Artificial Intelligence in Nuclear Medicine

Automated dental registration and TMJ segmentation for virtual surgical planning of orthognathic surgery via three-step computer-based method

OBJECTIVE

This study developed and evaluated a computer-based method for automating the registration of scanned dental models with 3D reconstructed skulls and segmentation of the temporomandibular joint (TMJ).

METHODS

A dataset comprising 1274 skull models and corresponding scanned dental models was collected. In total, 1066 cases were used for the development of the computer-based method, while 208 cases were used for validation. Performance was evaluated by comparing the automated results with manual registration and segmentation performed by clinicians, using accuracy and completeness metrics (e.g. intersection of union [IoU] and Dice similarity coefficient [DSC]).

RESULTS

The automated registration achieved a mean absolute error of 0.35 mm for the maxilla and 0.38 mm for the mandible, and a root mean squared error of 0.46 mm and 0.39 mm, respectively. The automatic TMJ segmentation exhibited an accuracy of 97.48 %, a precision of 97.06 %, a IoU of 95.72 %, DSC of 97.3 %, and a Hausdorff value of 1.87 mm, which were sufficient for clinical application.

CONCLUSION

The proposed method significantly improved the efficiency of orthognathic surgical planning by automating the registration and segmentation processes. The accuracy and precision of the automated results were sufficient for clinical use, reducing the workload on clinicians and facilitating faster and more reliable surgical planning.

CLINICAL SIGNIFICANCE

The computer-based method streamlines orthognathic surgical planning, enhancing precision and efficiency without compromising clinical accuracy, ultimately improving patient outcomes and reducing the workload of surgeons.

The clinical application of artificial intelligence in cancer precision treatment

BACKGROUND

Artificial intelligence has made significant contributions to oncology through the availability of high-dimensional datasets and advances in computing and deep learning. Cancer precision medicine aims to optimize therapeutic outcomes and reduce side effects for individual cancer patients. However, a comprehensive review describing the impact of artificial intelligence on cancer precision medicine is lacking.

OBSERVATIONS

By collecting and integrating large volumes of data and applying it to clinical tasks across various algorithms and models, artificial intelligence plays a significant role in cancer precision medicine. Here, we describe the general principles of artificial intelligence, including machine learning and deep learning. We further summarize the latest developments in artificial intelligence applications in cancer precision medicine. In tumor precision treatment, artificial intelligence plays a crucial role in individualizing both conventional and emerging therapies. In specific fields, including target prediction, targeted drug generation, immunotherapy response prediction, neoantigen prediction, and identification of long non-coding RNA, artificial intelligence offers promising perspectives. Finally, we outline the current challenges and ethical issues in the field.

CONCLUSIONS

Recent clinical studies demonstrate that artificial intelligence is involved in cancer precision medicine and has the potential to benefit cancer healthcare, particularly by optimizing conventional therapies, emerging targeted therapies, and individual immunotherapies. This review aims to provide valuable resources to clinicians and researchers and encourage further investigation in this field.

Exploring Mortality and Prognostic Factors of Heart Failure with In-Hospital and Emergency Patients by Electronic Medical Records: A Machine Learning Approach

Purpose

As HF progresses into advanced HF, patients experience a poor quality of life, distressing symptoms, intensive care use, social distress, and eventual hospital death. We aimed to investigate the relationship between morality and potential prognostic factors among in-patient and emergency patients with HF.

Patients and Methods

A case series study: Data are collected from in-hospital and emergency care patients from 2014 to 2021, including their international classification of disease at admission, and laboratory data such as blood count, liver and renal functions, lipid profile, and other biochemistry from the hospital's electrical medical records. After a series of data pre-processing in the electronic medical record system, several machine learning models were used to evaluate predictions of HF mortality. The outcomes of those potential risk factors were visualized by different statistical analyses.

Results

In total, 3871 hF patients were enrolled. Logistic regression showed that intensive care unit (ICU) history within 1 week (OR: 9.765, 95% CI: 6.65, 14.34; p-value < 0.001) and prothrombin time (OR: 1.193, 95% CI: 1.098, 1.296; <0.001) were associated with mortality. Similar results were obtained when we analyzed the data using Cox regression instead of logistic regression. Random forest, support vector machine (SVM), Adaboost, and logistic regression had better overall performances with areas under the receiver operating characteristic curve (AUROCs) of >0.87. Naïve Bayes was the best in terms of both specificity and precision. With ensemble learning, age, ICU history within 1 week, and respiratory rate (BF) were the top three compelling risk factors affecting mortality due to HF. To improve the explainability of the AI models, Shapley Additive Explanations methods were also conducted.

Conclusion

Exploring HF mortality and its patterns related to clinical risk factors by machine learning models can help physicians make appropriate decisions when monitoring HF patients' health quality in the hospital.

Artificial intelligence and glaucoma: a lucid and comprehensive review

Glaucoma is a pathologically irreversible eye illness in the realm of ophthalmic diseases. Because it is difficult to detect concealed and non-obvious progressive changes, clinical diagnosis and treatment of glaucoma is extremely challenging. At the same time, screening and monitoring for glaucoma disease progression are crucial. Artificial intelligence technology has advanced rapidly in all fields, particularly medicine, thanks to ongoing in-depth study and algorithm extension. Simultaneously, research and applications of machine learning and deep learning in the field of glaucoma are fast evolving. Artificial intelligence, with its numerous advantages, will raise the accuracy and efficiency of glaucoma screening and diagnosis to new heights, as well as significantly cut the cost of diagnosis and treatment for the majority of patients. This review summarizes the relevant applications of artificial intelligence in the screening and diagnosis of glaucoma, as well as reflects deeply on the limitations and difficulties of the current application of artificial intelligence in the field of glaucoma, and presents promising prospects and expectations for the application of artificial intelligence in other eye diseases such as glaucoma.

Oral Microbe Community and Pyramid Scene Parsing Network-based Periodontitis Risk Prediction

BACKGROUND

Periodontitis (PD) is a common chronic inflammatory disease affecting the gums and supporting tooth structures. It is often diagnosed only after significant irreversible tissue damage - such as gum recession and bone loss - has occurred, leading to tooth loss and systemic complications. Early detection of PD risk is therefore critical. This study integrates the Pyramid Scene Parsing Network (PSPNet), a deep learning model, with dental plaque microbial profiling data to generate a Periodontitis Risk Score (PRS) for identifying individuals at high risk of developing PD.

METHODS

Microbial profiling data from dental plaque samples of 90 healthy controls (CON) and 514 PD patients were obtained from the Gene Expression Omnibus database (GSE32159). A preprocessing algorithm identified predictive indicators for PD and calculated actual PRS values (PRSActual) for both groups. The maximum theoretical PRS was set to '1' for clinically diagnosed PD patients and '0' for CON. The differential algorithm was embedded into PSPNet, which was trained using the generated dataset. The model's predictive ability was evaluated by comparing PSPnet-based PRS (PRSPSPnet) with PRSActual.

RESULTS

After preprocessing, 27 indicators were identified for PD risk prediction. The PRSActual range ranged from 0.011 to 0.524 (mean 0.485) for CON and from 0.589 to 0.700 (mean 0.682) for PD patients, successfully distinguishing between the groups. The mean absolute error between PRSPSPnet and PRSActual was 0.027, with an average computation time per sample of 10-5 seconds, demonstrating both accuracy and efficiency.

CONCLUSION

By combining microbial profiling with PSPNet, this study offers a reliable, efficient, and noninvasive method for early screening of individuals at high risk of PD. This approach can help prevent irreversible periodontal damage, improve oral health, and reduce the associated health and economic burdens.

Artificial intelligence in fracture detection on radiographs: a literature review

Fractures are one of the most common reasons of admission to emergency department affecting individuals of all ages and regions worldwide that can be misdiagnosed during radiologic examination. Accurate and timely diagnosis of fracture is crucial for patients, and artificial intelligence that uses algorithms to imitate human intelligence to aid or enhance human performs is a promising solution to address this issue. In the last few years, numerous commercially available algorithms have been developed to enhance radiology practice and a large number of studies apply artificial intelligence to fracture detection. Recent contributions in literature have described numerous advantages showing how artificial intelligence performs better than doctors who have less experience in interpreting musculoskeletal X-rays, and assisting radiologists increases diagnostic accuracy and sensitivity, improves efficiency, and reduces interpretation time. Furthermore, algorithms perform better when they are trained with big data on a wide range of fracture patterns and variants and can provide standardized fracture identification across different radiologist, thanks to the structured report. In this review article, we discuss the use of artificial intelligence in fracture identification and its benefits and disadvantages. We also discuss its current potential impact on the field of radiology and radiomics.

A Review of the Utility and Limitations of Artificial Intelligence in Retinal Disorders and Pediatric Ophthalmology

Artificial intelligence (AI) is reshaping ophthalmology by enhancing diagnostic precision and treatment strategies, particularly in retinal disorders and pediatric ophthalmology. This review examines AI's efficacy in diagnosing conditions such as diabetic retinopathy (DR) and age-related macular degeneration (AMD) using imaging techniques, such as optical coherence tomography (OCT) and fundus photography. AI also shows promise in pediatric care, aiding in the screening of retinopathy of prematurity (ROP) and the management of conditions, including pediatric cataracts and strabismus. However, the integration of AI in ophthalmology presents challenges, including ethical concerns regarding algorithm biases, privacy issues, and limitations in data set quality. Addressing these challenges is crucial to ensure AI's responsible and effective deployment in clinical settings. This review synthesizes current research, underscoring AI's transformative potential in ophthalmology while highlighting critical considerations for its ethical use and technological advancement.

Radiation Detectors and Sensors in Medical Imaging

Medical imaging instrumentation design and construction is based on radiation sources and radiation detectors/sensors. This review focuses on the detectors and sensors of medical imaging systems. These systems are subdivided into various categories depending on their structure, the type of radiation they capture, how the radiation is measured, how the images are formed, and the medical goals they serve. Related to medical goals, detectors fall into two major areas: (i) anatomical imaging, which mainly concerns the techniques of diagnostic radiology, and (ii) functional-molecular imaging, which mainly concerns nuclear medicine. An important parameter in the evaluation of the detectors is the combination of the quality of the diagnostic result they offer and the burden of the patient with radiation dose. The latter has to be minimized; thus, the input signal (radiation photon flux) must be kept at low levels. For this reason, the detective quantum efficiency (DQE), expressing signal-to-noise ratio transfer through an imaging system, is of primary importance. In diagnostic radiology, image quality is better than in nuclear medicine; however, in most cases, the dose is higher. On the other hand, nuclear medicine focuses on the detection of functional findings and not on the accurate spatial determination of anatomical data. Detectors are integrated into projection or tomographic imaging systems and are based on the use of scintillators with optical sensors, photoconductors, or semiconductors. Analysis and modeling of such systems can be performed employing theoretical models developed in the framework of cascaded linear systems analysis (LCSA), as well as within the signal detection theory (SDT) and information theory.

Between Two Worlds: Investigating the Intersection of Human Expertise and Machine Learning in the Case of Coronary Artery Disease Diagnosis

Coronary artery disease (CAD) presents a significant global health burden, with early and accurate diagnostics crucial for effective management and treatment strategies. This study evaluates the efficacy of human evaluators compared to a Random Forest (RF) machine learning model in predicting CAD risk. It investigates the impact of incorporating human clinical judgments into the RF model's predictive capabilities. We recruited 606 patients from the Department of Nuclear Medicine at the University Hospital of Patras, Greece, from 16 February 2018 to 28 February 2022. Clinical data inputs included age, sex, comprehensive cardiovascular history (including prior myocardial infarction and revascularisation), CAD predisposing factors (such as hypertension, dyslipidemia, smoking, diabetes, and peripheral arteriopathy), baseline ECG abnormalities, and symptomatic descriptions ranging from asymptomatic states to angina-like symptoms and dyspnea on exertion. The diagnostic accuracies of human evaluators and the RF model (when trained with datasets inclusive of human judges' assessments) were comparable at 79% and 80.17%, respectively. However, the performance of the RF model notably declined to 73.76% when human clinical judgments were excluded from its training dataset. These results highlight a potential synergistic relationship between human expertise and advanced algorithmic predictions, suggesting a hybrid approach as a promising direction for enhancing CAD diagnostics.

The metaverse in nuclear medicine: transformative applications, challenges, and future directions

The metaverse, a rapidly evolving virtual reality space, holds immense potential to revolutionize nuclear medicine by enhancing education, training, diagnostics, and therapeutics. This review explores the transformative applications of the metaverse in nuclear medicine, where immersive virtual learning environments, simulation-based training, artificial intelligence (AI)-powered decision support systems integrated into interactive three-dimensional (3D) visualizations, and personalized dosimetry using realistic patient-specific virtual models are seamlessly incorporated into the metaverse ecosystem, creating a synergistic platform for healthcare professionals and patients alike. However, the responsible and sustainable adoption of the metaverse in nuclear medicine requires a multidisciplinary approach to address challenges related to standardization, accessibility, data security, and ethical concerns. The formation of cross-disciplinary consortia, increased research and development (R&D) investment, and the strengthening of data governance and cybersecurity measures are crucial steps in ensuring the safe and effective integration of the metaverse in healthcare. As the metaverse continues to evolve, researchers, practitioners, and policymakers must collaborate and explore its potential, navigate the challenges, and shape a future where technology and medicine seamlessly integrate to enhance patient care and outcomes in nuclear medicine. Further research is needed to fully understand the implications of the metaverse in clinical practice, education, and research, as well as to develop evidence-based guidelines for its responsible implementation. By embracing responsible innovation and collaboration, the nuclear medicine community can harness the power of the metaverse to transform and improve patient care.

Application of AI-empowered scenario-based simulation teaching mode in cardiovascular disease education

BACKGROUND

Cardiovascular diseases present a significant challenge in clinical practice due to their sudden onset and rapid progression. The management of these conditions necessitates cardiologists to possess strong clinical reasoning and individual competencies. The internship phase is crucial for medical students to transition from theory to practical application, with an emphasis on developing clinical thinking and skills. Despite the critical need for education on cardiovascular diseases, there is a noticeable gap in research regarding the utilization of artificial intelligence in clinical simulation teaching.

OBJECTIVE

This study aims to evaluate the effect and influence of AI-empowered scenario-based simulation teaching mode in the teaching of cardiovascular diseases.

METHODS

The study utilized a quasi-experimental research design and mixed-methods. The control group comprised 32 students using traditional teaching mode, while the experimental group included 34 students who were instructed on cardiovascular diseases using the AI-empowered scenario-based simulation teaching mode. Data collection included post-class tests, "Mini-CEX" assessments, Clinical critical thinking scale from both groups, and satisfaction surveys from experimental group. Qualitative data were gathered through semi-structured interviews.

RESULTS

Research shows that compared with traditional teaching models, AI-empowered scenario-based simulation teaching mode significantly improve students' performance in many aspects. The theoretical knowledge scores(P < 0.001), clinical operation skills(P = 0.0416) and clinical critical thinking abilities of students(P < 0.001) in the experimental group were significantly improved. The satisfaction survey showed that students in the experimental group were more satisfied with the teaching scene(P = 0.008), Individual participation(P = 0.006) and teaching content(P = 0.009). There is no significant difference in course discussion, group cooperation and teaching style of teachers(P > 0.05). Additionally, the qualitative data from the interviews highlighted three themes: (1) Positive new learning experience, (2) Improved clinical critical thinking skills, and (3) Valuable suggestions and concerns for further improvement.

CONCLUSION

The AI-empowered scenario simulation teaching Mode plays an important role in the improvement of clinical thinking and skills of medical undergraduates. This study believes that the AI-empowered scenario simulation teaching mode is an effective and feasible teaching model, which is worthy of promotion in other courses.

A systematic literature analysis of multi-organ cancer diagnosis using deep learning techniques

Cancer is becoming the most toxic ailment identified among individuals worldwide. The mortality rate has been increasing rapidly every year, which causes progression in the various diagnostic technologies to handle this illness. The manual procedure for segmentation and classification with a large set of data modalities can be a challenging task. Therefore, a crucial requirement is to significantly develop the computer-assisted diagnostic system intended for the initial cancer identification. This article offers a systematic review of Deep Learning approaches using various image modalities to detect multi-organ cancers from 2012 to 2023. It emphasizes the detection of five supreme predominant tumors, i.e., breast, brain, lung, skin, and liver. Extensive review has been carried out by collecting research and conference articles and book chapters from reputed international databases, i.e., Springer Link, IEEE Xplore, Science Direct, PubMed, and Wiley that fulfill the criteria for quality evaluation. This systematic review summarizes the overview of convolutional neural network model architectures and datasets used for identifying and classifying the diverse categories of cancer. This study accomplishes an inclusive idea of ensemble deep learning models that have achieved better evaluation results for classifying the different images into cancer or healthy cases. This paper will provide a broad understanding to the research scientists within the domain of medical imaging procedures of which deep learning technique perform best over which type of dataset, extraction of features, different confrontations, and their anticipated solutions for the complex problems. Lastly, some challenges and issues which control the health emergency have been discussed.

Explainable and visualizable machine learning models to predict biochemical recurrence of prostate cancer

PURPOSE

Machine learning (ML) models presented an excellent performance in the prognosis prediction. However, the black box characteristic of ML models limited the clinical applications. Here, we aimed to establish explainable and visualizable ML models to predict biochemical recurrence (BCR) of prostate cancer (PCa).

MATERIALS AND METHODS

A total of 647 PCa patients were retrospectively evaluated. Clinical parameters were identified using LASSO regression. Then, cohort was split into training and validation datasets with a ratio of 0.75:0.25 and BCR-related features were included in Cox regression and five ML algorithm to construct BCR prediction models. The clinical utility of each model was evaluated by concordance index (C-index) values and decision curve analyses (DCA). Besides, Shapley Additive Explanation (SHAP) values were used to explain the features in the models.

RESULTS

We identified 11 BCR-related features using LASSO regression, then establishing five ML-based models, including random survival forest (RSF), survival support vector machine (SSVM), survival Tree (sTree), gradient boosting decision tree (GBDT), extreme gradient boosting (XGBoost), and a Cox regression model, C-index were 0.846 (95%CI 0.796-0.894), 0.774 (95%CI 0.712-0.834), 0.757 (95%CI 0.694-0.818), 0.820 (95%CI 0.765-0.869), 0.793 (95%CI 0.735-0.852), and 0.807 (95%CI 0.753-0.858), respectively. The DCA showed that RSF model had significant advantages over all models. In interpretability of ML models, the SHAP value demonstrated the tangible contribution of each feature in RSF model.

CONCLUSIONS

Our score system provide reference for the identification for BCR, and the crafting of a framework for making therapeutic decisions for PCa on a personalized basis.

Deep learning for temporomandibular joint arthropathies: A systematic review and meta-analysis

BACKGROUND AND OBJECTIVE

The accurate diagnosis of temporomandibular disorders continues to be a challenge, despite the existence of internationally agreed-upon diagnostic criteria. The purpose of this study is to review applications of deep learning models in the diagnosis of temporomandibular joint arthropathies.

MATERIALS AND METHODS

An electronic search was conducted on PubMed, Scopus, Embase, Google Scholar, IEEE, arXiv, and medRxiv up to June 2023. Studies that reported the efficacy (outcome) of prediction, object detection or classification of TMJ arthropathies by deep learning models (intervention) of human joint-based or arthrogenous TMDs (population) in comparison to reference standard (comparison) were included. To evaluate the risk of bias, included studies were critically analysed using the quality assessment of diagnostic accuracy studies (QUADAS-2). Diagnostic odds ratios (DOR) were calculated. Forrest plot and funnel plot were created using STATA 17 and MetaDiSc.

RESULTS

Full text review was performed on 46 out of the 1056 identified studies and 21 studies met the eligibility criteria and were included in the systematic review. Four studies were graded as having a low risk of bias for all domains of QUADAS-2. The accuracy of all included studies ranged from 74% to 100%. Sensitivity ranged from 54% to 100%, specificity: 85%-100%, Dice coefficient: 85%-98%, and AUC: 77%-99%. The datasets were then pooled based on the sensitivity, specificity, and dataset size of seven studies that qualified for meta-analysis. The pooled sensitivity was 95% (85%-99%), specificity: 92% (86%-96%), and AUC: 97% (96%-98%). DORs were 232 (74-729). According to Deek's funnel plot and statistical evaluation (p =.49), publication bias was not present.

CONCLUSION

Deep learning models can detect TMJ arthropathies high sensitivity and specificity. Clinicians, and especially those not specialized in orofacial pain, may benefit from this methodology for assessing TMD as it facilitates a rigorous and evidence-based framework, objective measurements, and advanced analysis techniques, ultimately enhancing diagnostic accuracy.

Machine Learning-Assisted Decision Making in Orthopaedic Oncology

» Artificial intelligence is an umbrella term for computational calculations that are designed to mimic human intelligence and problem-solving capabilities, although in the future, this may become an incomplete definition. Machine learning (ML) encompasses the development of algorithms or predictive models that generate outputs without explicit instructions, assisting in clinical predictions based on large data sets. Deep learning is a subset of ML that utilizes layers of networks that use various inter-relational connections to define and generalize data.» ML algorithms can enhance radiomics techniques for improved image evaluation and diagnosis. While ML shows promise with the advent of radiomics, there are still obstacles to overcome.» Several calculators leveraging ML algorithms have been developed to predict survival in primary sarcomas and metastatic bone disease utilizing patient-specific data. While these models often report exceptionally accurate performance, it is crucial to evaluate their robustness using standardized guidelines.» While increased computing power suggests continuous improvement of ML algorithms, these advancements must be balanced against challenges such as diversifying data, addressing ethical concerns, and enhancing model interpretability.

Emergence of Artificial Intelligence and Machine Learning Models in Sudden Cardiac Arrest: A Comprehensive Review of Predictive Performance and Clinical Decision Support

Sudden cardiac death/sudden cardiac arrest (SCD/SCA) is an increasingly prevalent cause of mortality globally, particularly in individuals with preexisting cardiac conditions. The ambiguous premortem warnings and the restricted interventional window related to SCD account for the complexity of the condition. Current reports suggest SCD to be accountable for 20% of all deaths hence accurately predicting SCD risk is an imminent concern. Traditional approaches for predicting SCA, particularly "track-and-trigger" warning systems have demonstrated considerable inadequacies, including low sensitivity, false alarms, decreased diagnostic liability, reliance on clinician involvement, and human errors. Artificial intelligence (AI) and machine learning (ML) models have demonstrated near-perfect accuracy in predicting SCA risk, allowing clinicians to intervene timely. Given the constraints of current diagnostics, exploring the benefits of AI and ML models in enhancing outcomes for SCA/SCD is imperative. This review article aims to investigate the efficacy of AI and ML models in predicting and managing SCD, particularly targeting accuracy in prediction.

Machine learning based on functional and structural connectivity in mild cognitive impairment

OBJECTIVE

Alzheimer's disease (AD) is a chronic, degenerative neurological disorder characterized by progressive cognitive decline and mental behavioral abnormalities. Mild cognitive impairment (MCI) is regarded as a transitional stage in the progression from normal elderly individuals to patients with AD. While studies have identified abnormalities in brain connectivity in patients with MCI, including functional and structural connectivity, accurately identifying patients with MCI in clinical screening remains challenging. We hypothesized that utilizing machine learning (ML) based on both functional and structural connectivity could yield meaningful results in distinguishing between patients with MCI and normal elderly individuals, so as to provide valuable information for early diagnosis and precise evaluation of patients with MCI.

METHODS

Following clinical criteria, we recruited 32 patients with MCI for the patient group, and 32 normal elderly individuals for the control group. All subjects underwent examinations for resting-state functional magnetic resonance imaging (rs-fMRI) and diffusion tensor imaging (DTI). Subsequently, significant functional and structural connectivity features were selected and combined with a support vector machine for classification of the patient and control groups.

RESULTS

We observed significantly different functional connectivity in the frontal lobe and putamen between the MCI group and normal controls. The results based on functional connectivity features demonstrated a classification accuracy of 71.88% and an area under the curve (AUC) value of 0.78. In terms of structural connectivity, we found that decreased fractional anisotropy in patients with MCI was significantly associated with Montreal Cognitive Assessment scores, specifically in regions such as the precuneus and cingulate gyrus. The classification results using the structural connectivity feature yielded an accuracy of 92.19% and an AUC value of 0.99. Lastly, combining functional and structural connectivity features resulted in a classification accuracy and AUC value of 93.75% and 0.99, respectively.

CONCLUSIONS

In this study, we demonstrated a high classification performance, underscoring the potential of both brain functional and structural connectivity in distinguishing patients with MCI from normal elderly individuals. Furthermore, the integration of functional connectivity and structural connectivity features indicated that utilizing rs-fMRI and DTI could enhance the accuracy and specificity of identifying patients with MCI compared with relying on a single neuroimaging technique.

Improving the classification of multiple sclerosis and cerebral small vessel disease with interpretable transfer attention neural network

As an autoimmune-mediated inflammatory demyelinating disease of the central nervous system, multiple sclerosis (MS) is often confused with cerebral small vessel disease (cSVD), which is a regional pathological change in brain tissue with unknown pathogenesis. This is due to their similar clinical presentations and imaging manifestations. That misdiagnosis can significantly increase the occurrence of adverse events. Delayed or incorrect treatment is one of the most important causes of MS progression. Therefore, the development of a practical diagnostic imaging aid could significantly reduce the risk of misdiagnosis and improve patient prognosis. We propose an interpretable deep learning (DL) model that differentiates MS and cSVD using T2-weighted fluid-attenuated inversion recovery (FLAIR) images. Transfer learning (TL) was utilized to extract features from the ImageNet dataset. This pioneering model marks the first of its kind in neuroimaging, showing great potential in enhancing differential diagnostic capabilities within the field of neurological disorders. Our model extracts the texture features of the images and achieves more robust feature learning through two attention modules. The attention maps provided by the attention modules provide model interpretation to validate model learning and reveal more information to physicians. Finally, the proposed model is trained end-to-end using focal loss to reduce the influence of class imbalance. The model was validated using clinically diagnosed MS (n=112) and cSVD (n=321) patients from the Beijing Tiantan Hospital. The performance of the proposed model was better than that of two commonly used DL approaches, with a mean balanced accuracy of 86.06 % and a mean area under the receiver operating characteristic curve of 98.78 %. Moreover, the generated attention heat maps showed that the proposed model could focus on the lesion signatures in the image. The proposed model provides a practical diagnostic imaging aid for the use of routinely available imaging techniques such as magnetic resonance imaging to classify MS and cSVD by linking DL to human brain disease. We anticipate a substantial improvement in accurately distinguishing between various neurological conditions through this novel model.

EfficientNet-Based System for Detecting EGFR-Mutant Status and Predicting Prognosis of Tyrosine Kinase Inhibitors in Patients with NSCLC

We aimed to develop and validate a deep learning-based system using pre-therapy computed tomography (CT) images to detect epidermal growth factor receptor (EGFR)-mutant status in patients with non-small cell lung cancer (NSCLC) and predict the prognosis of advanced-stage patients with EGFR mutations treated with EGFR tyrosine kinase inhibitors (TKI). This retrospective, multicenter study included 485 patients with NSCLC from four hospitals. Of them, 339 patients from three centers were included in the training dataset to develop an EfficientNetV2-L-based model (EME) for predicting EGFR-mutant status, and the remaining patients were assigned to an independent test dataset. EME semantic features were extracted to construct an EME-prognostic model to stratify the prognosis of EGFR-mutant NSCLC patients receiving EGFR-TKI. A comparison of EME and radiomics was conducted. Additionally, we included patients from The Cancer Genome Atlas lung adenocarcinoma dataset with both CT images and RNA sequencing data to explore the biological associations between EME score and EGFR-related biological processes. EME obtained an area under the curve (AUC) of 0.907 (95% CI 0.840-0.926) on the test dataset, superior to the radiomics model (P = 0.007). The EME and radiomics fusion model showed better (AUC, 0.941) but not significantly increased performance (P = 0.895) compared with EME. In prognostic stratification, the EME-prognostic model achieved the best performance (C-index, 0.711). Moreover, the EME-prognostic score showed strong associations with biological pathways related to EGFR expression and EGFR-TKI efficacy. EME demonstrated a non-invasive and biologically interpretable approach to predict EGFR status, stratify survival prognosis, and correlate biological pathways in patients with NSCLC.

Computer-assisted decision support for the usage of preventive antibacterial therapy in children with febrile pyelonephritis: A preliminary study

Urinary tract infection (UTI) is one of the most common infectious diseases among children, but there is controversy regarding the use of preventive antibiotics for children first diagnosed with febrile pyelonephritis. To the best of our knowledge, no studies have addressed this issue by the deep learning technology. Therefore, in the current study, we conducted a study using Tc 99 m - DMSA renal static imaging data to investigate the need for preventive antibiotics on children first diagnosed with febrile pyelonephritis under 2 years old. The self-collected dataset comprised 64 children who did not require preventive antibiotic treatments and 112 children who did. Using several classic deep learning models, we verified that it is feasible to screen whether the first diagnosed children with febrile pyelonephritis require preventive antibacterial therapy, achieving a graded diagnosis. With the AlexNet model, we obtained accuracy of 84.05%, sensitivity of 81.71% and specificity of 86.70%, respectively. The experimental results indicate that deep learning technology could provide a new avenue to implement computer-assisted decision support for the diagnosis of the febrile pyelonephritis.

Cancer Immunotherapy and Medical Imaging Research Trends from 2003 to 2023: A Bibliometric Analysis

Purpose

With the rapid development of immunotherapy, cancer treatment has entered a new phase. Medical imaging, as a primary diagnostic method, is closely related to cancer immunotherapy. However, until now, there has been no systematic bibliometric analysis of the state of this field. Therefore, the main purpose of this article is to clarify the past research trajectory, summarize current research hotspots, reveal dynamic scientific developments, and explore future research directions.

Patients and Methods

A comprehensive search was conducted on the Web of Science Core Collection (WoSCC) database to identify publications related to immunotherapy specifically for the medical imaging of carcinoma. The search spanned the period from the year 2003 to 2023. Several analytical tools were employed. These included CiteSpace (6.2.4), and the Microsoft Office Excel (2016).

Results

By searching the database, a total of 704 English articles published between 2003 and 2023 were obtained. We have observed a rapid increase in the number of publications since 2018. The two most active countries are the United States (n=265) and China (n=170). Pittock, Sean J and Abu-sbeih, Hamzah are very concerned about the relationship between cancer immunotherapy and medical images and have published more academic papers (n = 5; n = 4). Among the top 10 co-cited authors, Topalian Sl (n=43) cited ranked first, followed by Graus F (n=40) cited. According to clustering, timeline, and burst word analysis, the results show that the current research focus is on "MRI", "deep learning", "tumor microenvironment" and so on.

Conclusion

Medical imaging and cancer immunotherapy are hot topics. The United States is the country with the most publications and the greatest influence in this field, followed by China. "MRI", "PET/PET-CT", "deep learning", "immune-related adverse events" and "tumor microenvironment" are currently hot research topics and potential targets.

Machine Learning in Diagnosis and Prognosis of Lung Cancer by PET-CT

As a disease with high morbidity and high mortality, lung cancer has seriously harmed people's health. Therefore, early diagnosis and treatment are more important. PET/CT is usually used to obtain the early diagnosis, staging, and curative effect evaluation of tumors, especially lung cancer, due to the heterogeneity of tumors and the differences in artificial image interpretation and other reasons, it also fails to entirely reflect the real situation of tumors. Artificial intelligence (AI) has been applied to all aspects of life. Machine learning (ML) is one of the important ways to realize AI. With the help of the ML method used by PET/CT imaging technology, there are many studies in the diagnosis and treatment of lung cancer. This article summarizes the application progress of ML based on PET/CT in lung cancer, in order to better serve the clinical. In this study, we searched PubMed using machine learning, lung cancer, and PET/CT as keywords to find relevant articles in the past 5 years or more. We found that PET/CT-based ML approaches have achieved significant results in the detection, delineation, classification of pathology, molecular subtyping, staging, and response assessment with survival and prognosis of lung cancer, which can provide clinicians a powerful tool to support and assist in critical daily clinical decisions. However, ML has some shortcomings such as slightly poor repeatability and reliability.

Machine-learning prediction of a novel diagnostic model using mitochondria-related genes for patients with bladder cancer

Bladder cancer (BC) is the ninth most-common cancer worldwide and it is associated with high morbidity and mortality. Mitochondrial Dysfunction is involved in the progression of BC. This study aimed to developed a novel diagnostic model based on mitochondria-related genes (MRGs) for BC patients using Machine Learning. In this study, we analyzed GSE13507 datasets and identified 752 DE-MRGs in BC specimens. Functional enrichment analysis uncovered the significant roles of 752 DE-MRGs in key processes such as cellular and organ development, as well as gene regulation. The analysis revealed the crucial functions of these genes in transcriptional regulation and protein-DNA interactions. Then, we performed LASSO and SVM-RFE, and identified four critical diagnostic genes including GLRX2, NMT1, OXSM and TRAF3IP3. Based on the above four genes, we developed a novel diagnostic model whose diagnostic value was confirmed in GSE13507, GSE3167 and GSE37816 datasets. Moreover, we reported the expressing pattern of GLRX2, NMT1, OXSM and TRAF3IP3 in BC samples. Immune cell infiltration analysis revealed that the four genes were associated with several immune cells. Finally, we performed RT-PCR and confirmed NMT1 was highly expressed in BC cells. Functional experiments revealed that knockdown of NMT1 suppressed the proliferation of BC cells. Overall, we have formulated a diagnostic potential that offered a comprehensive framework for delving into the underlying mechanisms of BC. Before proceeding with clinical implementation, it is essential to undertake further investigative efforts to validate its diagnostic effectiveness in BC patients.

Machine Learning Methods Using Artificial Intelligence Deployed on Electronic Health Record Data for Identification and Referral of At-Risk Patients From Primary Care Physicians to Eye Care Specialists: Retrospective, Case-Controlled Study

BACKGROUND

Identification and referral of at-risk patients from primary care practitioners (PCPs) to eye care professionals remain a challenge. Approximately 1.9 million Americans suffer from vision loss as a result of undiagnosed or untreated ophthalmic conditions. In ophthalmology, artificial intelligence (AI) is used to predict glaucoma progression, recognize diabetic retinopathy (DR), and classify ocular tumors; however, AI has not yet been used to triage primary care patients for ophthalmology referral.

OBJECTIVE

This study aimed to build and compare machine learning (ML) methods, applicable to electronic health records (EHRs) of PCPs, capable of triaging patients for referral to eye care specialists.

METHODS

Accessing the Optum deidentified EHR data set, 743,039 patients with 5 leading vision conditions (age-related macular degeneration [AMD], visually significant cataract, DR, glaucoma, or ocular surface disease [OSD]) were exact-matched on age and gender to 743,039 controls without eye conditions. Between 142 and 182 non-ophthalmic parameters per patient were input into 5 ML methods: generalized linear model, L1-regularized logistic regression, random forest, Extreme Gradient Boosting (XGBoost), and J48 decision tree. Model performance was compared for each pathology to select the most predictive algorithm. The area under the curve (AUC) was assessed for all algorithms for each outcome.

RESULTS

XGBoost demonstrated the best performance, showing, respectively, a prediction accuracy and an AUC of 78.6% (95% CI 78.3%-78.9%) and 0.878 for visually significant cataract, 77.4% (95% CI 76.7%-78.1%) and 0.858 for exudative AMD, 79.2% (95% CI 78.8%-79.6%) and 0.879 for nonexudative AMD, 72.2% (95% CI 69.9%-74.5%) and 0.803 for OSD requiring medication, 70.8% (95% CI 70.5%-71.1%) and 0.785 for glaucoma, 85.0% (95% CI 84.2%-85.8%) and 0.924 for type 1 nonproliferative diabetic retinopathy (NPDR), 82.2% (95% CI 80.4%-84.0%) and 0.911 for type 1 proliferative diabetic retinopathy (PDR), 81.3% (95% CI 81.0%-81.6%) and 0.891 for type 2 NPDR, and 82.1% (95% CI 81.3%-82.9%) and 0.900 for type 2 PDR.

CONCLUSIONS

The 5 ML methods deployed were able to successfully identify patients with elevated odds ratios (ORs), thus capable of patient triage, for ocular pathology ranging from 2.4 (95% CI 2.4-2.5) for glaucoma to 5.7 (95% CI 5.0-6.4) for type 1 NPDR, with an average OR of 3.9. The application of these models could enable PCPs to better identify and triage patients at risk for treatable ophthalmic pathology. Early identification of patients with unrecognized sight-threatening conditions may lead to earlier treatment and a reduced economic burden. More importantly, such triage may improve patients' lives.

Verification of image quality improvement of low-count bone scintigraphy using deep learning

To improve image quality for low-count bone scintigraphy using deep learning and evaluate their clinical applicability. Six hundred patients (training, 500; validation, 50; evaluation, 50) were included in this study. Low-count original images (75%, 50%, 25%, 10%, and 5% counts) were generated from reference images (100% counts) using Poisson resampling. Output (DL-filtered) images were obtained after training with U-Net using reference images as teacher data. Gaussian-filtered images were generated for comparison. Peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) to the reference image were calculated to determine image quality. Artificial neural network (ANN) value, bone scan index (BSI), and number of hotspots (Hs) were computed using BONENAVI analysis to assess diagnostic performance. Accuracy of bone metastasis detection and area under the curve (AUC) were calculated. PSNR and SSIM for DL-filtered images were highest in all count percentages. BONENAVI analysis values for DL-filtered images did not differ significantly, regardless of the presence or absence of bone metastases. BONENAVI analysis values for original and Gaussian-filtered images differed significantly at ≦25% counts in patients without bone metastases. In patients with bone metastases, BSI and Hs for original and Gaussian-filtered images differed significantly at ≦10% counts, whereas ANN values did not. The accuracy of bone metastasis detection was highest for DL-filtered images in all count percentages; the AUC did not differ significantly. The deep learning method improved image quality and bone metastasis detection accuracy for low-count bone scintigraphy, suggesting its clinical applicability.

A look at radiation detectors and their applications in medical imaging

The effectiveness and precision of disease diagnosis and treatment have increased, thanks to developments in clinical imaging over the past few decades. Science is developing and progressing steadily in imaging modalities, and effective outcomes are starting to show up as a result of the shorter scanning periods needed as well as the higher-resolution images generated. The choice of one clinical device over another is influenced by technical disparities among the equipment, such as detection medium, shorter scan time, patient comfort, cost-effectiveness, accessibility, greater sensitivity and specificity, and spatial resolution. Lately, computational algorithms, artificial intelligence (AI), in particular, have been incorporated with diagnostic and treatment techniques, including imaging systems. AI is a discipline comprised of multiple computational and mathematical models. Its applications aided in manipulating sophisticated data in imaging processes and increased imaging tests' accuracy and precision during diagnosis. Computed tomography (CT), positron emission tomography (PET), and Single Photon Emission Computed Tomography (SPECT) along with their corresponding radiation detectors have been reviewed in this study. This review will provide an in-depth explanation of the above-mentioned imaging modalities as well as the radiation detectors that are their essential components. From the early development of these medical instruments till now, various modifications and improvements have been done and more is yet to be established for better performance which calls for a necessity to capture the available information and record the gaps to be filled for better future advances.

Deep learning-based automated kidney and cyst segmentation of autosomal dominant polycystic kidney disease using single vs. multi-institutional data

PURPOSE

This study aimed to investigate if a deep learning model trained with a single institution's data has comparable accuracy to that trained with multi-institutional data for segmenting kidney and cyst regions in magnetic resonance (MR) images of patients affected by autosomal dominant polycystic kidney disease (ADPKD).

METHODS

We used TensorFlow with a Keras custom UNet on 2D slices of 756 MRI images of kidneys with ADPKD obtained from four institutions in the Consortium for Radiologic Imaging Studies of Polycystic Kidney Disease (CRISP) study. The ground truth was determined via a manual plus global thresholding method. Five models were trained with 80 % of all institutional data (n = 604) and each institutional data (n = 232, 172, 148, or 52), respectively, and validated with 10 % and tested on an unseen 10 % of the data. The model's performance was evaluated using the Dice Similarity Coefficient (DSC).

RESULTS

The DSCs by the model trained with all institutional data ranged from 0.92 to 0.95 for kidney image segmentation, only 1-2 % higher than those by the models trained with single institutional data (0.90-0.93).In cyst segmentation, however, the DSCs by the model trained with all institutional data ranged from 0.83 to 0.89, which were 2-20 % higher than those by the models trained with single institutional data (0.66-0.86).

CONCLUSION

The UNet performance, when trained with a single institutional dataset, exhibited similar accuracy to the model trained on a multi-institutional dataset. Segmentation accuracy increases with models trained on larger sample sizes, especially in more complex cyst segmentation.

A Systematic Review on Artificial Intelligence Evaluating Metastatic Prostatic Cancer and Lymph Nodes on PSMA PET Scans

Early detection of metastatic prostate cancer (mPCa) is crucial. Whilst the prostate-specific membrane antigen (PSMA) PET scan has high diagnostic accuracy, it suffers from inter-reader variability, and the time-consuming reporting process. This systematic review was registered on PROSPERO (ID CRD42023456044) and aims to evaluate AI's ability to enhance reporting, diagnostics, and predictive capabilities for mPCa on PSMA PET scans. Inclusion criteria covered studies using AI to evaluate mPCa on PSMA PET, excluding non-PSMA tracers. A search was conducted on Medline, Embase, and Scopus from inception to July 2023. After screening 249 studies, 11 remained eligible for inclusion. Due to the heterogeneity of studies, meta-analysis was precluded. The prediction model risk of bias assessment tool (PROBAST) indicated a low overall risk of bias in ten studies, though only one incorporated clinical parameters (such as age, and Gleason score). AI demonstrated a high accuracy (98%) in identifying lymph node involvement and metastatic disease, albeit with sensitivity variation (62-97%). Advantages included distinguishing bone lesions, estimating tumour burden, predicting treatment response, and automating tasks accurately. In conclusion, AI showcases promising capabilities in enhancing the diagnostic potential of PSMA PET scans for mPCa, addressing current limitations in efficiency and variability.

Radiomics and Deep Learning in Nasopharyngeal Carcinoma: A Review

Nasopharyngeal carcinoma is a common head and neck malignancy with distinct clinical management compared to other types of cancer. Precision risk stratification and tailored therapeutic interventions are crucial to improving the survival outcomes. Artificial intelligence, including radiomics and deep learning, has exhibited considerable efficacy in various clinical tasks for nasopharyngeal carcinoma. These techniques leverage medical images and other clinical data to optimize clinical workflow and ultimately benefit patients. In this review, we provide an overview of the technical aspects and basic workflow of radiomics and deep learning in medical image analysis. We then conduct a detailed review of their applications to seven typical tasks in the clinical diagnosis and treatment of nasopharyngeal carcinoma, covering various aspects of image synthesis, lesion segmentation, diagnosis, and prognosis. The innovation and application effects of cutting-edge research are summarized. Recognizing the heterogeneity of the research field and the existing gap between research and clinical translation, potential avenues for improvement are discussed. We propose that these issues can be gradually addressed by establishing standardized large datasets, exploring the biological characteristics of features, and technological upgrades.

Longitudinal imaging of murine atherosclerosis with 2-deoxy-2-[18F]fluoro-D-glucose and [18F]-sodium fluoride in genetically modified Apolipoprotein E knock-out and wild type mice

In a longitudinal design, four arterial segments in mice were followed by positron emission tomography/computed tomography (PET/CT) imaging. We aimed to determine how the tracers reflected the development of atherosclerosis via the uptake of 2-deoxy-2-[18F]fluoro-D-glucose ([18F]FDG) for imaging inflammation and [18F]-sodium fluoride (Na[18F]F) for imaging active microcalcification in a murine model of atherosclerosis. Apolipoprotein E knock-out (ApoE) mice and C57 BL/6NtaC (B6) mice were divided into four groups. They received either normal chow (N = 7, ApoE mice and N = 6, B6 mice) for 32 weeks or a high-fat diet (N = 6, ApoEHFD mice and N = 9, B6HFD mice) for 32 weeks. The mice were scanned with [18F]FDG and Na[18F]F using a dedicated small animal PET/CT scanner at three timepoints. The tracer uptakes in four aortic segments (abdominal aorta, aortic arch, ascending aorta, and thoracic aorta) were measured and reported as SUVmax values. The uptake of [18F]FDG (SUVmax: 5.7 ± 0.5 vs 1.9 ± 0.2, 230.3%, p =  < 0.0001) and Na[18F]F (SUVmax: 9.6 ± 1.8 vs 4.0 ± 0.3, 175%, p = 0.007) was significantly increased in the abdominal aorta of ApoEHFD mice at Week 32 compared to baseline abdominal aorta values of ApoEHFD mice. [18F]FDG uptake in the aortic arch, ascending aorta and the thoracic aorta of B6HFD mice at Week 32 showed a robust resemblance to the abdominal aorta uptake whereas the Na[18F]F uptake only resembled in the thoracic aorta of B6HFD mice at Week 32 compared to the abdominal aorta. The uptake of both [18F]FDG and Na[18F]F increased as the disease progressed over time, and the abdominal aorta provided a robust measure across mouse strain and diet. Therefore, it seems to be the preferred region for image readout. For [18F]FDG-PET, both B6 and ApoE mice provide valuable information and either mouse strain may be used in preclinical cardiovascular studies, whereas for Na[18F]F -PET, ApoE mice should be preferred.

A scoping review of interpretability and explainability concerning artificial intelligence methods in medical imaging

PURPOSE

To review eXplainable Artificial Intelligence/(XAI) methods available for medical imaging/(MI).

METHOD

A scoping review was conducted following the Joanna Briggs Institute's methodology. The search was performed on Pubmed, Embase, Cinhal, Web of Science, BioRxiv, MedRxiv, and Google Scholar. Studies published in French and English after 2017 were included. Keyword combinations and descriptors related to explainability, and MI modalities were employed. Two independent reviewers screened abstracts, titles and full text, resolving differences through discussion.

RESULTS

228 studies met the criteria. XAI publications are increasing, targeting MRI (n = 73), radiography (n = 47), CT (n = 46). Lung (n = 82) and brain (n = 74) pathologies, Covid-19 (n = 48), Alzheimer's disease (n = 25), brain tumors (n = 15) are the main pathologies explained. Explanations are presented visually (n = 186), numerically (n = 67), rule-based (n = 11), textually (n = 11), and example-based (n = 6). Commonly explained tasks include classification (n = 89), prediction (n = 47), diagnosis (n = 39), detection (n = 29), segmentation (n = 13), and image quality improvement (n = 6). The most frequently provided explanations were local (78.1 %), 5.7 % were global, and 16.2 % combined both local and global approaches. Post-hoc approaches were predominantly employed. The used terminology varied, sometimes indistinctively using explainable (n = 207), interpretable (n = 187), understandable (n = 112), transparent (n = 61), reliable (n = 31), and intelligible (n = 3).

CONCLUSION

The number of XAI publications in medical imaging is increasing, primarily focusing on applying XAI techniques to MRI, CT, and radiography for classifying and predicting lung and brain pathologies. Visual and numerical output formats are predominantly used. Terminology standardisation remains a challenge, as terms like "explainable" and "interpretable" are sometimes being used indistinctively. Future XAI development should consider user needs and perspectives.

Identifying immune infiltration by deep learning to assess the prognosis of patients with hepatocellular carcinoma

BACKGROUND

The treatment situation for hepatocellular carcinoma remains critical. The use of deep learning algorithms to assess immune infiltration is a promising new diagnostic tool.

METHODS

Patient data and whole slide images (WSIs) were obtained for the Xijing Hospital (XJH) cohort and TCGA cohort. We wrote programs using Visual studio 2022 with C# language to segment the WSI into tiles. Pathologists classified the tiles and later trained deep learning models using the ResNet 101V2 network via ML.NET with the TensorFlow framework. Model performance was evaluated using AccuracyMicro versus AccuracyMacro. Model performance was examined using ROC curves versus PR curves. The percentage of immune infiltration was calculated using the R package survminer to calculate the intergroup cutoff, and the Kaplan‒Meier method was used to plot the overall survival curve of patients. Cox regression was used to determine whether the percentage of immune infiltration was an independent risk factor for prognosis. A nomogram was constructed, and its accuracy was verified using time-dependent ROC curves with calibration curves. The CIBERSORT algorithm was used to assess immune infiltration between groups. Gene Ontology was used to explore the pathways of differentially expressed genes.

RESULTS

There were 100 WSIs and 165,293 tiles in the training set. The final deep learning models had an AccuracyMicro of 97.46% and an AccuracyMacro of 82.28%. The AUCs of the ROC curves on both the training and validation sets exceeded 0.95. The areas under the classification PR curves exceeded 0.85, except that of the TLS on the validation set, which might have had poor results (0.713) due to too few samples. There was a significant difference in OS between the TIL classification groups (p < 0.001), while there was no significant difference in OS between the TLS groups (p = 0.294). Cox regression showed that TIL percentage was an independent risk factor for prognosis in HCC patients (p = 0.015). The AUCs according to the nomogram were 0.714, 0.690, and 0.676 for the 1-year, 2-year, and 5-year AUCs in the TCGA cohort and 0.756, 0.797, and 0.883 in the XJH cohort, respectively. There were significant differences in the levels of infiltration of seven immune cell types between the two groups of samples, and gene ontology showed that the differentially expressed genes between the groups were immune related. Their expression levels of PD-1 and CTLA4 were also significantly different.

CONCLUSION

We constructed and tested a deep learning model that evaluates the immune infiltration of liver cancer tissue in HCC patients. Our findings demonstrate the value of the model in assessing patient prognosis, immune infiltration and immune checkpoint expression levels.

From FDG and beyond: the evolving potential of nuclear medicine

The radiopharmaceutical 2-[fluorine-18]fluoro-2-deoxy-D-glucose (FDG) has been dominantly used in positron emission tomography (PET) scans for over 20 years, and due to its vast utility its applications have expanded and are continuing to expand into oncology, neurology, cardiology, and infectious/inflammatory diseases. More recently, the addition of artificial intelligence (AI) has enhanced nuclear medicine diagnosis and imaging with FDG-PET, and new radiopharmaceuticals such as prostate-specific membrane antigen (PSMA) and fibroblast activation protein inhibitor (FAPI) have emerged. Nuclear medicine therapy using agents such as [177Lu]-dotatate surpasses conventional treatments in terms of efficacy and side effects. This article reviews recently established evidence of FDG and non-FDG drugs and anticipates the future trajectory of nuclear medicine.

New drug approvals for 2022: Synthesis and clinical applications

The U.S. Food and Drug Administration has approved a total of 37 new drugs in 2022, which are composed of 20 chemical entities and 17 biologics. In particular, 20 chemical entities, including 17 small molecule drugs, 1 radiotherapy, and 2 diagnostic agents, provide privileged scaffolds, breakthrough clinical benefits, and a new mechanism of action for the discovery of more potent clinical candidates. The structure-based drug development with clear targets and fragment-based drug development with privileged scaffolds have always been the important modules in the field of drug discovery, which could easily bypass the patent protection and bring about improved biological activity. Therefore, we summarized the relevant valuable information about clinical application, mechanism of action, and chemical synthesis of 17 newly approved small molecule drugs in 2022. We hope this timely and comprehensive review could bring about creative and elegant inspiration on the synthetic methodologies and mechanism of action for the discovery of new drugs with novel chemical scaffolds and extended clinical indications.

Transparency in Artificial Intelligence Research: a Systematic Review of Availability Items Related to Open Science in Radiology and Nuclear Medicine

RATIONALE AND OBJECTIVES

Reproducibility of artificial intelligence (AI) research has become a growing concern. One of the fundamental reasons is the lack of transparency in data, code, and model. In this work, we aimed to systematically review the radiology and nuclear medicine papers on AI in terms of transparency and open science.

MATERIALS AND METHODS

A systematic literature search was performed in PubMed to identify original research studies on AI. The search was restricted to studies published in Q1 and Q2 journals that are also indexed on the Web of Science. A random sampling of the literature was performed. Besides six baseline study characteristics, a total of five availability items were evaluated. Two groups of independent readers including eight readers participated in the study. Inter-rater agreement was analyzed. Disagreements were resolved with consensus.

RESULTS

Following eligibility criteria, we included a final set of 194 papers. The raw data was available in about one-fifth of the papers (34/194; 18%). However, the authors made their private data available only in one paper (1/161; 1%). About one-tenth of the papers made their pre-modeling (25/194; 13%), modeling (28/194; 14%), or post-modeling files (15/194; 8%) available. Most of the papers (189/194; 97%) did not attempt to create a ready-to-use system for real-world usage. Data origin, use of deep learning, and external validation had statistically significantly different distributions. The use of private data alone was negatively associated with the availability of at least one item (p<0.001).

CONCLUSION

Overall rates of availability for items were poor, leaving room for substantial improvement.

Diagnosis of thyroid disease using deep convolutional neural network models applied to thyroid scintigraphy images: a multicenter study

Objectives

The aim of this study was to improve the diagnostic performance of nuclear medicine physicians using a deep convolutional neural network (DCNN) model and validate the results with two multicenter datasets for thyroid disease by analyzing clinical single-photon emission computed tomography (SPECT) image data.

Methods

In this multicenter retrospective study, 3194 SPECT thyroid images were collected for model training (n=2067), internal validation (n=514) and external validation (n=613). First, four pretrained DCNN models (AlexNet, ShuffleNetV2, MobileNetV3 and ResNet-34) for were tested multiple medical image classification of thyroid disease types (i.e., Graves' disease, subacute thyroiditis, thyroid tumor and normal thyroid). The best performing model was then subjected to fivefold cross-validation to further assess its performance, and the diagnostic performance of this model was compared with that of junior and senior nuclear medicine physicians. Finally, class-specific attentional regions were visualized with attention heatmaps using gradient-weighted class activation mapping.

Results

Each of the four pretrained neural networks attained an overall accuracy of more than 0.85 for the classification of SPECT thyroid images. The improved ResNet-34 model performed best, with an accuracy of 0.944. For the internal validation set, the ResNet-34 model showed higher accuracy (p < 0.001) when compared to that of the senior nuclear medicine physician, with an improvement of nearly 10%. Our model achieved an overall accuracy of 0.931 for the external dataset, a significantly higher accuracy than that of the senior physician (0.931 vs. 0.868, p < 0.001).

Conclusion

The DCNN-based model performed well in terms of diagnosing thyroid scintillation images. The DCNN model showed higher sensitivity and greater specificity in identifying Graves' disease, subacute thyroiditis, and thyroid tumors compared to those of nuclear medicine physicians, illustrating the feasibility of deep learning models to improve the diagnostic efficiency for assisting clinicians.

A machine learning-based model for a dose point kernel calculation

PURPOSE

Absorbed dose calculation by kernel convolution requires the prior determination of dose point kernels (DPK). This study reports on the design, implementation, and test of a multi-target regressor approach to generate the DPKs for monoenergetic sources and a model to obtain DPKs for beta emitters.

METHODS

DPK for monoenergetic electron sources were calculated using the FLUKA Monte Carlo (MC) code for many materials of clinical interest and initial energies ranging from 10 to 3000 keV. Regressor Chains (RC) with three different coefficients regularization/shrinkage models were used as base regressors. Electron monoenergetic scaled DPKs (sDPKs) were used to assess the corresponding sDPKs for beta emitters typically used in nuclear medicine, which were compared against reference published data. Finally, the beta emitters sDPK were applied to a patient-specific case calculating the Voxel Dose Kernel (VDK) for a hepatic radioembolization treatment with [Formula: see text]Y.

RESULTS

The three trained machine learning models demonstrated a promising capacity to predict the sDPK for both monoenergetic emissions and beta emitters of clinical interest attaining differences lower than [Formula: see text] in the mean average percentage error (MAPE) as compared with previous studies. Furthermore, differences lower than [Formula: see text] were obtained for the absorbed dose in patient-specific dosimetry comparing against full stochastic MC calculations.

CONCLUSION

An ML model was developed to assess dosimetry calculations in nuclear medicine. The implemented approach has shown the capacity to accurately predict the sDPK for monoenergetic beta sources in a wide range of energy in different materials. The ML model to calculate the sDPK for beta-emitting radionuclides allowed to obtain VDK useful to achieve reliable patient-specific absorbed dose distributions required short computation times.

Automatic Classification of Magnetic Resonance Histology of Peripheral Arterial Chronic Total Occlusions Using a Variational Autoencoder: A Feasibility Study

The novel approach of our study consists in adapting and in evaluating a custom-made variational autoencoder (VAE) using two-dimensional (2D) convolutional neural networks (CNNs) on magnetic resonance imaging (MRI) images for differentiate soft vs. hard plaque components in peripheral arterial disease (PAD). Five amputated lower extremities were imaged at a clinical ultra-high field 7 Tesla MRI. Ultrashort echo time (UTE), T1-weighted (T1w) and T2-weighted (T2w) datasets were acquired. Multiplanar reconstruction (MPR) images were obtained from one lesion per limb. Images were aligned to each other and pseudo-color red-green-blue images were created. Four areas in latent space were defined corresponding to the sorted images reconstructed by the VAE. Images were classified from their position in latent space and scored using tissue score (TS) as following: (1) lumen patent, TS:0; (2) partially patent, TS:1; (3) mostly occluded with soft tissue, TS:3; (4) mostly occluded with hard tissue, TS:5. Average and relative percentage of TS was calculated per lesion defined as the sum of the tissue score for each image divided by the total number of images. In total, 2390 MPR reconstructed images were included in the analysis. Relative percentage of average tissue score varied from only patent (lesion #1) to presence of all four classes. Lesions #2, #3 and #5 were classified to contain tissues except mostly occluded with hard tissue while lesion #4 contained all (ranges (I): 0.2-100%, (II): 46.3-75.9%, (III): 18-33.5%, (IV): 20%). Training the VAE was successful as images with soft/hard tissues in PAD lesions were satisfactory separated in latent space. Using VAE may assist in rapid classification of MRI histology images acquired in a clinical setup for facilitating endovascular procedures.

Deep Learning Denoising Improves and Homogenizes Patient [18F]FDG PET Image Quality in Digital PET/CT

Given the constant pressure to increase patient throughput while respecting radiation protection, global body PET image quality (IQ) is not satisfactory in all patients. We first studied the association between IQ and other variables, in particular body habitus, on a digital PET/CT. Second, to improve and homogenize IQ, we evaluated a deep learning PET denoising solution (Subtle PETTM) using convolutional neural networks. We analysed retrospectively in 113 patients visual IQ (by a 5-point Likert score in two readers) and semi-quantitative IQ (by the coefficient of variation in the liver, CVliv) as well as lesion detection and quantification in native and denoised PET. In native PET, visual and semi-quantitative IQ were lower in patients with larger body habitus (p < 0.0001 for both) and in men vs. women (p ≤ 0.03 for CVliv). After PET denoising, visual IQ scores increased and became more homogeneous between patients (4.8 ± 0.3 in denoised vs. 3.6 ± 0.6 in native PET; p < 0.0001). CVliv were lower in denoised PET than in native PET, 6.9 ± 0.9% vs. 12.2 ± 1.6%; p < 0.0001. The slope calculated by linear regression of CVliv according to weight was significantly lower in denoised than in native PET (p = 0.0002), demonstrating more uniform CVliv. Lesion concordance rate between both PET series was 369/371 (99.5%), with two lesions exclusively detected in native PET. SUVmax and SUVpeak of up to the five most intense native PET lesions per patient were lower in denoised PET (p < 0.001), with an average relative bias of -7.7% and -2.8%, respectively. DL-based PET denoising by Subtle PETTM allowed [18F]FDG PET global image quality to be improved and homogenized, while maintaining satisfactory lesion detection and quantification. DL-based denoising may render body habitus adaptive PET protocols unnecessary, and pave the way for the improvement and homogenization of PET modalities.

A machine-learning-based combination of criteria to detect bladder cancer lymph node metastasis on [18F]FDG PET/CT: a pathology-controlled study

OBJECTIVES

Initial pelvic lymph node (LN) staging is pivotal for treatment planification in patients with muscle-invasive bladder cancer (MIBC), but [¹⁸F]FDG PET/CT provides insufficient and variable diagnostic performance. We aimed to develop and validate a machine-learning-based combination of criteria on [¹⁸F]FDG PET/CT to accurately identify pelvic LN involvement in bladder cancer patients.

METHODS

Consecutive patients with localized MIBC who performed preoperative [¹⁸F]FDG PET/CT between 2010 and 2017 were retrospectively assigned to training (n = 129) and validation (n = 44) sets. The reference standard was the pathological status after extended pelvic LN dissection. In the training set, a random forest algorithm identified the combination of criteria that best predicted LN status. The diagnostic performances (AUC) and interrater agreement of this combination of criteria were compared to a consensus of experts.

RESULTS

The overall prevalence of pelvic LN involvement was 24% (n = 41/173). In the training set, the top 3 features were derived from pelvic LNs (SUVmax of the most intense LN, and product of diameters of the largest LN) and primary bladder tumor (product of diameters). In the validation set, diagnostic performance did not differ significantly between the combination of criteria (AUC = 0.59 95%CI [0.43-0.73]) and the consensus of experts (AUC = 0.64 95%CI [0.48-0.78], p = 0.54). The interrater agreement was equally good with Κ = 0.66 for both.

CONCLUSION

The developed machine-learning-based combination of criteria performs as well as a consensus of experts to detect pelvic LN involvement on [¹⁸F]FDG PET/CT in patients with MIBC.

KEY POINTS

• The developed machine-learning-based combination of criteria performs as well as experts to detect pelvic LN involvement on [¹⁸F]FDG PET/CT in patients with muscle-invasive bladder cancer. • The top 3 features to predict LN involvement were the SUVmax of the most intense LN, the product of diameters of the largest LN, and the product of diameters of the primary bladder tumor.

Applications of Artificial Intelligence in the Radiology Roundtrip: Process Streamlining, Workflow Optimization, and Beyond

There are many impactful applications of artificial intelligence (AI) in the electronic radiology roundtrip and the patient's journey through the healthcare system that go beyond diagnostic applications. These tools have the potential to improve quality and safety, optimize workflow, increase efficiency, and increase patient satisfaction. In this article, we review the role of AI for process improvement and workflow enhancement which includes applications beginning from the time of order entry, scan acquisition, applications supporting the image interpretation task, and applications supporting tasks after image interpretation such as result communication. These non-diagnostic workflow and process optimization tasks are an important part of the arsenal of potential AI tools that can streamline day to day clinical practice and patient care.

Clinical application of AI-based PET images in oncological patients

Based on the advantages of revealing the functional status and molecular expression of tumor cells, positron emission tomography (PET) imaging has been performed in numerous types of malignant diseases for diagnosis and monitoring. However, insufficient image quality, the lack of a convincing evaluation tool and intra- and interobserver variation in human work are well-known limitations of nuclear medicine imaging and restrict its clinical application. Artificial intelligence (AI) has gained increasing interest in the field of medical imaging due to its powerful information collection and interpretation ability. The combination of AI and PET imaging potentially provides great assistance to physicians managing patients. Radiomics, an important branch of AI applied in medical imaging, can extract hundreds of abstract mathematical features of images for further analysis. In this review, an overview of the applications of AI in PET imaging is provided, focusing on image enhancement, tumor detection, response and prognosis prediction and correlation analyses with pathology or specific gene mutations in several types of tumors. Our aim is to describe recent clinical applications of AI-based PET imaging in malignant diseases and to focus on the description of possible future developments.

Deep learning-enhanced nuclear medicine SPECT imaging applied to cardiac studies

Deep learning (DL) has a growing popularity and is a well-established method of artificial intelligence for data processing, especially for images and videos. Its applications in nuclear medicine are broad and include, among others, disease classification, image reconstruction, and image de-noising. Positron emission tomography (PET) and single-photon emission computerized tomography (SPECT) are major image acquisition technologies in nuclear medicine. Though several studies have been conducted to apply DL in many nuclear medicine domains, such as cancer detection and classification, few studies have employed such methods for cardiovascular disease applications. The present paper reviews recent DL approaches focused on cardiac SPECT imaging. Extensive research identified fifty-five related studies, which are discussed. The review distinguishes between major application domains, including cardiovascular disease diagnosis, SPECT attenuation correction, image denoising, full-count image estimation, and image reconstruction. In addition, major findings and dominant techniques employed for the mentioned task are revealed. Current limitations of DL approaches and future research directions are discussed.

The Use of Artificial Intelligence in the Diagnosis and Classification of Thyroid Nodules: An Update

The incidence of thyroid nodules diagnosed is increasing every year, leading to a greater risk of unnecessary procedures being performed or wrong diagnoses being made. In our paper, we present the latest knowledge on the use of artificial intelligence in diagnosing and classifying thyroid nodules. We particularly focus on the usefulness of artificial intelligence in ultrasonography for the diagnosis and characterization of pathology, as these are the two most developed fields. In our search of the latest innovations, we reviewed only the latest publications of specific types published from 2018 to 2022. We analyzed 930 papers in total, from which we selected 33 that were the most relevant to the topic of our work. In conclusion, there is great scope for the use of artificial intelligence in future thyroid nodule classification and diagnosis. In addition to the most typical uses of artificial intelligence in cancer differentiation, we identified several other novel applications of artificial intelligence during our review.

A Machine Learning based model for a Dose Point Kernel calculation

PURPOSE

Absorbed dose calculation by kernel convolution requires the prior determination of dose point kernels (DPK). This study shows applications of machine learning to generate the DPKs for monoenergetic sources and a model to obtain DPKs for beta emitters.

METHODS

DPK for monoenergetic electron sources were calculated using the FLUKA Monte Carlo (MC) code for many materials of clinical interest and initial energies ranging from 10 to 3000 keV. Three machine learning (ML) algorithms were trained using the MC DPKs. Electron monoenergetic scaled DPKs (sDPKs) were used to assess the corresponding sDPKs for beta emitters typically used in nuclear medicine, which were compared against reference published data. Finally, the ML sDPK approach was applied to a patient-specific case calculating the dose voxel kernels (DVK) for a hepatic radioembolization treatment with \(^{90}\)Y.

RESULTS

The three trained machine learning models demonstrated a promising capacity to predict the sDPK for both monoenergetic emissions and beta emitters of clinical interest attaining differences lower than \(10%\) in the mean average percentage error (MAPE) as compared with previous studies. Furthermore, differences lower than \(7 %\) were obtained for the absorbed dose in patient-specific dosimetry comparing against full stochastic MC calculations.

CONCLUSION

An ML model was developed to assess dosimetry calculations in nuclear medicine. The implemented approach has shown the capacity to accurately predict the sDPK for monoenergetic beta sources in a wide range of energy in different materials. The ML model to calculate the sDPK for beta-emitting radionuclides allowed to obtain VDK useful to achieve reliable patient-specific absorbed dose distributions required remarkable short computation times.

AI for Anglophone Africa: Unlocking its adoption for responsible solutions in academia-private sector

In recent years, AI technologies have become indispensable in social and industrial development, yielding revolutionary results in improving labor efficiency, lowering labor costs, optimizing human resource structure, and creating new job demands. To reap the full benefits of responsible AI solutions in Africa, it is critical to investigate existing challenges and propose strategies, policies, and frameworks for overcoming and eliminating them. As a result, this study investigated the challenges of adopting responsible AI solutions in the Academia-Private sectors for Anglophone Africa through literature reviews, expert interviews, and then proposes solutions and framework for the sustainable and successful adoption of responsible AI.

FROM TEXT TO DIAGNOSE: CHATGPT'S EFFICACY IN MEDICAL DECISION-MAKING

OBJECTIVE

The aim: Evaluate the diagnostic capabilities of the ChatGPT in the field of medical diagnosis.

PATIENTS AND METHODS

Materials and methods: We utilized 50 clinical cases, employing Large Language Model ChatGPT-3.5. The experiment had three phases, each with a new chat setup. In the initial phase, ChatGPT received detailed clinical case descriptions, guided by a "Persona Pattern" prompt. In the second phase, cases with diagnostic errors were addressed by providing potential diagnoses for ChatGPT to choose from. The final phase assessed artificial intelligence's ability to mimic a medical practitioner's diagnostic process, with prompts limiting initial information to symptoms and history.

RESULTS

Results: In the initial phase, ChatGPT showed a 66.00% diagnostic accuracy, surpassing physicians by nearly 50%. Notably, in 11 cases requiring image inter¬pretation, ChatGPT struggled initially but achieved a correct diagnosis for four without added interpretations. In the second phase, ChatGPT demonstrated a remarkable 70.59% diagnostic accuracy, while physicians averaged 41.47%. Furthermore, the overall accuracy of Large Language Model in first and second phases together was 90.00%. In the third phase emulating real doctor decision-making, ChatGPT achieved a 46.00% success rate.

CONCLUSION

Conclusions: Our research underscores ChatGPT's strong potential in clinical medicine as a diagnostic tool, especially in structured scenarios. It emphasizes the need for supplementary data and the complexity of medical diagnosis. This contributes valuable insights to AI-driven clinical diagnostics, with a nod to the importance of prompt engineering techniques in ChatGPT's interaction with doctors.

A SWOT analysis of artificial intelligence in diagnostic imaging in the developing world: making a case for a paradigm shift

Diagnostic imaging (DI) refers to techniques and methods of creating images of the body’s internal parts and organs with or without the use of ionizing radiation, for purposes of diagnosing, monitoring and characterizing diseases. By default, DI equipment are technology based and in recent times, there has been widespread automation of DI operations in high-income countries while low and middle-income countries (LMICs) are yet to gain traction in automated DI. Advanced DI techniques employ artificial intelligence (AI) protocols to enable imaging equipment perceive data more accurately than humans do, and yet automatically or under expert evaluation, make clinical decisions such as diagnosis and characterization of diseases. In this narrative review, SWOT analysis is used to examine the strengths, weaknesses, opportunities and threats associated with the deployment of AI-based DI protocols in LMICs. Drawing from this analysis, a case is then made to justify the need for widespread AI applications in DI in resource-poor settings. Among other strengths discussed, AI-based DI systems could enhance accuracies in diagnosis, monitoring, characterization of diseases and offer efficient image acquisition, processing, segmentation and analysis procedures, but may have weaknesses regarding the need for big data, huge initial and maintenance costs, and inadequate technical expertise of professionals. They present opportunities for synthetic modality transfer, increased access to imaging services, and protocol optimization; and threats of input training data biases, lack of regulatory frameworks and perceived fear of job losses among DI professionals. The analysis showed that successful integration of AI in DI procedures could position LMICs towards achievement of universal health coverage by 2030/2035. LMICs will however have to learn from the experiences of advanced settings, train critical staff in relevant areas of AI and proceed to develop in-house AI systems with all relevant stakeholders onboard.