The Current and Future State of AI Interpretation of Medical Images

Use of artificial intelligence algorithms to analyse systemic sclerosis-interstitial lung disease imaging features

The use of artificial intelligence (AI) in high-resolution computed tomography (HRCT) for diagnosing systemic sclerosis-associated interstitial lung disease (SSc-ILD) is relatively limited. This study aimed to analyse lung HRCT images of patients with systemic sclerosis with interstitial lung disease (SSc-ILD) using artificial intelligence (AI), conduct correlation analysis with clinical manifestations and prognosis, and explore the features and prognosis of SSc-ILD. Overall, 72 lung HRCT images and clinical data of 58 patients with SSC-ILD were collected. ILD lesion type, location, and volume on HRCT images were identified and evaluated using AI. The imaging characteristics of diffuse SSC (dSSc)-ILD and limited SSc-ILD (lSSc-ILD) were statistically analysed. Furthermore, the correlations between lesion type, clinical indicators, and prognosis were investigated. dSSc and lSSc were more prevalent in patients with a disease duration of < 1 and ≥ 5 years, respectively. SSc-ILD mainly comprises non-specific interstitial pneumonia (NSIP), usual interstitial pneumonia (UIP), and unclassifiable idiopathic interstitial pneumonia. HRCT reveals various lesion types in the early stages of the disease, with an increase in the number of lesion types as the disease progresses. Lesions appearing as grid, ground-glass, and nodular shadows were dispersed throughout both lungs, while those appearing as consolidation shadows and honeycomb were distributed across the lungs. Ground-glass opacity lesion type was absent on HRCT images of patients with SSc-ILD and pulmonary hypertension. This study showed that AI can efficiently analyse imaging characteristics of SSc-ILD, demonstrating its potential to learn from complex images with high generalisation ability.

Enhancing representation in radiography-reports foundation model: a granular alignment algorithm using masked contrastive learning

Recently, multi-modal vision-language foundation models have gained significant attention in the medical field. While these models offer great opportunities, they still face crucial challenges, such as the requirement for fine-grained knowledge understanding in computer-aided diagnosis and the capability of utilizing very limited or even no task-specific labeled data in real-world clinical applications. In this study, we present MaCo, a masked contrastive chest X-ray foundation model that tackles these challenges. MaCo explores masked contrastive learning to simultaneously achieve fine-grained image understanding and zero-shot learning for a variety of medical imaging tasks. It designs a correlation weighting mechanism to adjust the correlation between masked chest X-ray image patches and their corresponding reports, thereby enhancing the model's representation learning capabilities. To evaluate the performance of MaCo, we conducted extensive experiments using 6 well-known open-source X-ray datasets. The experimental results demonstrate the superiority of MaCo over 10 state-of-the-art approaches across tasks such as classification, segmentation, detection, and phrase grounding. These findings highlight the significant potential of MaCo in advancing a wide range of medical image analysis tasks.

A knowledge-based decision support system to support family doctors in personalizing type-2 diabetes mellitus medical nutrition therapy

BACKGROUND

Type-2 Diabetes Mellitus (T2D) is a growing concern worldwide, and family doctors are called to help diabetic patients manage this chronic disease, also with Medical Nutrition Therapy (MNT). However, MNT for Diabetes is usually standardized, while it would be much more effective if tailored to the patient. There is a gap in patient-tailored MNT which, if addressed, could support family doctors in delivering effective recommendations. In this context, decision support systems (DSSs) are valuable tools for physicians to support MNT for T2D patients - as long as DSSs are transparent to humans in their decision-making process. Indeed, the lack of transparency in data-driven DSS might hinder their adoption in clinical practice, thus leaving family physicians to adopt general nutrition guidelines provided by the national healthcare systems.

METHOD

This work presents a prototypical ontology-based clinical Decision Support System (OnT2D- DSS) aimed at assisting general practice doctors in managing T2D patients, specifically in creating a tailored dietary plan, leveraging clinical expert knowledge. OnT2D-DSS exploits clinical expert knowledge formalized as a domain ontology to identify a patient's phenotype and potential comorbidities, providing personalized MNT recommendations for macro- and micro-nutrient intake. The system can be accessed via a prototypical interface.

RESULTS

Two preliminary experiments are conducted to assess both the quality and correctness of the inferences provided by the system and the usability and acceptance of the OnT2D-DSS (conducted with nutrition experts and family doctors, respectively).

CONCLUSIONS

Overall, the system is deemed accurate by the nutrition experts and valuable by the family doctors, with minor suggestions for future improvements collected during the experiments.

Artificial Intelligence-Enhanced Neurocritical Care for Traumatic Brain Injury : Past, Present and Future

In neurointensive care units (NICUs), particularly in cases involving traumatic brain injury (TBI), swift and accurate decision-making is critical because of rapidly changing patient conditions and the risk of secondary brain injury. The use of artificial intelligence (AI) in NICU can enhance clinical decision support and provide valuable assistance in these complex scenarios. This article aims to provide a comprehensive review of the current status and future prospects of AI utilization in the NICU, along with the challenges that must be overcome to realize this. Presently, the primary application of AI in NICU is outcome prediction through the analysis of preadmission and high-resolution data during admission. Recent applications include augmented neuromonitoring via signal quality control and real-time event prediction. In addition, AI can integrate data gathered from various measures and support minimally invasive neuromonitoring to increase patient safety. However, despite the recent surge in AI adoption within the NICU, the majority of AI applications have been limited to simple classification tasks, thus leaving the true potential of AI largely untapped. Emerging AI technologies, such as generalist medical AI and digital twins, harbor immense potential for enhancing advanced neurocritical care through broader AI applications. If challenges such as acquiring high-quality data and ethical issues are overcome, these new AI technologies can be clinically utilized in the actual NICU environment. Emphasizing the need for continuous research and development to maximize the potential of AI in the NICU, we anticipate that this will further enhance the efficiency and accuracy of TBI treatment within the NICU.

Capability of multimodal large language models to interpret pediatric radiological images

BACKGROUND

There is a dearth of artificial intelligence (AI) development and research dedicated to pediatric radiology. The newest iterations of large language models (LLMs) like ChatGPT can process image and video input in addition to text. They are thus theoretically capable of providing impressions of input radiological images.

OBJECTIVE

To assess the ability of multimodal LLMs to interpret pediatric radiological images.

MATERIALS AND METHODS

Thirty medically significant cases were collected and submitted to GPT-4 (OpenAI, San Francisco, CA), Gemini 1.5 Pro (Google, Mountain View, CA), and Claude 3 Opus (Anthropic, San Francisco, CA) with a short history for a total of 90 images. AI responses were recorded and independently assessed for accuracy by a resident and attending physician. 95% confidence intervals were determined using the adjusted Wald method.

RESULTS

Overall, the models correctly diagnosed 27.8% (25/90) of images (95% CI=19.5-37.8%), were partially correct for 13.3% (12/90) of images (95% CI=2.7-26.4%), and were incorrect for 58.9% (53/90) of images (95% CI=48.6-68.5%).

CONCLUSION

Multimodal LLMs are not yet capable of interpreting pediatric radiological images.

AI supported detection of cerebral multiple sclerosis lesions decreases radiologic reporting times

PURPOSE

Multiple Sclerosis (MS) is a common autoimmune disease of the central nervous system. MRI plays a crucial role in diagnosing as well as in disease and treatment monitoring. Therefore, evaluation of cerebral MRI of MS patients is part of daily clinical routine. A growing number of companies offer commercial software to support the reporting with automated lesion detection. Aim of this study was to evaluate the effect of such a software with AI supported lesion detection to the radiologic reporting.

METHOD

Four radiologist each counted MS-lesions in MRI examinations of 50 patients separated by the locations periventricular, cortical/juxtacortical, infrantentorial and unspecific white matter. After at least six weeks they repeated the evaluation, this time using the AI based software mdbrain for lesion detection. In both settings the required time was documented. Further the radiologists evaluated follow-up MRI of 50 MS-patients concerning new and enlarging lesions in the same manner.

RESULTS

To determine the lesion-load the average reporting time decreased from 286.85 sec to 196.34 sec (p > 0.001). For the evaluation of the follow-up images the reporting time dropped from 196.17 sec to 120.87 sec (p < 0.001). The interrater reliabilities showed no significant differences for the determination of lesion-load (0.83 without vs. 0.8 with software support) and for the detection of new/enlarged lesions (0.92 without vs. 0.82 with software support).

CONCLUSION

For the evaluation of MR images of MS patients, an AI-based support for image-interpretation can significantly decreases reporting times.

Value-Based Radiology in Canada: Reducing Low-Value Care and Improving System Efficiency

Radiology departments are increasingly tasked with managing growing demands on services including long waitlists for scanning and interventional procedures, human health resource shortages, equipment needs, and challenges incorporating advanced imaging solutions. The burden of system inefficiencies and the overuse of "low-value" imaging causes downstream impact on patients at the individual level, the economy and healthcare system at the societal level, and planetary health at an overarching level. Low value imaging includes those performed for an inappropriate clinical indication, with little to no value to the management of the patient, and resulting in healthcare resource waste; it is estimated that up to a quarter of advanced imaging studies in Canada meet this criterion. Strategies to reduce low-value imaging include the development and use of referral guidelines, use of appropriateness criteria, optimization of existing protocols, and integration of clinical decision support tools into the ordering provider's workflow. Additional means of optimizing system efficiency such as centralized intake models, improved access to electronic medical records and outside imaging, enhanced communication with patients and referrers, and the utilization of artificial intelligence will further increase the value of radiology provided to patients and care providers.

The state of artificial intelligence in medical research: A survey of corresponding authors from top medical journals

Natural Language Processing (NLP) is a subset of artificial intelligence that enables machines to understand and respond to human language through Large Language Models (LLMs)‥ These models have diverse applications in fields such as medical research, scientific writing, and publishing, but concerns such as hallucination, ethical issues, bias, and cybersecurity need to be addressed. To understand the scientific community's understanding and perspective on the role of Artificial Intelligence (AI) in research and authorship, a survey was designed for corresponding authors in top medical journals. An online survey was conducted from July 13th, 2023, to September 1st, 2023, using the SurveyMonkey web instrument, and the population of interest were corresponding authors who published in 2022 in the 15 highest-impact medical journals, as ranked by the Journal Citation Report. The survey link has been sent to all the identified corresponding authors by mail. A total of 266 authors answered, and 236 entered the final analysis. Most of the researchers (40.6%) reported having moderate familiarity with artificial intelligence, while a minority (4.4%) had no associated knowledge. Furthermore, the vast majority (79.0%) believe that artificial intelligence will play a major role in the future of research. Of note, no correlation between academic metrics and artificial intelligence knowledge or confidence was found. The results indicate that although researchers have varying degrees of familiarity with artificial intelligence, its use in scientific research is still in its early phases. Despite lacking formal AI training, many scholars publishing in high-impact journals have started integrating such technologies into their projects, including rephrasing, translation, and proofreading tasks. Efforts should focus on providing training for their effective use, establishing guidelines by journal editors, and creating software applications that bundle multiple integrated tools into a single platform.

Factors for increasing positive predictive value of pneumothorax detection on chest radiographs using artificial intelligence

This study evaluated the positive predictive value (PPV) of artificial intelligence (AI) in detecting pneumothorax on chest radiographs (CXRs) and its affecting factors. Patients determined to have pneumothorax on CXR by a commercial AI software from March to December 2021 were included retrospectively. The PPV was evaluated according to the true-positive (TP) and false-positive (FP) diagnosis determined by radiologists. To know the factors that might influence the results, logistic regression with generalized estimating equation was used. Among a total of 87,658 CXRs, 308 CXRs with 331 pneumothoraces from 283 patients were finally included. The overall PPV of AI about pneumothorax was 41.1% (TF:FP = 136:195). The PA view (odds ratio [OR], 29.837; 95% confidence interval [CI], 15.062-59.107), high abnormality score (OR, 1.081; 95% CI, 1.066-1.097), large amount of pneumothorax (OR, 1.005; 95% CI, 1.003-1.007), presence of ipsilateral atelectasis (OR, 3.508; 95% CI, 1.509-8.156) and a small amount of ipsilateral pleural effusion (OR, 5.277; 95% CI, 2.55-10.919) had significant effects on the increasing PPV. Therefore, PPV for pneumothorax diagnosis using AI can vary based on patients' factors, image-acquisition protocols, and the presence of concurrent lesions on CXR.

Improved Robustness for Deep Learning-based Segmentation of Multi-Center Myocardial Perfusion MRI Datasets Using Data Adaptive Uncertainty-guided Space-time Analysis

BACKGROUND

Fully automatic analysis of myocardial perfusion MRI datasets enables rapid and objective reporting of stress/rest studies in patients with suspected ischemic heart disease. Developing deep learning techniques that can analyze multi-center datasets despite limited training data and variations in software (pulse sequence) and hardware (scanner vendor) is an ongoing challenge.

METHODS

Datasets from 3 medical centers acquired at 3T (n = 150 subjects; 21,150 first-pass images) were included: an internal dataset (inD; n = 95) and two external datasets (exDs; n = 55) used for evaluating the robustness of the trained deep neural network (DNN) models against differences in pulse sequence (exD-1) and scanner vendor (exD-2). A subset of inD (n = 85) was used for training/validation of a pool of DNNs for segmentation, all using the same spatiotemporal U-Net architecture and hyperparameters but with different parameter initializations. We employed a space-time sliding-patch analysis approach that automatically yields a pixel-wise "uncertainty map" as a byproduct of the segmentation process. In our approach, dubbed Data Adaptive Uncertainty-Guided Space-time (DAUGS) analysis, a given test case is segmented by all members of the DNN pool and the resulting uncertainty maps are leveraged to automatically select the "best" one among the pool of solutions. For comparison, we also trained a DNN using the established approach with the same settings (hyperparameters, data augmentation, etc.).

RESULTS

The proposed DAUGS analysis approach performed similarly to the established approach on the internal dataset (Dice score for the testing subset of inD: 0.896 ± 0.050 vs. 0.890 ± 0.049; p = n.s.) whereas it significantly outperformed on the external datasets (Dice for exD-1: 0.885 ± 0.040 vs. 0.849 ± 0.065, p < 0.005; Dice for exD-2: 0.811 ± 0.070 vs. 0.728 ± 0.149, p < 0.005). Moreover, the number of image series with "failed" segmentation (defined as having myocardial contours that include bloodpool or are noncontiguous in ≥1 segment) was significantly lower for the proposed vs. the established approach (4.3% vs. 17.1%, p < 0.0005).

CONCLUSIONS

The proposed DAUGS analysis approach has the potential to improve the robustness of deep learning methods for segmentation of multi-center stress perfusion datasets with variations in the choice of pulse sequence, site location or scanner vendor.

Using AI to Identify Unremarkable Chest Radiographs for Automatic Reporting

Background Radiology practices have a high volume of unremarkable chest radiographs and artificial intelligence (AI) could possibly improve workflow by providing an automatic report. Purpose To estimate the proportion of unremarkable chest radiographs, where AI can correctly exclude pathology (ie, specificity) without increasing diagnostic errors. Materials and Methods In this retrospective study, consecutive chest radiographs in unique adult patients (≥18 years of age) were obtained January 1-12, 2020, at four Danish hospitals. Exclusion criteria included insufficient radiology reports or AI output error. Two thoracic radiologists, who were blinded to AI output, labeled chest radiographs as "remarkable" or "unremarkable" based on predefined unremarkable findings (reference standard). Radiology reports were classified similarly. A commercial AI tool was adapted to output a chest radiograph "remarkableness" probability, which was used to calculate specificity at different AI sensitivities. Chest radiographs with missed findings by AI and/or the radiology report were graded by one thoracic radiologist as critical, clinically significant, or clinically insignificant. Paired proportions were compared using the McNemar test. Results A total of 1961 patients were included (median age, 72 years [IQR, 58-81 years]; 993 female), with one chest radiograph per patient. The reference standard labeled 1231 of 1961 chest radiographs (62.8%) as remarkable and 730 of 1961 (37.2%) as unremarkable. At 99.9%, 99.0%, and 98.0% sensitivity, the AI had a specificity of 24.5% (179 of 730 radiographs [95% CI: 21, 28]), 47.1% (344 of 730 radiographs [95% CI: 43, 51]), and 52.7% (385 of 730 radiographs [95% CI: 49, 56]), respectively. With the AI fixed to have a similar sensitivity as radiology reports (87.2%), the missed findings of AI and reports had 2.2% (27 of 1231 radiographs) and 1.1% (14 of 1231 radiographs) classified as critical (P = .01), 4.1% (51 of 1231 radiographs) and 3.6% (44 of 1231 radiographs) classified as clinically significant (P = .46), and 6.5% (80 of 1231) and 8.1% (100 of 1231) classified as clinically insignificant (P = .11), respectively. At sensitivities greater than or equal to 95.4%, the AI tool exhibited less than or equal to 1.1% critical misses. Conclusion A commercial AI tool used off-label could correctly exclude pathology in 24.5%-52.7% of all unremarkable chest radiographs at greater than or equal to 98% sensitivity. The AI had equal or lower rates of critical misses than radiology reports at sensitivities greater than or equal to 95.4%. These results should be confirmed in a prospective study. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Yoon and Hwang in this issue.

Automated Real-Time Detection of Lung Sliding Using Artificial Intelligence: A Prospective Diagnostic Accuracy Study

BACKGROUND

Rapid evaluation for pneumothorax is a common clinical priority. Although lung ultrasound (LUS) often is used to assess for pneumothorax, its diagnostic accuracy varies based on patient and provider factors. To enhance the performance of LUS for pulmonary pathologic features, artificial intelligence (AI)-assisted imaging has been adopted; however, the diagnostic accuracy of AI-assisted LUS (AI-LUS) deployed in real time to diagnose pneumothorax remains unknown.

RESEARCH QUESTION

In patients with suspected pneumothorax, what is the real-time diagnostic accuracy of AI-LUS to recognize the absence of lung sliding?

STUDY DESIGN AND METHODS

We performed a prospective AI-assisted diagnostic accuracy study of AI-LUS to recognize the absence of lung sliding in a convenience sample of patients with suspected pneumothorax. After calibrating the model parameters and imaging settings for bedside deployment, we prospectively evaluated its diagnostic accuracy for lung sliding compared with a reference standard of expert consensus.

RESULTS

Two hundred forty-one lung sliding evaluations were derived from 62 patients. AI-LUS showed a sensitivity of 0.921 (95% CI, 0.792-0.973), specificity of 0.802 (95% CI, 0.735-0.856), area under the receiver operating characteristic curve of 0.885 (95% CI, 0.828-0.956), and accuracy of 0.824 (95% CI, 0.766-0.870) for the diagnosis of absent lung sliding.

INTERPRETATION

In this study, real-time AI-LUS showed high sensitivity and moderate specificity to identify the absence of lung sliding. Further research to improve model performance and optimize the integration of AI-LUS into existing diagnostic pathways is warranted.

Artificial Intelligence Assessment of Biological Age From Transthoracic Echocardiography: Discrepancies with Chronologic Age Predict Significant Excess Mortality

BACKGROUND

Age and sex can be estimated using artificial intelligence on the basis of various sources. The aims of this study were to test whether convolutional neural networks could be trained to estimate age and predict sex using standard transthoracic echocardiography and to evaluate the prognostic implications.

METHODS

The algorithm was trained on 76,342 patients, validated in 22,825 patients, and tested in 20,960 patients. It was then externally validated using data from a different hospital (n = 556). Finally, a prospective cohort of handheld point-of-care ultrasound devices (n = 319; ClinicalTrials.gov identifier NCT05455541) was used to confirm the findings. A multivariate Cox regression model was used to investigate the association between age estimation and chronologic age with overall survival.

RESULTS

The mean absolute error in age estimation was 4.9 years, with a Pearson correlation coefficient of 0.922. The probabilistic value of sex had an overall accuracy of 96.1% and an area under the curve of 0.993. External validation and prospective study cohorts yielded consistent results. Finally, survival analysis demonstrated that age prediction ≥5 years vs chronologic age was associated with an independent 34% increased risk for death during follow-up (P < .001).

CONCLUSIONS

Applying artificial intelligence to standard transthoracic echocardiography allows the prediction of sex and the estimation of age. Machine-based estimation is an independent predictor of overall survival and, with further evaluation, can be used for risk stratification and estimation of biological age.

The potential role for artificial intelligence in fracture risk prediction

Osteoporotic fractures are a major health challenge in older adults. Despite the availability of safe and effective therapies for osteoporosis, these therapies are underused in individuals at high risk for fracture, calling for better case-finding and fracture risk assessment strategies. Artificial intelligence (AI) and machine learning (ML) hold promise for enhancing identification of individuals at high risk for fracture by distilling useful features from high-dimensional data derived from medical records, imaging, and wearable devices. AI-ML could enable automated opportunistic screening for vertebral fractures and osteoporosis, home-based monitoring and intervention targeting lifestyle factors, and integration of multimodal features to leverage fracture prediction, ultimately aiding improved fracture risk assessment and individualised treatment. Optimism must be balanced with consideration for the explainability of AI-ML models, biases (including information inequity in numerically under-represented populations), model limitations, and net clinical benefit and workload impact. Clinical integration of AI-ML algorithms has the potential to transform osteoporosis management, offering a more personalised approach to reduce the burden of osteoporotic fractures.

Machine learning approach for prediction of outcomes in anticoagulated patients with atrial fibrillation

BACKGROUND

The accuracy of available prediction tools for clinical outcomes in patients with atrial fibrillation (AF) remains modest. Machine Learning (ML) has been used to predict outcomes in the AF population, but not in a population entirely on anticoagulant therapy.

METHODS AND AIMS

Different supervised ML models were applied to predict all-cause death, cardiovascular (CV) death, major bleeding and stroke in anticoagulated patients with AF, processing data from the multicenter START-2 Register.

RESULTS

11078 AF patients (male n = 6029, 54.3%) were enrolled with a median follow-up period of 1.5 years [IQR 1.0-2.6]. Patients on Vitamin K Antagonists (VKA) were 5135 (46.4%) and 5943 (53.6%) were on Direct Oral Anticoagulants (DOAC). Using Multi-Gate Mixture of Experts, a cross-validated AUC of 0.779 ± 0.016 and 0.745 ± 0.022 were obtained, respectively, for the prediction of all-cause death and CV-death in the overall population. The best ML model outperformed CHA2DSVA2SC and HAS-BLED for all-cause death prediction (p < 0.001 for both). When compared to HAS-BLED, Gradient Boosting improved major bleeding prediction in DOACs patients (0.711 vs. 0.586, p < 0.001). A very low number of events during follow-up (52) resulted in a suboptimal ischemic stroke prediction (best AUC of 0.606 ± 0.117 in overall population). Body mass index, age, renal function, platelet count and hemoglobin levels resulted the most important variables for ML prediction.

CONCLUSIONS

In AF patients, ML models showed good discriminative ability to predict all-cause death, regardless of the type of anticoagulation strategy, and major bleeding on DOAC therapy, outperforming CHA2DS2VASC and the HAS-BLED scores for risk prediction in these populations.

A Novel Video-Based Methodology for Automated Classification of Dystonia and Choreoathetosis in Dyskinetic Cerebral Palsy During a Lower Extremity Task

BACKGROUND

Movement disorders in children and adolescents with dyskinetic cerebral palsy (CP) are commonly assessed from video recordings, however scoring is time-consuming and expert knowledge is required for an appropriate assessment.

OBJECTIVE

To explore a machine learning approach for automated classification of amplitude and duration of distal leg dystonia and choreoathetosis within short video sequences.

METHODS

Available videos of a heel-toe tapping task were preprocessed to optimize key point extraction using markerless motion analysis. Postprocessed key point data were passed to a time series classification ensemble algorithm to classify dystonia and choreoathetosis duration and amplitude classes (scores 0, 1, 2, 3, and 4), respectively. As ground truth clinical scoring of dystonia and choreoathetosis by the Dyskinesia Impairment Scale was used. Multiclass performance metrics as well as metrics for summarized scores: absence (score 0) and presence (score 1-4) were determined.

RESULTS

Thirty-three participants were included: 29 with dyskinetic CP and 4 typically developing, age 14 years:6 months ± 5 years:15 months. The multiclass accuracy results for dystonia were 77% for duration and 68% for amplitude; for choreoathetosis 30% for duration and 38% for amplitude. The metrics for score 0 versus score 1 to 4 revealed an accuracy of 81% for dystonia duration, 77% for dystonia amplitude, 53% for choreoathetosis duration and amplitude.

CONCLUSIONS

This methodology study yielded encouraging results in distinguishing between presence and absence of dystonia, but not for choreoathetosis. A larger dataset is required for models to accurately represent distinct classes/scores. This study presents a novel methodology of automated assessment of movement disorders solely from video data.

How artificial intelligence could transform emergency care

Artificial intelligence (AI) in healthcare is the ability of a computer to perform tasks typically associated with clinical care (e.g. medical decision-making and documentation). AI will soon be integrated into an increasing number of healthcare applications, including elements of emergency department (ED) care. Here, we describe the basics of AI, various categories of its functions (including machine learning and natural language processing) and review emerging and potential future use-cases for emergency care. For example, AI-assisted symptom checkers could help direct patients to the appropriate setting, models could assist in assigning triage levels, and ambient AI systems could document clinical encounters. AI could also help provide focused summaries of charts, summarize encounters for hand-offs, and create discharge instructions with an appropriate language and reading level. Additional use cases include medical decision making for decision rules, real-time models that predict clinical deterioration or sepsis, and efficient extraction of unstructured data for coding, billing, research, and quality initiatives. We discuss the potential transformative benefits of AI, as well as the concerns regarding its use (e.g. privacy, data accuracy, and the potential for changing the doctor-patient relationship).

Multicenter comparison using two AI stroke CT perfusion software packages for determining thrombectomy eligibility

BACKGROUND

Stroke AI platforms assess infarcted core and potentially salvageable tissue (penumbra) to identify patients suitable for mechanical thrombectomy. Few studies have compared outputs of these platforms, and none have been multicenter or considered NIHSS or scanner/protocol differences. Our objective was to compare volume estimates and thrombectomy eligibility from two widely used CT perfusion (CTP) packages, Viz.ai and RAPID.AI, in a large multicenter cohort.

METHODS

We analyzed CTP data of acute stroke patients with large vessel occlusion (LVO) from four institutions. Core and penumbra volumes were estimated by each software and DEFUSE-3 thrombectomy eligibility assessed. Results between software packages were compared and categorized by NIHSS score, scanner manufacturer/model, and institution.

RESULTS

Primary analysis of 362 cases found statistically significant differences in both software's volume estimations, with subgroup analysis showing these differences were driven by results from a single scanner model, the Canon Aquilion One. Viz.ai provided larger estimates with mean differences of 8cc and 18cc for core and penumbra, respectively (p<0.001). NIHSS subgroup analysis also showed systematically larger Viz.ai volumes (p<0.001). Despite volume differences, a significant difference in thrombectomy eligibility was not found. Additional subgroup analysis showed significant differences in penumbra volume for the Phillips Ingenuity scanner, and thrombectomy eligibility for the Canon Aquilion One scanner at one center (7 % increased eligibility with Viz.ai, p=0.03).

CONCLUSIONS

Despite systematic differences in core and penumbra volume estimates between Viz.ai and RAPID.AI, DEFUSE-3 eligibility was not statistically different in primary or NIHSS subgroup analysis. A DEFUSE-3 eligibility difference, however, was seen on one scanner at one institution, suggesting scanner model and local CTP protocols can influence performance and cause discrepancies in thrombectomy eligibility. We thus recommend centers discuss optimal scanning protocols with software vendors and scanner manufacturers to maximize CTP accuracy.

Artificial Intelligence Applications for Thoracic Surgeons: "The Phenomenal Cosmic Powers of the Magic Lamp"

In the digital age, artificial intelligence (AI) is emerging as a transformative force in various sectors, including medicine. This article explores the potential of AI, which is akin to the magical genie of Aladdin's lamp, particularly within thoracic surgery and lung cancer management. It examines AI applications like machine learning and deep learning in achieving more precise diagnoses, preoperative risk assessment, and improved surgical outcomes. The challenges and advancements in AI integration, especially in computer vision and multi-modal models, are discussed alongside their impact on robotic surgery and operating room management. Despite its transformative potential, implementing AI in medicine faces challenges regarding data scarcity, interpretability issues, and ethical concerns. Collaboration between AI and medical communities is essential to address these challenges and unlock the full potential of AI in revolutionizing clinical practice. This article underscores the importance of further research and interdisciplinary collaboration to ensure the safe and effective deployment of AI in real-world clinical settings.

A Responsible Framework for Applying Artificial Intelligence on Medical Images and Signals at the Point of Care: The PACS-AI Platform

The potential of artificial intelligence (AI) in medicine lies in its ability to enhance clinicians' capacity to analyse medical images, thereby improving diagnostic precision and accuracy and thus enhancing current tests. However, the integration of AI within health care is fraught with difficulties. Heterogeneity among health care system applications, reliance on proprietary closed-source software, and rising cybersecurity threats pose significant challenges. Moreover, before their deployment in clinical settings, AI models must demonstrate their effectiveness across a wide range of scenarios and must be validated by prospective studies, but doing so requires testing in an environment mirroring the clinical workflow, which is difficult to achieve without dedicated software. Finally, the use of AI techniques in health care raises significant legal and ethical issues, such as the protection of patient privacy, the prevention of bias, and the monitoring of the device's safety and effectiveness for regulatory compliance. This review describes challenges to AI integration in health care and provides guidelines on how to move forward. We describe an open-source solution that we developed that integrates AI models into the Picture Archives Communication System (PACS), called PACS-AI. This approach aims to increase the evaluation of AI models by facilitating their integration and validation with existing medical imaging databases. PACS-AI may overcome many current barriers to AI deployment and offer a pathway toward responsible, fair, and effective deployment of AI models in health care. In addition, we propose a list of criteria and guidelines that AI researchers should adopt when publishing a medical AI model to enhance standardisation and reproducibility.

Assessing the Impact of an Artificial Intelligence-Based Model for Intracranial Aneurysm Detection in CT Angiography on Patient Diagnosis and Outcomes (IDEAL Study)-a protocol for a multicenter, double-blinded randomized controlled trial

BACKGROUND

This multicenter, double-blinded, randomized controlled trial (RCT) aims to assess the impact of an artificial intelligence (AI)-based model on the efficacy of intracranial aneurysm detection in CT angiography (CTA) and its influence on patients' short-term and long-term outcomes.

METHODS

Study design: Prospective, multicenter, double-blinded RCT.

SETTINGS

The model was designed for the automatic detection of intracranial aneurysms from original CTA images.

PARTICIPANTS

Adult inpatients and outpatients who are scheduled for head CTA scanning. Randomization groups: (1) Experimental Group: Head CTA interpreted by radiologists with the assistance of the True-AI-integrated intracranial aneurysm diagnosis strategy (True-AI arm). (2) Control Group: Head CTA interpreted by radiologists with the assistance of the Sham-AI-integrated intracranial aneurysm diagnosis strategy (Sham-AI arm).

RANDOMIZATION

Block randomization, stratified by center, gender, and age group.

PRIMARY OUTCOMES

Coprimary outcomes of superiority in patient-level sensitivity and noninferiority in specificity for the True-AI arm to the Sham-AI arm in intracranial aneurysms.

SECONDARY OUTCOMES

Diagnostic performance for other intracranial lesions, detection rates, workload of CTA interpretation, resource utilization, treatment-related clinical events, aneurysm-related events, quality of life, and cost-effectiveness analysis.

BLINDING

Study participants and participating radiologists will be blinded to the intervention.

SAMPLE SIZE

Based on our pilot study, the patient-level sensitivity is assumed to be 0.65 for the Sham-AI arm and 0.75 for the True-AI arm, with specificities of 0.90 and 0.88, respectively. The prevalence of intracranial aneurysms for patients undergoing head CTA in the hospital is approximately 12%. To establish superiority in sensitivity and noninferiority in specificity with a margin of 5% using a one-sided α = 0.025 to ensure that the power of coprimary endpoint testing reached 0.80 and a 5% attrition rate, the sample size was determined to be 6450 in a 1:1 allocation to True-AI or Sham-AI arm.

DISCUSSION

The study will determine the precise impact of the AI system on the detection performance for intracranial aneurysms in a double-blinded design and following the real-world effects on patients' short-term and long-term outcomes.

TRIAL REGISTRATION

This trial has been registered with the NIH, U.S. National Library of Medicine at ClinicalTrials.gov, ID: NCT06118840 . Registered 11 November 2023.

Turning radiology reports into epidemiological data to track seasonal pulmonary infections and the COVID-19 pandemic

OBJECTIVES

To automatically label chest radiographs and chest CTs regarding the detection of pulmonary infection in the report text, to calculate the number needed to image (NNI) and to investigate if these labels correlate with regional epidemiological infection data.

MATERIALS AND METHODS

All chest imaging reports performed in the emergency room between 01/2012 and 06/2022 were included (64,046 radiographs; 27,705 CTs). Using a regular expression-based text search algorithm, reports were labeled positive/negative for pulmonary infection if described. Data for regional weekly influenza-like illness (ILI) consultations (10/2013-3/2022), COVID-19 cases, and hospitalization (2/2020-6/2022) were matched with report labels based on calendar date. Positive rate for pulmonary infection detection, NNI, and the correlation with influenza/COVID-19 data were calculated.

RESULTS

Between 1/2012 and 2/2020, a 10.8-16.8% per year positive rate for detecting pulmonary infections on chest radiographs was found (NNI 6.0-9.3). A clear and significant seasonal change in mean monthly detection counts (102.3 winter; 61.5 summer; p < .001) correlated moderately with regional ILI consultations (weekly data r = 0.45; p < .001). For 2020-2021, monthly pulmonary infection counts detected by chest CT increased to 64-234 (23.0-26.7% per year positive rate, NNI 3.7-4.3) compared with 14-94 (22.4-26.7% positive rate, NNI 3.7-4.4) for 2012-2019. Regional COVID-19 epidemic waves correlated moderately with the positive pulmonary infection CT curve for 2020-2022 (weekly new cases: r = 0.53; hospitalizations: r = 0.65; p < .001).

CONCLUSION

Text mining of radiology reports allows to automatically extract diagnoses. It provides a metric to calculate the number needed to image and to track the trend of diagnoses in real time, i.e., seasonality and epidemic course of pulmonary infections.

CLINICAL RELEVANCE

Digitally labeling radiology reports represent previously neglected data and may assist in automated disease tracking, in the assessment of physicians' clinical reasoning for ordering radiology examinations and serve as actionable data for hospital workflow optimization.

KEY POINTS

• Radiology reports, commonly not machine readable, can be automatically labeled with the contained diagnoses using a regular-expression based text search algorithm. • Chest radiograph reports positive for pulmonary infection moderately correlated with regional influenza-like illness consultations (weekly data; r = 0.45; p < .001) and chest CT reports with the course of the regional COVID-19 pandemic (new cases: r = 0.53; hospitalizations: r = 0.65; p < 0.001). • Rendering radiology reports into data labels provides a metric for automated disease tracking, the assessment of ordering physicians clinical reasoning and can serve as actionable data for workflow optimization.

Ethics for AI in Plastic Surgery: Guidelines and Review

INTRODUCTION

Artificial intelligence (AI) holds the potential to revolutionize medicine, offering vast improvements for plastic surgery. While human physicians are limited to one lifetime of experience, AI is poised to soon surpass human capabilities, as it draws on limitless information and continuous learning abilities. Nevertheless, as AI becomes increasingly prevalent in this domain, it gives rise to critical ethical considerations that must be addressed by professionals.

MATERIALS AND METHODS

This work reviews the literature referring to the ethical challenges brought on by the ever-expanding use of AI in plastic surgery and offers guidelines for its application.

RESULTS

Ethical challenges include the disclosure of use of AI by caregivers, validation of decision-making, data privacy, informed consent and autonomy, potential biases in AI systems, the opaque nature of AI models, questions of liability, and the need for regulations.

CONCLUSIONS

There is a lack of consensus for the ethical use of AI in plastic surgery. Guidelines, such as those presented in this work, are needed within each discipline of medicine to respond to important ethical considerations for the safe use of AI.

LEVEL OF EVIDENCE V

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .

Artificial Intelligence in the Management of Women with Endometriosis and Adenomyosis: Can Machines Ever Be Worse Than Humans?

Artificial intelligence (AI) is experiencing advances and integration in all medical specializations, and this creates excitement but also concerns. This narrative review aims to critically assess the state of the art of AI in the field of endometriosis and adenomyosis. By enabling automation, AI may speed up some routine tasks, decreasing gynecologists' risk of burnout, as well as enabling them to spend more time interacting with their patients, increasing their efficiency and patients' perception of being taken care of. Surgery may also benefit from AI, especially through its integration with robotic surgery systems. This may improve the detection of anatomical structures and enhance surgical outcomes by combining intra-operative findings with pre-operative imaging. Not only that, but AI promises to improve the quality of care by facilitating clinical research. Through the introduction of decision-support tools, it can enhance diagnostic assessment; it can also predict treatment effectiveness and side effects, as well as reproductive prognosis and cancer risk. However, concerns exist regarding the fact that good quality data used in tool development and compliance with data sharing guidelines are crucial. Also, professionals are worried AI may render certain specialists obsolete. This said, AI is more likely to become a well-liked team member rather than a usurper.

An Update on the Use of Artificial Intelligence in Digital Pathology for Oral Epithelial Dysplasia Research

INTRODUCTION

Oral epithelial dysplasia (OED) is a precancerous histopathological finding which is considered the most important prognostic indicator for determining the risk of malignant transformation into oral squamous cell carcinoma (OSCC). The gold standard for diagnosis and grading of OED is through histopathological examination, which is subject to inter- and intra-observer variability, impacting accurate diagnosis and prognosis. The aim of this review article is to examine the current advances in digital pathology for artificial intelligence (AI) applications used for OED diagnosis.

MATERIALS AND METHODS

We included studies that used AI for diagnosis, grading, or prognosis of OED on histopathology images or intraoral clinical images. Studies utilizing imaging modalities other than routine light microscopy (e.g., scanning electron microscopy), or immunohistochemistry-stained histology slides, or immunofluorescence were excluded from the study. Studies not focusing on oral dysplasia grading and diagnosis, e.g., to discriminate OSCC from normal epithelial tissue were also excluded.

RESULTS

A total of 24 studies were included in this review. Nineteen studies utilized deep learning (DL) convolutional neural networks for histopathological OED analysis, and 4 used machine learning (ML) models. Studies were summarized by AI method, main study outcomes, predictive value for malignant transformation, strengths, and limitations.

CONCLUSION

ML/DL studies for OED grading and prediction of malignant transformation are emerging as promising adjunctive tools in the field of digital pathology. These adjunctive objective tools can ultimately aid the pathologist in more accurate diagnosis and prognosis prediction. However, further supportive studies that focus on generalization, explainable decisions, and prognosis prediction are needed.

Artificial Intelligence in the Future Landscape of Pediatric Neuroradiology: Opportunities and Challenges

This paper will review how artificial intelligence (AI) will play an increasingly important role in pediatric neuroradiology in the future. A safe, transparent, and human-centric AI is needed to tackle the quadruple aim of improved health outcomes, enhanced patient and family experience, reduced costs, and improved well-being of the healthcare team in pediatric neuroradiology. Equity, diversity and inclusion, data safety, and access to care will need to always be considered. In the next decade, AI algorithms are expected to play an increasingly important role in access to care, workflow management, abnormality detection, classification, response prediction, prognostication, report generation, as well as in the patient and family experience in pediatric neuroradiology. Also, AI algorithms will likely play a role in recognizing and flagging rare diseases and in pattern recognition to identify previously unknown disorders. While AI algorithms will play an important role, humans will not only need to be in the loop, but in the center of pediatric neuroimaging. AI development and deployment will need to be closely watched and monitored by experts in the field. Patient and data safety need to be at the forefront, and the risks of a dependency on technology will need to be contained. The applications and implications of AI in pediatric neuroradiology will differ from adult neuroradiology.

Gradient-Based Saliency Maps Are Not Trustworthy Visual Explanations of Automated AI Musculoskeletal Diagnoses

Saliency maps are popularly used to "explain" decisions made by modern machine learning models, including deep convolutional neural networks (DCNNs). While the resulting heatmaps purportedly indicate important image features, their "trustworthiness," i.e., utility and robustness, has not been evaluated for musculoskeletal imaging. The purpose of this study was to systematically evaluate the trustworthiness of saliency maps used in disease diagnosis on upper extremity X-ray images. The underlying DCNNs were trained using the Stanford MURA dataset. We studied four trustworthiness criteria-(1) localization accuracy of abnormalities, (2) repeatability, (3) reproducibility, and (4) sensitivity to underlying DCNN weights-across six different gradient-based saliency methods (Grad-CAM (GCAM), gradient explanation (GRAD), integrated gradients (IG), Smoothgrad (SG), smooth IG (SIG), and XRAI). Ground-truth was defined by the consensus of three fellowship-trained musculoskeletal radiologists who each placed bounding boxes around abnormalities on a holdout saliency test set. Compared to radiologists, all saliency methods showed inferior localization (AUPRCs: 0.438 (SG)-0.590 (XRAI); average radiologist AUPRC: 0.816), repeatability (IoUs: 0.427 (SG)-0.551 (IG); average radiologist IOU: 0.613), and reproducibility (IoUs: 0.250 (SG)-0.502 (XRAI); average radiologist IOU: 0.613) on abnormalities such as fractures, orthopedic hardware insertions, and arthritis. Five methods (GCAM, GRAD, IG, SG, XRAI) passed the sensitivity test. Ultimately, no saliency method met all four trustworthiness criteria; therefore, we recommend caution and rigorous evaluation of saliency maps prior to their clinical use.

Minimum labelling requirements for dermatology artificial intelligence-based Software as Medical Device (SaMD): A consensus statement

BACKGROUND/OBJECTIVES

Artificial intelligence (AI) holds remarkable potential to improve care delivery in dermatology. End users (health professionals and general public) of AI-based Software as Medical Devices (SaMD) require relevant labelling information to ensure that these devices can be used appropriately. Currently, there are no clear minimum labelling requirements for dermatology AI-based SaMDs.

METHODS

Common labelling recommendations for AI-based SaMD identified in a recent literature review were evaluated by an Australian expert panel in digital health and dermatology via a modified Delphi consensus process. A nine-point Likert scale was used to indicate importance of 10 items, and voting was conducted to determine the specific characteristics to include for some items. Consensus was achieved when more than 75% of the experts agreed that inclusion of information was necessary.

RESULTS

There was robust consensus supporting inclusion of all proposed items as minimum labelling requirements; indication for use, intended user, training and test data sets, algorithm design, image processing techniques, clinical validation, performance metrics, limitations, updates and adverse events. Nearly all suggested characteristics of the labelling items received endorsement, except for some characteristics related to performance metrics. Moreover, there was consensus that uniform labelling criteria should apply across all AI categories and risk classes set out by the Therapeutic Goods Administration.

CONCLUSIONS

This study provides critical evidence for setting labelling standards by the Therapeutic Goods Administration to safeguard patients, health professionals, consumers, industry, and regulatory bodies from AI-based dermatology SaMDs that do not currently provide adequate information about how they were developed and tested.

Randomised controlled trials evaluating artificial intelligence in clinical practice: a scoping review

This scoping review of randomised controlled trials on artificial intelligence (AI) in clinical practice reveals an expanding interest in AI across clinical specialties and locations. The USA and China are leading in the number of trials, with a focus on deep learning systems for medical imaging, particularly in gastroenterology and radiology. A majority of trials (70 [81%] of 86) report positive primary endpoints, primarily related to diagnostic yield or performance; however, the predominance of single-centre trials, little demographic reporting, and varying reports of operational efficiency raise concerns about the generalisability and practicality of these results. Despite the promising outcomes, considering the likelihood of publication bias and the need for more comprehensive research including multicentre trials, diverse outcome measures, and improved reporting standards is crucial. Future AI trials should prioritise patient-relevant outcomes to fully understand AI's true effects and limitations in health care.

Evaluating a Novel AI Tool for Automated Measurement of the Aortic Root and Valve in Cardiac Magnetic Resonance Imaging

Objective Evaluating an artificial intelligence (AI) tool (AIATELLA, version 1.0; AIATELLA Oy, Helsinki, Finland) in interpreting cardiac magnetic resonance (CMR) imaging to produce measurements of the aortic root and valve by comparison of accuracy and efficiency with that of three National Health Service (NHS) cardiologists. Methods AI-derived aortic root and valve measurements were recorded alongside manual measurements from three experienced NHS consultant cardiologists (CCs) over three separate sites in the northeast part of the United Kingdom. The study utilised a comprehensive dataset of CMR images, with the intraclass correlation coefficient (ICC) being the primary measure of concordance between the AI and the cardiologist assessments. Patient imaging was anonymised and blinded at the point of transfer to a secure data server.  Results The study demonstrates a high level of concordance between AI assessment of the aortic root and valve with NHS cardiologists (ICC of 0.98). Notably, the AI delivered results in 2.6 seconds (+/- 0.532) compared to a mean of 334.5 seconds (+/- 61.9) by the cardiologists, a statistically significant improvement in efficiency without compromising accuracy. Conclusion AI's accuracy and speed of analysis suggest that it could be a valuable tool in cardiac diagnostics, addressing the challenges of time-consuming and variable clinician-based assessments. This research reinforces AI's role in optimising the patient journey and improving the efficiency of the diagnostic pathway.

The Promise of Artificial Intelligence-Assisted Point-of-Care Ultrasonography in Perioperative Care

The role of point-of-care ultrasonography in the perioperative setting has expanded rapidly over recent years. Revolutionizing this technology further is integrating artificial intelligence to assist clinicians in optimizing images, identifying anomalies, performing automated measurements and calculations, and facilitating diagnoses. Artificial intelligence can increase point-of-care ultrasonography efficiency and accuracy, making it an even more valuable point-of-care tool. Given this topic's importance and ever-changing landscape, this review discusses the latest trends to serve as an introduction and update in this area.

Artificial intelligence in coronary artery calcium score: rationale, different approaches, and outcomes

Almost 35 years after its introduction, coronary artery calcium score (CACS) not only survived technological advances but became one of the cornerstones of contemporary cardiovascular imaging. Its simplicity and quantitative nature established it as one of the most robust approaches for atherosclerotic cardiovascular disease risk stratification in primary prevention and a powerful tool to guide therapeutic choices. Groundbreaking advances in computational models and computer power translated into a surge of artificial intelligence (AI)-based approaches directly or indirectly linked to CACS analysis. This review aims to provide essential knowledge on the AI-based techniques currently applied to CACS, setting the stage for a holistic analysis of the use of these techniques in coronary artery calcium imaging. While the focus of the review will be detailing the evidence, strengths, and limitations of end-to-end CACS algorithms in electrocardiography-gated and non-gated scans, the current role of deep-learning image reconstructions, segmentation techniques, and combined applications such as simultaneous coronary artery calcium and pulmonary nodule segmentation, will also be discussed.

Applications of Deep Learning in Trauma Radiology: A Narrative Review

Diagnostic imaging is essential in modern trauma care for initial evaluation and identifying injuries requiring intervention. Deep learning (DL) has become mainstream in medical image analysis and has shown promising efficacy for classification, segmentation, and lesion detection. This narrative review provides the fundamental concepts for developing DL algorithms in trauma imaging and presents an overview of current progress in each modality. DL has been applied to detect free fluid on Focused Assessment with Sonography for Trauma (FAST), traumatic findings on chest and pelvic X-rays, and computed tomography (CT) scans, identify intracranial hemorrhage on head CT, detect vertebral fractures, and identify injuries to organs like the spleen, liver, and lungs on abdominal and chest CT. Future directions involve expanding dataset size and diversity through federated learning, enhancing model explainability and transparency to build clinician trust, and integrating multimodal data to provide more meaningful insights into traumatic injuries. Though some commercial artificial intelligence products are Food and Drug Administration-approved for clinical use in the trauma field, adoption remains limited, highlighting the need for multi-disciplinary teams to engineer practical, real-world solutions. Overall, DL shows immense potential to improve the efficiency and accuracy of trauma imaging, but thoughtful development and validation are critical to ensure these technologies positively impact patient care.

Advances in research and application of artificial intelligence and radiomic predictive models based on intracranial aneurysm images

Intracranial aneurysm is a high-risk disease, with imaging playing a crucial role in their diagnosis and treatment. The rapid advancement of artificial intelligence in imaging technology holds promise for the development of AI-based radiomics predictive models. These models could potentially enable the automatic detection and diagnosis of intracranial aneurysms, assess their status, and predict outcomes, thereby assisting in the creation of personalized treatment plans. In addition, these techniques could improve diagnostic efficiency for physicians and patient prognoses. This article aims to review the progress of artificial intelligence radiomics in the study of intracranial aneurysms, addressing the challenges faced and future prospects, in hopes of introducing new ideas for the precise diagnosis and treatment of intracranial aneurysms.

GPT-agents based on medical guidelines can improve the responsiveness and explainability of outcomes for traumatic brain injury rehabilitation

This study explored the application of generative pre-trained transformer (GPT) agents based on medical guidelines using large language model (LLM) technology for traumatic brain injury (TBI) rehabilitation-related questions. To assess the effectiveness of multiple agents (GPT-agents) created using GPT-4, a comparison was conducted using direct GPT-4 as the control group (GPT-4). The GPT-agents comprised multiple agents with distinct functions, including "Medical Guideline Classification", "Question Retrieval", "Matching Evaluation", "Intelligent Question Answering (QA)", and "Results Evaluation and Source Citation". Brain rehabilitation questions were selected from the doctor-patient Q&A database for assessment. The primary endpoint was a better answer. The secondary endpoints were accuracy, completeness, explainability, and empathy. Thirty questions were answered; overall GPT-agents took substantially longer and more words to respond than GPT-4 (time: 54.05 vs. 9.66 s, words: 371 vs. 57). However, GPT-agents provided superior answers in more cases compared to GPT-4 (66.7 vs. 33.3%). GPT-Agents surpassed GPT-4 in accuracy evaluation (3.8 ± 1.02 vs. 3.2 ± 0.96, p = 0.0234). No difference in incomplete answers was found (2 ± 0.87 vs. 1.7 ± 0.79, p = 0.213). However, in terms of explainability (2.79 ± 0.45 vs. 07 ± 0.52, p < 0.001) and empathy (2.63 ± 0.57 vs. 1.08 ± 0.51, p < 0.001) evaluation, the GPT-agents performed notably better. Based on medical guidelines, GPT-agents enhanced the accuracy and empathy of responses to TBI rehabilitation questions. This study provides guideline references and demonstrates improved clinical explainability. However, further validation through multicenter trials in a clinical setting is necessary. This study offers practical insights and establishes groundwork for the potential theoretical integration of LLM-agents medicine.

The path from task-specific to general purpose artificial intelligence for medical diagnostics: A bibliometric analysis

Artificial intelligence (AI) has revolutionized many fields, and its potential in healthcare has been increasingly recognized. Based on diverse data sources such as imaging, laboratory tests, medical records, and electrophysiological data, diagnostic AI has witnessed rapid development in recent years. A comprehensive understanding of the development status, contributing factors, and their relationships in the application of AI to medical diagnostics is essential to further promote its use in clinical practice. In this study, we conducted a bibliometric analysis to explore the evolution of task-specific to general-purpose AI for medical diagnostics. We used the Web of Science database to search for relevant articles published between 2010 and 2023, and applied VOSviewer, the R package Bibliometrix, and CiteSpace to analyze collaborative networks and keywords. Our analysis revealed that the field of AI in medical diagnostics has experienced rapid growth in recent years, with a focus on tasks such as image analysis, disease prediction, and decision support. Collaborative networks were observed among researchers and institutions, indicating a trend of global cooperation in this field. Additionally, we identified several key factors contributing to the development of AI in medical diagnostics, including data quality, algorithm design, and computational power. Challenges to progress in the field include model explainability, robustness, and equality, which will require multi-stakeholder, interdisciplinary collaboration to tackle. Our study provides a holistic understanding of the path from task-specific, mono-modal AI toward general-purpose, multimodal AI for medical diagnostics. With the continuous improvement of AI technology and the accumulation of medical data, we believe that AI will play a greater role in medical diagnostics in the future.

BI-RADS Category Assignments by GPT-3.5, GPT-4, and Google Bard: A Multilanguage Study

Background The performance of publicly available large language models (LLMs) remains unclear for complex clinical tasks. Purpose To evaluate the agreement between human readers and LLMs for Breast Imaging Reporting and Data System (BI-RADS) categories assigned based on breast imaging reports written in three languages and to assess the impact of discordant category assignments on clinical management. Materials and Methods This retrospective study included reports for women who underwent MRI, mammography, and/or US for breast cancer screening or diagnostic purposes at three referral centers. Reports with findings categorized as BI-RADS 1-5 and written in Italian, English, or Dutch were collected between January 2000 and October 2023. Board-certified breast radiologists and the LLMs GPT-3.5 and GPT-4 (OpenAI) and Bard, now called Gemini (Google), assigned BI-RADS categories using only the findings described by the original radiologists. Agreement between human readers and LLMs for BI-RADS categories was assessed using the Gwet agreement coefficient (AC1 value). Frequencies were calculated for changes in BI-RADS category assignments that would affect clinical management (ie, BI-RADS 0 vs BI-RADS 1 or 2 vs BI-RADS 3 vs BI-RADS 4 or 5) and compared using the McNemar test. Results Across 2400 reports, agreement between the original and reviewing radiologists was almost perfect (AC1 = 0.91), while agreement between the original radiologists and GPT-4, GPT-3.5, and Bard was moderate (AC1 = 0.52, 0.48, and 0.42, respectively). Across human readers and LLMs, differences were observed in the frequency of BI-RADS category upgrades or downgrades that would result in changed clinical management (118 of 2400 [4.9%] for human readers, 611 of 2400 [25.5%] for Bard, 573 of 2400 [23.9%] for GPT-3.5, and 435 of 2400 [18.1%] for GPT-4; P < .001) and that would negatively impact clinical management (37 of 2400 [1.5%] for human readers, 435 of 2400 [18.1%] for Bard, 344 of 2400 [14.3%] for GPT-3.5, and 255 of 2400 [10.6%] for GPT-4; P < .001). Conclusion LLMs achieved moderate agreement with human reader-assigned BI-RADS categories across reports written in three languages but also yielded a high percentage of discordant BI-RADS categories that would negatively impact clinical management. © RSNA, 2024 Supplemental material is available for this article.

Edge Artificial Intelligence (AI) for real-time automatic quantification of filariasis in mobile microscopy

Filariasis, a neglected tropical disease caused by roundworms, is a significant public health concern in many tropical countries. Microscopic examination of blood samples can detect and differentiate parasite species, but it is time consuming and requires expert microscopists, a resource that is not always available. In this context, artificial intelligence (AI) can assist in the diagnosis of this disease by automatically detecting and differentiating microfilariae. In line with the target product profile for lymphatic filariasis as defined by the World Health Organization, we developed an edge AI system running on a smartphone whose camera is aligned with the ocular of an optical microscope that detects and differentiates filarias species in real time without the internet connection. Our object detection algorithm that uses the Single-Shot Detection (SSD) MobileNet V2 detection model was developed with 115 cases, 85 cases with 1903 fields of view and 3342 labels for model training, and 30 cases with 484 fields of view and 873 labels for model validation before clinical validation, is able to detect microfilariae at 10x magnification and distinguishes four species of them at 40x magnification: Loa loa, Mansonella perstans, Wuchereria bancrofti, and Brugia malayi. We validated our augmented microscopy system in the clinical environment by replicating the diagnostic workflow encompassed examinations at 10x and 40x with the assistance of the AI models analyzing 18 samples with the AI running on a middle range smartphone. It achieved an overall precision of 94.14%, recall of 91.90% and F1 score of 93.01% for the screening algorithm and 95.46%, 97.81% and 96.62% for the species differentiation algorithm respectively. This innovative solution has the potential to support filariasis diagnosis and monitoring, particularly in resource-limited settings where access to expert technicians and laboratory equipment is scarce.

Prognostic Utility of Left Atrial Strain From MRI Feature Tracking in Ischemic and Nonischemic Dilated Cardiomyopathy: A Multicenter Study

BACKGROUND. MRI-based prognostic evaluation in patients with dilated cardiomyopathy (DCM) has historically used markers of late gadolinium enhancement (LGE) and feature tracking (FT)-derived left ventricular global longitudinal strain (LVGLS). Early data indicate that FT-derived left atrial strain (LAS) parameters, including reservoir, conduit, and booster, may also have prognostic roles in such patients. OBJECTIVE. The purpose of our study was to evaluate the prognostic utility of LAS parameters, derived from MRI FT, in patients with ischemic or nonischemic DCM, including in comparison with the traditional parameters of LGE and LVGLS. METHODS. This retrospective study included 811 patients with ischemic or nonischemic DCM (median age, 60 years; 640 men, 171 women) who underwent cardiac MRI at any of five centers. FT-derived LAS parameters and LVGLS were measured using two- and four-chamber cine images. LGE percentage was quantified. Patients were assessed for a composite outcome of all-cause mortality or heart failure hospitalization. Multivariable Cox regression analyses including demographic characteristics, cardiovascular risk factors, medications used, and a wide range of cardiac MRI parameters were performed. Kaplan-Meier analyses with log-rank tests were also performed. RESULTS. A total of 419 patients experienced the composite outcome. Patients who did, versus those who did not, experience the composite outcome had larger LVGLS (-6.7% vs -8.3%, respectively; p < .001) as well as a smaller LAS reservoir (13.3% vs 19.3%, p < .001), LAS conduit (4.7% vs 8.0%, p < .001), and LAS booster (8.1% vs 10.3%, p < .001) but no significant difference in LGE (10.1% vs 11.3%, p = .51). In multivariable Cox regression analyses, significant independent predictors of the composite outcome included LAS reservoir (HR = 0.96, p < .001) and LAS conduit (HR = 0.91, p < .001). LAS booster and LGE were not significant independent predictors in the models. LVGLS was a significant independent predictor only in a model that initially included LAS booster but not the other LAS parameters. In Kaplan-Meier analysis, all three LAS parameters were significantly associated with the composite outcome (p < .001). CONCLUSION. In this multicenter study, LAS reservoir and LAS conduit were significant independent prognostic markers in patients with ischemic or nonischemic DCM, showing greater prognostic utility than the currently applied markers of LVGLS and LGE. CLINICAL IMPACT. FT-derived LAS analysis provides incremental prognostic information in patients with DCM.

Large Language Models in Oncology: Revolution or Cause for Concern?

The technological capability of artificial intelligence (AI) continues to advance with great strength. Recently, the release of large language models has taken the world by storm with concurrent excitement and concern. As a consequence of their impressive ability and versatility, their provide a potential opportunity for implementation in oncology. Areas of possible application include supporting clinical decision making, education, and contributing to cancer research. Despite the promises that these novel systems can offer, several limitations and barriers challenge their implementation. It is imperative that concerns, such as accountability, data inaccuracy, and data protection, are addressed prior to their integration in oncology. As the progression of artificial intelligence systems continues, new ethical and practical dilemmas will also be approached; thus, the evaluation of these limitations and concerns will be dynamic in nature. This review offers a comprehensive overview of the potential application of large language models in oncology, as well as concerns surrounding their implementation in cancer care.

A cascading learning method with SegFormer for radiographic measurement of periodontal bone loss

OBJECTIVE

Marginal alveolar bone loss is one of the key features of periodontitis and can be observed via panoramic radiographs. This study aimed to establish a cascading learning method with deep learning (DL) for precise radiographic bone loss (RBL) measurements at specific tooth positions.

MATERIALS AND METHODS

Through the design of two tasks for tooth position recognition and tooth semantic segmentation using the SegFormer model, specific tooth's crown, intrabony portion, and suprabony portion of the roots were obtained. The RBL was subsequently measured by length through these three areas using the principal component analysis (PCA) principal axis.

RESULTS

The average intersection over union (IoU) for the tooth position recognition task was 0.8906, with an F1-score of 0.9338. The average IoU for the tooth semantic segmentation task was 0.8465, with an F1-score of 0.9138. When the two tasks were combined, the average IoU was 0.7889, with an F1-score of 0.8674. The correlation coefficient between the RBL prediction results based on the PCA principal axis and the clinicians' measurements exceeded 0.85. Compared to those of the other two methods, the average precision of the predicted RBL was 0.7722, the average sensitivity was 0.7416, and the average F1-score was 0.7444.

CONCLUSIONS

The method for predicting RBL using DL and PCA produced promising results, offering rapid and reliable auxiliary information for future periodontal disease diagnosis.

CLINICAL RELEVANCE

Precise RBL measurements are important for periodontal diagnosis. The proposed RBL-SF can measure RBL at specific tooth positions and assign the bone loss stage. The ability of the RBL-SF to measure RBL at specific tooth positions can guide clinicians to a certain extent in the accurate diagnosis of periodontitis.