Artificial intelligence for early detection of diabetes mellitus complications via retinal imaging

Background

Diabetes mellitus (DM) increases the risk of vascular complications, and retinal vasculature imaging serves as a valuable indicator of both microvascular and macrovascular health. Moreover, artificial intelligence (AI)-enabled systems developed for high-throughput detection of diabetic retinopathy (DR) using digitized retinal images have become clinically adopted. This study reviews AI applications using retinal images for DM-related complications, highlighting advancements beyond DR screening, diagnosis, and prognosis, and addresses implementation challenges, such as ethics, data privacy, equitable access, and explainability.

Methods

We conducted a thorough literature search across several databases, including PubMed, Scopus, and Web of Science, focusing on studies involving diabetes, the retina, and artificial intelligence. We reviewed the original research based on their methodology, AI algorithms, data processing techniques, and validation procedures to ensure a detailed analysis of AI applications in diabetic retinal imaging.

Results

Retinal images can be used to diagnose DM complications including DR, neuropathy, nephropathy, and atherosclerotic cardiovascular disease, as well as to predict the risk of cardiovascular events. Beyond DR screening, AI integration also offers significant potential to address the challenges in the comprehensive care of patients with DM.

Conclusion

With the ability to evaluate the patient's health status in relation to DM complications as well as risk prognostication of future cardiovascular complications, AI-assisted retinal image analysis has the potential to become a central tool for modern personalized medicine in patients with DM.

Postoperative pancreatic fistula risk assessment using digital pathology based analyses at the parenchymal resection margin of the pancreas - Results from the randomized multicenter RECOPANC trial

BACKGROUND

In pancreatic surgery Postoperative pancreatic fistula (POPF) represents the most dreaded complication, for which pancreatic texture is acknowledged as one of the strongest predictors. No consensual objective reference has been defined to evaluate the pancreas composition. The presented study aimed to mine histology data of the pancreatic tissue composition with AI assist and correlate it with clinic-pathological parameters derived from the RECOPANC study.

METHOD

From 320 patients originally included in the RECOPANC multicentric study, after series of exclusions slides of 134 patients were selected of AI-assisted analysis.For each slide tissue training fields were defined. Machine learning was trained to differentiate the tissue compartments: acinar, fibrotic, and adipose tissue, followed by quantification of the tissue area compartments.

RESULTS

Relative fibrotic tissue area revealed as the strongest determinant for the prediction of clinically relevant POPF in multivariable analysis (p = 0.027). The AI assessed amount of fibrotic tissue performed significantly better in prediction of fistula development compared to the surgical palpatory assessment of the pancreatic texture.

CONCLUSION

The present study is the first correlating AI-assisted quantified pancreatic tissue composition and POPF within a multicentric cohort.

Machine-learning model based on ultrasomics for non-invasive evaluation of fibrosis in IgA nephropathy

OBJECTIVES

To develop and validate an ultrasomics-based machine-learning (ML) model for non-invasive assessment of interstitial fibrosis and tubular atrophy (IF/TA) in patients with IgA nephropathy (IgAN).

MATERIALS AND METHODS

In this multi-center retrospective study, 471 patients with primary IgA nephropathy from four institutions were included (training, n = 275; internal testing, n = 69; external testing, n = 127; respectively). The least absolute shrinkage and selection operator logistic regression with tenfold cross-validation was used to identify the most relevant features. The ML models were constructed based on ultrasomics. The Shapley Additive Explanation (SHAP) was used to explore the interpretability of the models. Logistic regression analysis was employed to combine ultrasomics, clinical data, and ultrasound imaging characteristics, creating a comprehensive model. A receiver operating characteristic curve, calibration, decision curve, and clinical impact curve were used to evaluate prediction performance.

RESULTS

To differentiate between mild and moderate-to-severe IF/TA, three prediction models were developed: the Rad_SVM_Model, Clinic_LR_Model, and Rad_Clinic_Model. The area under curves of these three models were 0.861, 0.884, and 0.913 in the training cohort, and 0.760, 0.860, and 0.894 in the internal validation cohort, as well as 0.794, 0.865, and 0.904 in the external validation cohort. SHAP identified the contribution of radiomics features. Difference analysis showed that there were significant differences between radiomics features and fibrosis. The comprehensive model was superior to that of individual indicators and performed well.

CONCLUSIONS

We developed and validated a model that combined ultrasomics, clinical data, and clinical ultrasonic characteristics based on ML to assess the extent of fibrosis in IgAN.

KEY POINTS

Question Currently, there is a lack of a comprehensive ultrasomics-based machine-learning model for non-invasive assessment of the extent of Immunoglobulin A nephropathy (IgAN) fibrosis. Findings We have developed and validated a robust and interpretable machine-learning model based on ultrasomics for assessing the degree of fibrosis in IgAN. Clinical relevance The machine-learning model developed in this study has significant interpretable clinical relevance. The ultrasomics-based comprehensive model had the potential for non-invasive assessment of fibrosis in IgAN, which helped evaluate disease progress.

Combined Input Deep Learning Pipeline for Embryo Selection for In Vitro Fertilization Using Light Microscopic Images and Additional Features

The current process of embryo selection in in vitro fertilization is based on morphological criteria; embryos are manually evaluated by embryologists under subjective assessment. In this study, a deep learning-based pipeline was developed to classify the viability of embryos using combined inputs, including microscopic images of embryos and additional features, such as patient age and developed pseudo-features, including a continuous interpretation of Istanbul grading scores by predicting the embryo stage, inner cell mass, and trophectoderm. For viability prediction, convolution-based transferred learning models were employed, multiple pretrained models were compared, and image preprocessing techniques and hyperparameter optimization via Optuna were utilized. In addition, a custom weight was trained using a self-supervised learning framework known as the Simple Framework for Contrastive Learning of Visual Representations (SimCLR) in cooperation with generated images using generative adversarial networks (GANs). The best model was developed from the EfficientNet-B0 model using preprocessed images combined with pseudo-features generated using separate EfficientNet-B0 models, and optimized by Optuna to tune the hyperparameters of the models. The designed model's F1 score, accuracy, sensitivity, and area under curve (AUC) were 65.02%, 69.04%, 56.76%, and 66.98%, respectively. This study also showed an advantage in accuracy and a similar AUC when compared with the recent ensemble method.

Machine Learning and Deep Learning Applications in Magnetic Particle Imaging

In recent years, magnetic particle imaging (MPI) has emerged as a promising imaging technique depicting high sensitivity and spatial resolution. It originated in the early 2000s where it proposed a new approach to challenge the low spatial resolution achieved by using relaxometry in order to measure the magnetic fields. MPI presents 2D and 3D images with high temporal resolution, non-ionizing radiation, and optimal visual contrast due to its lack of background tissue signal. Traditionally, the images were reconstructed by the conversion of signal from the induced voltage by generating system matrix and X-space based methods. Because image reconstruction and analyses play an integral role in obtaining precise information from MPI signals, newer artificial intelligence-based methods are continuously being researched and developed upon. In this work, we summarize and review the significance and employment of machine learning and deep learning models for applications with MPI and the potential they hold for the future. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 1.

Artificial Intelligence-Assisted Colonoscopy for Polyp Detection : A Systematic Review and Meta-analysis

BACKGROUND

Randomized clinical trials (RCTs) of computer-aided detection (CADe) system-enhanced colonoscopy compared with conventional colonoscopy suggest increased adenoma detection rate (ADR) and decreased adenoma miss rate (AMR), but the effect on detection of advanced colorectal neoplasia (ACN) is unclear.

PURPOSE

To conduct a systematic review to compare performance of CADe-enhanced and conventional colonoscopy.

DATA SOURCES

Cochrane Library, Google Scholar, Ovid EMBASE, Ovid MEDLINE, PubMed, Scopus, and Web of Science Core Collection databases were searched through February 2024.

STUDY SELECTION

Published RCTs comparing CADe-enhanced and conventional colonoscopy.

DATA EXTRACTION

Average adenoma per colonoscopy (APC) and ACN per colonoscopy were primary outcomes. Adenoma detection rate, AMR, and ACN detection rate (ACN DR) were secondary outcomes. Balancing outcomes included withdrawal time and resection of nonneoplastic polyps (NNPs). Subgroup analyses were done by neural network architecture.

DATA SYNTHESIS

Forty-four RCTs with 36 201 cases were included. Computer-aided detection-enhanced colonoscopies have higher average APC (12 090 of 12 279 [0.98] vs. 9690 of 12 292 [0.78], incidence rate difference [IRD] = 0.22 [95% CI, 0.16 to 0.28]) and higher ADR (7098 of 16 253 [44.7%] vs. 5825 of 15 855 [36.7%], rate ratio [RR] = 1.21 [CI, 1.15 to 1.28]). Average ACN per colonoscopy was similar (1512 of 9296 [0.16] vs. 1392 of 9121 [0.15], IRD = 0.01 [CI, -0.01 to 0.02]), but ACN DR was higher with CADe system use (1260 of 9899 [12.7%] vs. 1119 of 9746 [11.5%], RR = 1.16 [CI, 1.02 to 1.32]). Using CADe systems resulted in resection of almost 2 extra NNPs per 10 colonoscopies and longer total withdrawal time (0.53 minutes [CI, 0.30 to 0.77]).

LIMITATION

Statistically significant heterogeneity in quality and sample size and inability to blind endoscopists to the intervention in included studies may affect the performance estimates.

CONCLUSION

Computer-aided detection-enhanced colonoscopies have increased APC and detection rate but no difference in ACN per colonoscopy and a small increase in ACN DR. There is minimal increase in procedure time and no difference in performance across neural network architectures.

PRIMARY FUNDING SOURCE

None. (PROSPERO: CRD42023422835).

Evolving and Novel Applications of Artificial Intelligence in Abdominal Imaging

Advancements in artificial intelligence (AI) have significantly transformed the field of abdominal radiology, leading to an improvement in diagnostic and disease management capabilities. This narrative review seeks to evaluate the current standing of AI in abdominal imaging, with a focus on recent literature contributions. This work explores the diagnosis and characterization of hepatobiliary, pancreatic, gastric, colonic, and other pathologies. In addition, the role of AI has been observed to help differentiate renal, adrenal, and splenic disorders. Furthermore, workflow optimization strategies and quantitative imaging techniques used for the measurement and characterization of tissue properties, including radiomics and deep learning, are highlighted. An assessment of how these advancements enable more precise diagnosis, tumor description, and body composition evaluation is presented, which ultimately advances the clinical effectiveness and productivity of radiology. Despite the advancements of AI in abdominal imaging, technical, ethical, and legal challenges persist, and these challenges, as well as opportunities for future development, are highlighted.

Steady morphokinetic progression is an independent predictor of live birth: a descriptive reference for euploid embryos

STUDY QUESTION

Can modelling the longitudinal morphokinetic pattern of euploid embryos during time-lapse monitoring (TLM) be helpful for selecting embryos with the highest live birth potential?

SUMMARY ANSWER

Longitudinal reference ranges of morphokinetic development of euploid embryos have been identified, and embryos with steadier progression during TLM are associated with higher chances of live birth.

WHAT IS KNOWN ALREADY

TLM imaging is increasingly adopted by fertility clinics as an attempt to improve the ability of selecting embryos with the highest potential for implantation. Many markers of embryonic morphokinetics have been incorporated into decision algorithms for embryo (de)selection. However, longitudinal changes during this temporal process, and the impact of such changes on embryonic competence remain unknown. Aiming to model the reference ranges of morphokinetic development of euploid embryos and using it as a single longitudinal trajectory might provide an additive value to the blastocyst morphological grade in identifying highly competent embryos.

STUDY DESIGN SIZE DURATION

This observational, retrospective cohort study was performed in a single IVF clinic between October 2017 and June 2021 and included only autologous single euploid frozen embryo transfers (seFET).

PARTICIPANTS/MATERIALS SETTING METHODS

Reference ranges were developed from [hours post-insemination (hpi)] of the standard morphokinetic parameters of euploid embryos assessed as tPB2, tPNa, tPNf, t2-t9, tSC, tM, tSB, and tB. Variance in morphokinetic patterns was measured and reported as morphokinetic variance score (MVS). Nuclear errors (micronucleation, binucleation, and multinucleation) were annotated when present in at least one blastomere at the two- or four-cell stages. The blastocyst grade of expansion, trophectoderm (TE), and inner cell mass (ICM) were assessed immediately before biopsy using Gardner's criteria. Pre-implantation genetic diagnosis for aneuploidy (PGT-A) was performed by next-generation sequencing. All euploid embryos were singly transferred in a frozen transferred cycle and outcomes were assessed as live birth, pregnancy loss, or not pregnant. Association of MVS with live birth was investigated with regression analyses.

MAIN RESULTS AND THE ROLE OF CHANCE

TLM data from 340 seFET blastocysts were included in the study, of which 189 (55.6%) resulted in a live birth. The median time for euploid embryos to reach blastulation was 109.9 hpi (95% CI: 98.8-121.0 hpi). The MVS was calculated from the variance in time taken for the embryo to reach all morphokinetic points and reflects the total morphokinetic variability it exhibits during its development. Embryos with more erratic kinetics, i.e. higher morphokinetic variance, had higher rates of pregnancy loss (P = 0.004) and no pregnancy (P < 0.001) compared to embryos with steadier morphokinetic patterns. In the multivariable analysis adjusting for ICM, TE grade, presence of nuclear errors, and time of blastulation, MVS was independently associated with live birth (odds ratio [OR]: 0.62, 95% CI: 0.46-0.84, P = 0.002) along with ICM quality. Live birth rate of embryos with the same ICM grading but different morphokinetic variance patterns differed significantly. Live birth rates of embryos exhibiting low MVS with ICM grades A, B, and C were 85%, 76%, and 67%, respectively. However, ICM grades A, B, and C embryos with high MVS had live birth rates of 65%, 48%, and 21% (P < 0.001). The addition of the MVS to embryo morphology score (ICM and TE grading) significantly improved the model's AUC value (0.67 vs 0.62, P = 0.015) and this finding persisted through repeat cross-validation (0.64 ± 0.08 vs 0.60 ± 0.07, P < 0.001).

LIMITATIONS REASONS FOR CAUTION

The exclusion of IVF cases limits, for now, the utility of the model to only ICSI-derived embryos. The utility of these reference ranges and the association of MVS with various clinical outcomes should be further investigated.

WIDER IMPLICATIONS OF THE FINDINGS

We have developed reference ranges for morphokinetic development of euploid embryos and a marker for measuring total morphokinetic variability exhibited by developed blastocysts. Longitudinal assessment of embryonic morphokinetics rather than static time points may provide more insight about which embryos have higher live birth potential. The developed reference ranges and MVS show an association with live birth that is independent of known morphological factors and could emerge as a valuable tool in prioritizing embryos for transfer.

STUDY FUNDING/COMPETING INTERESTS

This study received no external funding. The authors declare no conflicting interests.

TRIAL REGISTRATION NUMBER

N/A.

Radiomics and machine learning for renal tumor subtype assessment using multiphase computed tomography in a multicenter setting

OBJECTIVES

To distinguish histological subtypes of renal tumors using radiomic features and machine learning (ML) based on multiphase computed tomography (CT).

MATERIAL AND METHODS

Patients who underwent surgical treatment for renal tumors at two tertiary centers from 2012 to 2022 were included retrospectively. Preoperative arterial (corticomedullary) and venous (nephrogenic) phase CT scans from these centers, as well as from external imaging facilities, were manually segmented, and standardized radiomic features were extracted. Following preprocessing and addressing the class imbalance, a ML algorithm based on extreme gradient boosting trees (XGB) was employed to predict renal tumor subtypes using 10-fold cross-validation. The evaluation was conducted using the multiclass area under the receiver operating characteristic curve (AUC). Algorithms were trained on data from one center and independently tested on data from the other center.

RESULTS

The training cohort comprised n = 297 patients (64.3% clear cell renal cell cancer [RCC], 13.5% papillary renal cell carcinoma (pRCC), 7.4% chromophobe RCC, 9.4% oncocytomas, and 5.4% angiomyolipomas (AML)), and the testing cohort n = 121 patients (56.2%/16.5%/3.3%/21.5%/2.5%). The XGB algorithm demonstrated a diagnostic performance of AUC = 0.81/0.64/0.8 for venous/arterial/combined contrast phase CT in the training cohort, and AUC = 0.75/0.67/0.75 in the independent testing cohort. In pairwise comparisons, the lowest diagnostic accuracy was evident for the identification of oncocytomas (AUC = 0.57-0.69), and the highest for the identification of AMLs (AUC = 0.9-0.94) CONCLUSION: Radiomic feature analyses can distinguish renal tumor subtypes on routinely acquired CTs, with oncocytomas being the hardest subtype to identify.

CLINICAL RELEVANCE STATEMENT

Radiomic feature analyses yield robust results for renal tumor assessment on routine CTs. Although radiologists routinely rely on arterial phase CT for renal tumor assessment and operative planning, radiomic features derived from arterial phase did not improve the accuracy of renal tumor subtype identification in our cohort.

Can Pretreatment MRI and Planning CT Radiomics Improve Prediction of Complete Pathological Response in Locally Advanced Rectal Cancer Following Neoadjuvant Treatment?

OBJECTIVE(S)

The treatment response to neoadjuvant chemoradiation (nCRT) differs largely in individuals treated for rectal cancer. In this study, we investigated the role of radiomics to predict the pathological response in locally advanced rectal cancers at different treatment time points: (1) before the start of any treatment using baseline T2-weighted MRI (T2W-MR) and (2) at the start of radiation treatment using planning CT.

METHODS

Patients on nCRT followed by surgery between June 2017 to December 2019 were included in the study. Histopathological tumour response grading (TRG) was used for classification, and gross tumour volume was defined by the radiation oncologists. Following resampling, 100 and 103 pyradiomic features were extracted from T2W-MR and planning CT images, respectively. Synthetic minority oversampling technique (SMOTE) was used to address class imbalance. Four machine learning classifiers built clinical, radiomic, and merged models. Model performances were evaluated on a held-out test dataset following 3-fold cross-validation using area under the receiver operator characteristic curves (AUC) with bootstrap 95% confidence intervals.

RESULTS

One hundred and fifty patients were included; 58/150 with TRG 1 were classified as complete responders, and rest were incomplete responders (IR). Clinical models performed better (AUC = 0.68) compared to radiomics models (AUC = 0.62). Overall, the clinical + T2W-MR model showed best performance (AUC = 0.72) in predicting the pathological response prior to therapy. Clinical + Planning CT-merged models could only achieve the highest AUC of 0.66.

CONCLUSION

Merging clinical and baseline T2W-MR radiomics enhances predicting pathological response in rectal cancer. Validation in larger cohorts is warranted, especially for watch and wait strategies.

Evolving and Novel Applications of Artificial Intelligence in Thoracic Imaging

The advent of artificial intelligence (AI) is revolutionizing medicine, particularly radiology. With the development of newer models, AI applications are demonstrating improved performance and versatile utility in the clinical setting. Thoracic imaging is an area of profound interest, given the prevalence of chest imaging and the significant health implications of thoracic diseases. This review aims to highlight the promising applications of AI within thoracic imaging. It examines the role of AI, including its contributions to improving diagnostic evaluation and interpretation, enhancing workflow, and aiding in invasive procedures. Next, it further highlights the current challenges and limitations faced by AI, such as the necessity of 'big data', ethical and legal considerations, and bias in representation. Lastly, it explores the potential directions for the application of AI in thoracic radiology.

Artificial intelligence-powered assisted ranking of sibling embryos to increase first cycle pregnancy rate

RESEARCH QUESTION

Could EMBRYOLY, an artificial intelligence embryo evaluation tool, assist embryologists to increase first cycle pregnancy rate and reduce cycles to pregnancy for patients?

DESIGN

Data from 11,988 embryos were collected via EMBRYOLY from 2666 egg retrievals (2019-2022) across 11 centres in France, Spain and Morocco using three time-lapse systems (TLS). Data from two independent clinics were also examined. EMBRYOLY's transformer-based model was applied to transferred embryos to evaluate ranking performances against pregnancy and birth outcomes. It was applied to cohorts to rank sibling embryos (including non-transferred) according to their likelihood of clinical pregnancy and to compute the agreement with the embryologist's highest ranked embryo. Its effect on time to pregnancy and first cycle pregnancy rate was evaluated on cohorts with multiple single blastocyst transfers, assuming the embryologist would have considered EMBRYOLY's ranking on the embryos favoured for transfer.

RESULTS

EMBRYOLY's score correlated significantly with clinical pregnancies and live births for cleavage and blastocyst transfers. This held true for clinical pregnancies from blastocyst transfers in two independent clinics. In cases of multiple single embryo transfers, embryologists achieved a 19.8% first cycle pregnancy rate, which could have been improved to 44.1% with the adjunctive use of EMBRYOLY (McNemar's test: P < 0.001). This could have reduced cycles to clinical pregnancy from 2.01 to 1.66 (Wilcoxon test: P < 0.001).

CONCLUSIONS

EMBRYOLY's potential to enhance first cycle pregnancy rates when combined with embryologists' expertise is highlighted. It reduces the number of unsuccessful cycles for patients across TLS and IVF centres.

R, F. L, G. N. Vibrating Micro-Capsule as an Autonomous Device for in-situ Endoscopic Scan and Body Tissue Characterization

This work concerns the implementation of a diagnostic technique for the digestive system using a device designed based on a spherical vibrating capsule of 1 cm in diameter and autonomous by its onboard electronics. For local scanning, this device is also equipped with a network of high-frequency optimized sensors. Depending on the desired diagnosis, this device can adapt its electromechanical characteristics to the nature of the application in transmission and/or simultaneous reception. It is also designed for network configuration to provide a 3D mapping of the acoustic properties of the environment under investigation (biological tissues).

Predicting implantation by using dual AI system incorporating three-dimensional blastocyst image and conventional embryo evaluation parameters-A pilot study

Purpose

To investigate the usefulness of an original dual artificial intelligence (AI) system, in which the first AI system eliminates the background of sliced tomographic blastocyst images, then the second AI system predicts implantation success using three-dimensional (3D) reconstructed images of the sequential images and conventional embryo evaluation parameters (CEE) such as maternal age.

Methods

Patients (from June 2022 to July 2023) could opt out and there was additional information on the Web site of the clinic. Implantation and non-implantation cases numbered 458 and 519, respectively. A total of 10 747 tomographic images of the blastocyst in a time-lapse incubator system with the CEE were obtained.

Results

The statistic values by the dual AI system were 0.774 ± 0.033 (mean ± standard error) for area under the characteristic curve, 0.727 for sensitivity, 0.719 for specificity, 0.727 for predictive value of positive test, 0.719 predictive value of negative test, and 0.723 for accuracy, respectively.

Conclusions

The usefulness of the dual AI system in predicting implantation of blastocyst in handling 3D data with conventional embryo evaluation information was demonstrated. This system may be a feasible option in clinical practice.

Interpretable artificial intelligence-assisted embryo selection improved single-blastocyst transfer outcomes: a prospective cohort study

RESEARCH QUESTION

What is the pregnancy and neonatal outcomes of an interpretable artificial intelligence (AI) model for embryo selection in a prospective clinical trial?

DESIGN

This single-centre prospective cohort study was carried out from October 2021 to March 2022. A total of 330 eligible patients were assigned to their preferred groups, with 250 patients undergoing a fresh single-blastocyst transfer cycle after the exclusion criteria had been applied. For the AI-assisted group (AAG), embryologists selected the embryos for transfer based on the ranking recommendations provided by an interpretable AI system, while with the manual group, embryologists used the Gardner grading system to make their decisions.

RESULTS

The implantation rate was significantly higher in the AAG than the manual group (80.87% versus 68.15%, P = 0.022). No significant difference was found in terms of monozygotic twin rate, miscarriage rate, live birth rate and ectopic pregnancy rate between the groups. Furthermore, there was no significant difference in terms of neonatal outcomes, including gestational weeks, premature birth rate, birth height, birthweight, sex ratio at birth and newborn malformation rate. The consensus rate between the AI and retrospective analysis by the embryologists was significantly higher for good-quality embryos (i.e. grade 4BB or higher) versus poor-quality embryos (i.e. less than 4BB) (84.71% versus 25%, P < 0.001).

CONCLUSIONS

These prospective trial results suggest that the proposed AI system could effectively help embryologists to improve the implantation rate with single-blastocyst transfer compared with traditional manual evaluation methods.

Integrating Artificial Intelligence Into Radiation Oncology: Can Humans Spot AI?

Introduction Artificial intelligence (AI) is transforming healthcare, particularly in radiation oncology. AI-based contouring tools like Limbus are designed to delineate Organs at Risk (OAR) and Target Volumes quickly. This study evaluates the accuracy and efficiency of AI contouring compared to human radiation oncologists and the ability of professionals to differentiate between AI-generated and human-generated contours. Methods At a recent AI conference in Abu Dhabi, a blind comparative analysis was performed to assess AI's performance in radiation oncology. Participants included four human radiation oncologists and the Limbus® AI software. They contoured specific regions from CT scans of a breast cancer patient. The audience, consisting of healthcare professionals and AI experts, was challenged to identify the AI-generated contours. The exercise was repeated twice to observe any learning effects. Time taken for contouring and audience identification accuracy were recorded. Results Initially, only 28% of the audience correctly identified the AI contours, which slightly increased to 31% in the second attempt. This indicated a difficulty in distinguishing between AI and human expertise. The AI completed contouring in up to 60 seconds, significantly faster than the human average of 8 minutes. Discussion The results indicate that AI can perform radiation contouring comparably to human oncologists but much faster. The challenge faced by professionals in identifying AI versus human contours highlights AI's advanced capabilities in medical tasks. Conclusion AI shows promise in enhancing radiation oncology workflow by reducing contouring time without quality compromise. Further research is needed to confirm AI contouring's clinical efficacy and its integration into routine practice.

Artificial general intelligence for radiation oncology

The emergence of artificial general intelligence (AGI) is transforming radiation oncology. As prominent vanguards of AGI, large language models (LLMs) such as GPT-4 and PaLM 2 can process extensive texts and large vision models (LVMs) such as the Segment Anything Model (SAM) can process extensive imaging data to enhance the efficiency and precision of radiation therapy. This paper explores full-spectrum applications of AGI across radiation oncology including initial consultation, simulation, treatment planning, treatment delivery, treatment verification, and patient follow-up. The fusion of vision data with LLMs also creates powerful multimodal models that elucidate nuanced clinical patterns. Together, AGI promises to catalyze a shift towards data-driven, personalized radiation therapy. However, these models should complement human expertise and care. This paper provides an overview of how AGI can transform radiation oncology to elevate the standard of patient care in radiation oncology, with the key insight being AGI's ability to exploit multimodal clinical data at scale.

Artificial intelligence and allied subsets in early detection and preclusion of gynecological cancers

Gynecological cancers including breast, cervical, ovarian, uterine, and vaginal, pose the greatest threat to world health, with early identification being crucial to patient outcomes and survival rates. The application of machine learning (ML) and artificial intelligence (AI) approaches to the study of gynecological cancer has shown potential to revolutionize cancer detection and diagnosis. The current review outlines the significant advancements, obstacles, and prospects brought about by AI and ML technologies in the timely identification and accurate diagnosis of different types of gynecological cancers. The AI-powered technologies can use genomic data to discover genetic alterations and biomarkers linked to a particular form of gynecologic cancer, assisting in the creation of targeted treatments. Furthermore, it has been shown that the potential benefits of AI and ML technologies in gynecologic tumors can greatly increase the accuracy and efficacy of cancer diagnosis, reduce diagnostic delays, and possibly eliminate the need for needless invasive operations. In conclusion, the review focused on the integrative part of AI and ML based tools and techniques in the early detection and exclusion of various cancer types; together with a collaborative coordination between research clinicians, data scientists, and regulatory authorities, which is suggested to realize the full potential of AI and ML in gynecologic cancer care.

The influence of artificial intelligence on the work of the medical physicist in radiotherapy practice: a short review

There have been many applications and influences of Artificial intelligence (AI) in many sectors and its professionals, that of radiotherapy and the medical physicist is no different. AI and technological advances have necessitated changing roles of medical physicists due to the development of modernized technology with image-guided accessories for the radiotherapy treatment of cancer patients. Given the changing role of medical physicists in ensuring patient safety and optimal care, AI can reshape radiotherapy practice now and in some years to come. Medical physicists' roles in radiotherapy practice have evolved to meet technology for the management of better patient care in the age of modern radiotherapy. This short review provides an insight into the influence of AI on the changing role of medical physicists in each specific chain of the workflow in radiotherapy in which they are involved.

Make It Less Complex: Autoencoder for Speckle Noise Removal-Application to Breast and Lung Ultrasound

Ultrasound (US) imaging is used in the diagnosis and monitoring of COVID-19 and breast cancer. The presence of Speckle Noise (SN) is a downside to its usage since it decreases lesion conspicuity. Filters can be used to remove SN, but they involve time-consuming computation and parameter tuning. Several researchers have been developing complex Deep Learning (DL) models (150,000-500,000 parameters) for the removal of simulated added SN, without focusing on the real-world application of removing naturally occurring SN from original US images. Here, a simpler (<30,000 parameters) Convolutional Neural Network Autoencoder (CNN-AE) to remove SN from US images of the breast and lung is proposed. In order to do so, simulated SN was added to such US images, considering four different noise levels (σ = 0.05, 0.1, 0.2, 0.5). The original US images (N = 1227, breast + lung) were given as targets, while the noised US images served as the input. The Structural Similarity Index Measure (SSIM) and Peak Signal-to-Noise Ratio (PSNR) were used to compare the output of the CNN-AE and of the Median and Lee filters with the original US images. The CNN-AE outperformed the use of these classic filters for every noise level. To see how well the model removed naturally occurring SN from the original US images and to test its real-world applicability, a CNN model that differentiates malignant from benign breast lesions was developed. Several inputs were used to train the model (original, CNN-AE denoised, filter denoised, and noised US images). The use of the original US images resulted in the highest Matthews Correlation Coefficient (MCC) and accuracy values, while for sensitivity and negative predicted values, the CNN-AE-denoised US images (for higher σ values) achieved the best results. Our results demonstrate that the application of a simpler DL model for SN removal results in fewer misclassifications of malignant breast lesions in comparison to the use of original US images and the application of the Median filter. This shows that the use of a less-complex model and the focus on clinical practice applicability are relevant and should be considered in future studies.

Synergy between artificial intelligence and precision medicine for computer-assisted oral and maxillofacial surgical planning

OBJECTIVES

The aim of this review was to investigate the application of artificial intelligence (AI) in maxillofacial computer-assisted surgical planning (CASP) workflows with the discussion of limitations and possible future directions.

MATERIALS AND METHODS

An in-depth search of the literature was undertaken to review articles concerned with the application of AI for segmentation, multimodal image registration, virtual surgical planning (VSP), and three-dimensional (3D) printing steps of the maxillofacial CASP workflows.

RESULTS

The existing AI models were trained to address individual steps of CASP, and no single intelligent workflow was found encompassing all steps of the planning process. Segmentation of dentomaxillofacial tissue from computed tomography (CT)/cone-beam CT imaging was the most commonly explored area which could be applicable in a clinical setting. Nevertheless, a lack of generalizability was the main issue, as the majority of models were trained with the data derived from a single device and imaging protocol which might not offer similar performance when considering other devices. In relation to registration, VSP and 3D printing, the presence of inadequate heterogeneous data limits the automatization of these tasks.

CONCLUSION

The synergy between AI and CASP workflows has the potential to improve the planning precision and efficacy. However, there is a need for future studies with big data before the emergent technology finds application in a real clinical setting.

CLINICAL RELEVANCE

The implementation of AI models in maxillofacial CASP workflows could minimize a surgeon's workload and increase efficiency and consistency of the planning process, meanwhile enhancing the patient-specific predictability.

Artificial Intelligence, Augmented Reality, and Virtual Reality Advances and Applications in Interventional Radiology

Artificial intelligence (AI) uses computer algorithms to process and interpret data as well as perform tasks, while continuously redefining itself. Machine learning, a subset of AI, is based on reverse training in which evaluation and extraction of data occur from exposure to labeled examples. AI is capable of using neural networks to extract more complex, high-level data, even from unlabeled data sets, and better emulate, or even exceed, the human brain. Advances in AI have and will continue to revolutionize medicine, especially the field of radiology. Compared to the field of interventional radiology, AI innovations in the field of diagnostic radiology are more widely understood and used, although still with significant potential and growth on the horizon. Additionally, AI is closely related and often incorporated into the technology and programming of augmented reality, virtual reality, and radiogenomic innovations which have the potential to enhance the efficiency and accuracy of radiological diagnoses and treatment planning. There are many barriers that limit the applications of artificial intelligence applications into the clinical practice and dynamic procedures of interventional radiology. Despite these barriers to implementation, artificial intelligence in IR continues to advance and the continued development of machine learning and deep learning places interventional radiology in a unique position for exponential growth. This review describes the current and possible future applications of artificial intelligence, radiogenomics, and augmented and virtual reality in interventional radiology while also describing the challenges and limitations that must be addressed before these applications can be fully implemented into common clinical practice.

Modeling three sources of uncertainty in assisted reproductive technologies with probabilistic graphical models

Embryo selection is a critical step in assisted reproduction: good selection criteria are expected to increase the probability of inducing a pregnancy. Machine learning techniques have been applied for implantation prediction or embryo quality assessment, which embryologists can use to make a decision about embryo selection. However, this is a highly uncertain real-world problem, and current proposals do not model always all the sources of uncertainty. We present a novel probabilistic graphical model that accounts for three different sources of uncertainty, the standard embryo and cycle viability, and a third one that represents any unknown factor that can drive a treatment to a failure in otherwise perfect conditions. We derive a parametric learning method based on the Expectation-Maximization strategy, which accounts for uncertainty issues. We empirically analyze the model within a real database consisting of 604 cycles (3125 embryos) carried out at Hospital Donostia (Spain). Embryologists followed the protocol of the Spanish Association for Reproduction Biology Studies (ASEBIR), based on morphological features, for embryo selection. Our model predictions are correlated with the ASEBIR protocol, which validates our model. The benefits of accounting for the different sources of uncertainty and the importance of the cycle characteristics are shown. Considering only transferred embryos, our model does not further discriminate them as implanted or failed, suggesting that the ASEBIR protocol could be understood as a thorough summary of the available morphological features.

Augmentation of literature review of COVID-19 radiology

We suggest an augmentation of the excellent comprehensive review article titled "Comprehensive literature review on the radiographic findings, imaging modalities, and the role of radiology in the coronavirus disease 2019 (COVID-19) pandemic" under the following categories: (1) "Inclusion of additional radiological features, related to pulmonary infarcts and to COVID-19 pneumonia"; (2) "Amplified discussion of cardiovascular COVID-19 manifestations and the role of cardiac magnetic resonance imaging in monitoring and prognosis"; (3) "Imaging findings related to fluorodeoxyglucose positron emission tomography, optical, thermal and other imaging modalities/devices, including 'intelligent edge' and other remote monitoring devices"; (4) "Artificial intelligence in COVID-19 imaging"; (5) "Additional annotations to the radiological images in the manuscript to illustrate the additional signs discussed"; and (6) "A minor correction to a passage on pulmonary destruction".

Artificial Intelligence Applied to Pancreatic Imaging: A Narrative Review

The diagnosis, evaluation, and treatment planning of pancreatic pathologies usually require the combined use of different imaging modalities, mainly, computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET). Artificial intelligence (AI) has the potential to transform the clinical practice of medical imaging and has been applied to various radiological techniques for different purposes, such as segmentation, lesion detection, characterization, risk stratification, or prediction of response to treatments. The aim of the present narrative review is to assess the available literature on the role of AI applied to pancreatic imaging. Up to now, the use of computer-aided diagnosis (CAD) and radiomics in pancreatic imaging has proven to be useful for both non-oncological and oncological purposes and represents a promising tool for personalized approaches to patients. Although great developments have occurred in recent years, it is important to address the obstacles that still need to be overcome before these technologies can be implemented into our clinical routine, mainly considering the heterogeneity among studies.

COVID-19 related maternal mortality cases in associated with Delta and Omicron waves and the role of lung ultrasound

Objective

To present coronavirus disease-2019 (COVID-19) related maternal mortality in relation to Delta and Omicron waves and to investigate the role of lung ultrasound (LUS) in estimating mortality.

Materials and Methods

This retrospective cohort study was conducted in the obstetrics and gynecology clinic of a tertiary pandemic hospital between March 2020 and January 2022. The hospitalized pregnant women with COVID-19 diagnosis and maternal deaths were studied in relation with Delta and Omicron waves. The relationship between LUS scores of hospitalized patients and maternal mortality was explored.

Results

Thousand and sixty-five pregnant women were hospitalized because of COVID-19 infection. Fifty-one (4.79%) of these patients had critical sickness, 96 (9.01%) of them had severe illness, 62 (5.82%) of them were admitted to the intensive care unit and 28 (2.63%) of all hospitalized pregnant women had died. Of the 1.065 patients, 783 (73.5%) were hospitalized before the Delta wave and the maternal mortality rate was 1.28% (10/783), 243 (22.8%) were hospitalized during the Delta wave and the maternal mortality rate was 7% (17/243) [relative risk (RR)=5.478, 95% confidence interval (CI) (2.54-11.8), z=4.342, p<0.001]. During the Omicron wave 39 (3.66%) patients were hospitalized and the maternal mortality rate was 2.56% (1/39). Maternal mortality rates, according to LUS scores, were 0.37% (1/273) for LUS 0, 0.72% (2/277) for LUS 1, 2.58% (10/387) for LUS 2 and 11.72% (15/128) for LUS 3 respectively (LUS 3 vs. others; maternal mortality: RR=8.447, 95% CI (4.11-17.34), z=5.814, p<0.0001). There were no vaccinated patients in the study cohort.

Conclusion

The maternal mortality rate was relatively high, particularly during the Delta wave at our referral center. The Delta wave, delayed vaccination and vaccine hesitancy of pregnant women might have important roles in maternal mortality. Higher LUS scores should warn clinicians of an increased risk of maternal death.

3D DCE-MRI Radiomic Analysis for Malignant Lesion Prediction in Breast Cancer Patients

RATIONALE AND OBJECTIVES

To develop and validate a radiomic model, with radiomic features extracted from breast Dynamic Contrast-Enhanced Magnetic Resonance Imaging (DCE-MRI) from a 1.5T scanner, for predicting the malignancy of masses with enhancement. Images were acquired using an 8-channel breast coil in the axial plane. The rationale behind this study is to show the feasibility of a radiomics-powered model that could be integrated into the clinical practice by exploiting only standard-of-care DCE-MRI with the goal of reducing the required image pre-processing (ie, normalization and quantitative imaging map generation).

MATERIALS AND METHODS

107 radiomic features were extracted from a manually annotated dataset of 111 patients, which was split into discovery and test sets. A feature calibration and pre-processing step was performed to find only robust non-redundant features. An in-depth discovery analysis was performed to define a predictive model: for this purpose, a Support Vector Machine (SVM) was trained in a nested 5-fold cross-validation scheme, by exploiting several unsupervised feature selection methods. The predictive model performance was evaluated in terms of Area Under the Receiver Operating Characteristic (AUROC), specificity, sensitivity, PPV and NPV. The test was performed on unseen held-out data.

RESULTS

The model combining Unsupervised Discriminative Feature Selection (UDFS) and SVMs on average achieved the best performance on the blinded test set: AUROC = 0.725±0.091, sensitivity = 0.709±0.176, specificity = 0.741±0.114, PPV = 0.72±0.093, and NPV = 0.75±0.114.

CONCLUSION

In this study, we built a radiomic predictive model based on breast DCE-MRI, using only the strongest enhancement phase, with promising results in terms of accuracy and specificity in the differentiation of malignant from benign breast lesions.

Identification of Radiomic Features as an Imaging Marker to Differentiate Benign and Malignant Breast Masses Based on Magnetic Resonance Imaging

Background - Breast cancer is one of the most common cancers among women globally and early identification is known to increase patient outcomes. Therefore, the main aim of this study is to identify the essential radiomic features as an image marker and compare the diagnostic feasibility of feature parameters derived from radiomics analysis and conventional Magnetic Resonance Imaging (MRI) to differentiate benign and malignant breast masses.

Methods and Material - T1-weighted Dynamic Contrast-Enhanced (DCE) breast MR axial images of 151 (benign (79) and malignant (72)) patients were chosen. Regions of interest were selected using both manual and semi-automatic segmentation from each lesion. 382 radiomic features computed on the selected regions. A random forest model was employed to detect the most important features that differentiate benign and malignant breast masses. The ten most important radiomics features were obtained from manual and semi-automatic segmentation based on the Gini index to train a support vector machine. MATLAB and IBM SPSS Statistics Subscription software used for statistical analysis.

Results - The accuracy (sensitivity) of the models built from the ten most significant features obtained from manual and semi-automatic segmentation were 0.815 (0.84), 0.821 (0.87), respectively. The top 10 features obtained from manual delineation and semi-automatic segmentation showed a significant difference (p<0.05) between benign and malignant breast lesions.

Conclusion - This radiomics analysis based on DCE-BMRI revealed distinct radiomic features to differentiate benign and malignant breast masses. Therefore, the radiomics analysis can be used as a supporting tool in detecting breast MRI lesions.

Common and Uncommon Errors in Emergency Ultrasound

Errors in emergency ultrasound (US) have been representing an increasing problem in recent years thanks to several unique features related to both the inherent characteristics of the discipline and to the latest developments, which every medical operator should be aware of. Because of the subjective nature of the interpretation of emergency US findings, it is more prone to errors than other diagnostic imaging modalities. The misinterpretation of US images should therefore be considered as a serious risk in diagnosis. The etiology of error is multi-factorial: it depends on environmental factors, patients and the technical skills of the operator; it is influenced by intrinsic US artifacts, poor clinical correlation, US-setting errors and anatomical variants; and it is conditioned by the lack of a methodologically correct clinical approach and excessive diagnostic confidence too. In this review, we evaluate the common and uncommon sources of diagnostic errors in emergency US during clinical practice, showing how to recognize and avoid them.

Pictorial research of pancreas with artificial intelligence and simulacra in the works of Fellini

This is the consideration recalled from my reading of Acute pancreatitis: A pictorial review of early pancreatic fluid collections by Xiao. This perspective related to the works of Fellini might be able to contribute the future development of the research of pancreatic diseases.

Radiomics and machine learning applications in rectal cancer: Current update and future perspectives

The high incidence of rectal cancer in both sexes makes it one of the most common tumors, with significant morbidity and mortality rates. To define the best treatment option and optimize patient outcome, several rectal cancer biological variables must be evaluated. Currently, medical imaging plays a crucial role in the characterization of this disease, and it often requires a multimodal approach. Magnetic resonance imaging is the first-choice imaging modality for local staging and restaging and can be used to detect high-risk prognostic factors. Computed tomography is widely adopted for the detection of distant metastases. However, conventional imaging has recognized limitations, and many rectal cancer characteristics remain assessable only after surgery and histopathology evaluation. There is a growing interest in artificial intelligence applications in medicine, and imaging is by no means an exception. The introduction of radiomics, which allows the extraction of quantitative features that reflect tumor heterogeneity, allows the mining of data in medical images and paved the way for the identification of potential new imaging biomarkers. To manage such a huge amount of data, the use of machine learning algorithms has been proposed. Indeed, without prior explicit programming, they can be employed to build prediction models to support clinical decision making. In this review, current applications and future perspectives of artificial intelligence in medical imaging of rectal cancer are presented, with an imaging modality-based approach and a keen eye on unsolved issues. The results are promising, but the road ahead for translation in clinical practice is rather long.

Embryo selection with artificial intelligence: how to evaluate and compare methods?

Embryo selection within in vitro fertilization (IVF) is the process of evaluating qualities of fertilized oocytes (embryos) and selecting the best embryo(s) available within a patient cohort for subsequent transfer or cryopreservation. In recent years, artificial intelligence (AI) has been used extensively to improve and automate the embryo ranking and selection procedure by extracting relevant information from embryo microscopy images. The AI models are evaluated based on their ability to identify the embryo(s) with the highest chance(s) of achieving a successful pregnancy. Whether such evaluations should be based on ranking performance or pregnancy prediction, however, seems to divide studies. As such, a variety of performance metrics are reported, and comparisons between studies are often made on different outcomes and data foundations. Moreover, superiority of AI methods over manual human evaluation is often claimed based on retrospective data, without any mentions of potential bias. In this paper, we provide a technical view on some of the major topics that divide how current AI models are trained, evaluated and compared. We explain and discuss the most common evaluation metrics and relate them to the two separate evaluation objectives, ranking and prediction. We also discuss when and how to compare AI models across studies and explain in detail how a selection bias is inevitable when comparing AI models against current embryo selection practice in retrospective cohort studies.

Recognition of facial expression of fetuses by artificial intelligence (AI)

OBJECTIVES

The development of the artificial intelligence (AI) classifier to recognize fetal facial expressions that are considered as being related to the brain development of fetuses as a retrospective, non-interventional pilot study.

METHODS

Images of fetal faces with sonography obtained from outpatient pregnant women with a singleton fetus were enrolled in routine conventional practice from 19 to 38 weeks of gestation from January 1, 2020, to September 30, 2020, with completely de-identified data. The images were classified into seven categories, such as eye blinking, mouthing, face without any expression, scowling, smiling, tongue expulsion, and yawning. The category in which the number of fetuses was less than 10 was eliminated before preparation. Next, we created a deep learning AI classifier with the data. Statistical values such as accuracy for the test dataset and the AI confidence score profiles for each category per image for all data were obtained.

RESULTS

The number of fetuses/images in the rated categories were 14/147, 23/302, 33/320, 8/55, and 10/72 for eye blinking, mouthing, face without any expression, scowling, and yawning, respectively. The accuracy of the AI fetal facial expression for the entire test data set was 0.985. The accuracy/sensitivity/specificity values were 0.996/0.993/1.000, 0.992/0.986/1.000, 0.985/1.000/0.979, 0.996/0.888/1.000, and 1.000/1.000/1.000 for the eye blinking, mouthing, face without any expression, scowling categories, and yawning, respectively.

CONCLUSIONS

The AI classifier has the potential to objectively classify fetal facial expressions. AI can advance fetal brain development research using ultrasound.