Amniotic Fluid Classification and Artificial Intelligence: Challenges and Opportunities

Development of Artificial Intelligence Image Classification Models for Determination of Umbilical Cord Vascular Anomalies

OBJECTIVE

The goal of this work was to develop robust techniques for the processing and identification of SUA using artificial intelligence (AI) image classification models.

METHODS

Ultrasound images obtained retrospectively were analyzed for blinding, text removal, AI training, and image prediction. After developing and testing text removal methods, a small n-size study (40 images) using fastai/PyTorch to classify umbilical cord images. This data set was expanded to 286 lateral-CFI images that were used to compare: different neural network performance, diagnostic value, and model predictions.

RESULTS

AI-Optical Character Recognition method was superior in its ability to remove text from images. The small n-size mixed single umbilical artery determination data set was tested with a pretrained ResNet34 neural network and obtained and error rate average of 0.083 (n = 3). The expanded data set was then tested with several AI models. The majority of the tested networks were able to obtain an average error rate of <0.15 with minimal modifications. The ResNet34-default performed the best with: an image-classification error rate of 0.0175, sensitivity of 1.00, specificity of 0.97, and ability to correctly infer classification.

CONCLUSION

This work provides a robust framework for ultrasound image AI classifications. AI could successfully classify umbilical cord types of ultrasound image study with excellent diagnostic value. Together this study provides a reproducible framework to develop AI-specific ultrasound classification of umbilical cord or other diagnoses to be used in conjunction with physicians for optimal patient care.

Perceiving placental ultrasound image texture evolution during pregnancy with normal and adverse outcome through machine learning prism

INTRODUCTION

The objective was to perform placental ultrasound image texture (UPIA) in first (T1), second(T2) and third(T3) trimesters of pregnancy using machine learning( ML).

METHODS

In this prospective observational study the 2D placental ultrasound (US) images from 11-14 weeks, 20-24 weeks, and 28-32 weeks were taken. The image data was divided into training, validating, and testing subsets in the ratio of 80%, 10%, and 10%. Three different ML techniques, deep learning, transfer learning, and vision transformer were used for UPIA.

RESULTS

Out of 1008 cases included in the study, 59.5% (600/1008) had a normal outcome. The image texture classification was compared between T1&T2, T2 &T3 and T1&T3 pairs. Using Inception v3 model, to classify T1& T2 images, gave the accuracy, Cohen Kappa score of 83.3%, 0.662 respectively. The image classification between T1&T3 achieved best results using EfficientNetB0 model, having the accuracy, Cohen Kappa score, sensitivity and specificity of 87.5%, 0.749, 83.4%, and 88.9% respectively. Comparison of placental image texture among cases with materno-fetal adverse outcome and controls was done using Efficient Net B0. The F1 score, was found to be 0.824 , 0.820, and 0.892 in T1, T2 and T3 respectively. The sensitivity and specificity of the model was 77.4% at 80.2% at T1 but increased to 81.0% and 93.9% at T2 &T3 respectively.

DISCUSSION

The study presents a novel technique to classify placental ultrasound image texture using ML models and could differentiate first and third-trimester normal placenta and normal and adverse pregnancy outcome images with good accuracy.

A Deep Learning Fusion Approach to Diagnosis the Polycystic Ovary Syndrome (PCOS)

One of the leading causes of female infertility is PCOS, which is a hormonal disorder affecting women of childbearing age. The common symptoms of PCOS include increased acne, irregular period, increase in body hair, and overweight. Early diagnosis of PCOS is essential to manage the symptoms and reduce the associated health risks. Nonetheless, the diagnosis is based on Rotterdam criteria, including a high level of androgen hormones, ovulation failure, and polycystic ovaries on the ultrasound image (PCOM). At present, doctors and radiologists manually perform PCOM detection using ovary ultrasound by counting the number of follicles and determining their volume in the ovaries, which is one of the challenging PCOS diagnostic criteria. Moreover, such physicians require more tests and checks for biochemical/clinical signs in addition to the patient’s symptoms in order to decide the PCOS diagnosis. Furthermore, clinicians do not utilize a single diagnostic test or specific method to examine patients. This paper introduces the data set that includes the ultrasound image of the ovary with clinical data related to the patient that has been classified as PCOS and non-PCOS. Next, we proposed a deep learning model that can diagnose the PCOM based on the ultrasound image, which achieved 84.81% accuracy using the Inception model. Then, we proposed a fusion model that includes the ultrasound image with clinical data to diagnose the patient if they have PCOS or not. The best model that has been developed achieved 82.46% accuracy by extracting the image features using MobileNet architecture and combine with clinical features.