A preliminary study to quantitatively evaluate the development of maturation degree for fetal lung based on transfer learning deep model from ultrasound images

Evolving the Era of 5D Ultrasound? A Systematic Literature Review on the Applications for Artificial Intelligence Ultrasound Imaging in Obstetrics and Gynecology

Artificial intelligence (AI) has gained prominence in medical imaging, particularly in obstetrics and gynecology (OB/GYN), where ultrasound (US) is the preferred method. It is considered cost effective and easily accessible but is time consuming and hindered by the need for specialized training. To overcome these limitations, AI models have been proposed for automated plane acquisition, anatomical measurements, and pathology detection. This study aims to overview recent literature on AI applications in OB/GYN US imaging, highlighting their benefits and limitations. For the methodology, a systematic literature search was performed in the PubMed and Cochrane Library databases. Matching abstracts were screened based on the PICOS (Participants, Intervention or Exposure, Comparison, Outcome, Study type) scheme. Articles with full text copies were distributed to the sections of OB/GYN and their research topics. As a result, this review includes 189 articles published from 1994 to 2023. Among these, 148 focus on obstetrics and 41 on gynecology. AI-assisted US applications span fetal biometry, echocardiography, or neurosonography, as well as the identification of adnexal and breast masses, and assessment of the endometrium and pelvic floor. To conclude, the applications for AI-assisted US in OB/GYN are abundant, especially in the subspecialty of obstetrics. However, while most studies focus on common application fields such as fetal biometry, this review outlines emerging and still experimental fields to promote further research.

Classification of normal and abnormal fetal heart ultrasound images and identification of ventricular septal defects based on deep learning

OBJECTIVES

Congenital heart defects (CHDs) are the most common birth defects. Recently, artificial intelligence (AI) was used to assist in CHD diagnosis. No comparison has been made among the various types of algorithms that can assist in the prenatal diagnosis.

METHODS

Normal and abnormal fetal ultrasound heart images, including five standard views, were collected according to the International Society of Ultrasound in Obstetrics and Gynecology (ISUOG) Practice guidelines. You Only Look Once version 5 (YOLOv5) models were trained and tested. An excellent model was screened out after comparing YOLOv5 with other classic detection methods.

RESULTS

On the training set, YOLOv5n performed slightly better than the others. On the validation set, YOLOv5n attained the highest overall accuracy (90.67 %). On the CHD test set, YOLOv5n, which only needed 0.007 s to recognize each image, had the highest overall accuracy (82.93 %), and YOLOv5l achieved the best accuracy on the abnormal dataset (71.93 %). On the VSD test set, YOLOv5l had the best performance, with a 92.79 % overall accuracy rate and 92.59 % accuracy on the abnormal dataset. The YOLOv5 models achieved better performance than the Fast region-based convolutional neural network (RCNN) & ResNet50 model and the Fast RCNN & MobileNetv2 model on the CHD test set (p<0.05) and VSD test set (p<0.01).

CONCLUSIONS

YOLOv5 models are able to accurately distinguish normal and abnormal fetal heart ultrasound images, especially with respect to the identification of VSD, which have the potential to assist ultrasound in prenatal diagnosis.

Use of artificial intelligence and deep learning in fetal ultrasound imaging

Deep learning is considered the leading artificial intelligence tool in image analysis in general. Deep-learning algorithms excel at image recognition, which makes them valuable in medical imaging. Obstetric ultrasound has become the gold standard imaging modality for detection and diagnosis of fetal malformations. However, ultrasound relies heavily on the operator's experience, making it unreliable in inexperienced hands. Several studies have proposed the use of deep-learning models as a tool to support sonographers, in an attempt to overcome these problems inherent to ultrasound. Deep learning has many clinical applications in the field of fetal imaging, including identification of normal and abnormal fetal anatomy and measurement of fetal biometry. In this Review, we provide a comprehensive explanation of the fundamentals of deep learning in fetal imaging, with particular focus on its clinical applicability. © 2022 International Society of Ultrasound in Obstetrics and Gynecology.

A review on deep-learning algorithms for fetal ultrasound-image analysis

Deep-learning (DL) algorithms are becoming the standard for processing ultrasound (US) fetal images. A number of survey papers in the field is today available, but most of them are focusing on a broader area of medical-image analysis or not covering all fetal US DL applications. This paper surveys the most recent work in the field, with a total of 153 research papers published after 2017. Papers are analyzed and commented from both the methodology and the application perspective. We categorized the papers into (i) fetal standard-plane detection, (ii) anatomical structure analysis and (iii) biometry parameter estimation. For each category, main limitations and open issues are presented. Summary tables are included to facilitate the comparison among the different approaches. In addition, emerging applications are also outlined. Publicly-available datasets and performance metrics commonly used to assess algorithm performance are summarized, too. This paper ends with a critical summary of the current state of the art on DL algorithms for fetal US image analysis and a discussion on current challenges that have to be tackled by researchers working in the field to translate the research methodology into actual clinical practice.

Towards deep observation: A systematic survey on artificial intelligence techniques to monitor fetus via Ultrasound Images

Several reviews have been conducted regarding artificial intelligence (AI) techniques to improve pregnancy outcomes. But they are not focusing on ultrasound images. This survey aims to explore how AI can assist with fetal growth monitoring via ultrasound image. We reported our findings using the guidelines for PRISMA. We conducted a comprehensive search of eight bibliographic databases. Out of 1269 studies 107 are included. We found that 2D ultrasound images were more popular (88) than 3D and 4D ultrasound images (19). Classification is the most used method (42), followed by segmentation (31), classification integrated with segmentation (16) and other miscellaneous methods such as object-detection, regression, and reinforcement learning (18). The most common areas that gained traction within the pregnancy domain were the fetus head (43), fetus body (31), fetus heart (13), fetus abdomen (10), and the fetus face (10). This survey will promote the development of improved AI models for fetal clinical applications.

•

Artificial intelligence studies to monitor fetal development via ultrasound images

•

Fetal issues categorized based on four categories — general, head, heart, face, abdomen

•

The most used AI techniques are classification, segmentation, object detection, and RL

•

The research and practical implications are included.

Prediction for pathological and immunohistochemical characteristics of triple-negative invasive breast carcinomas: the performance comparison between quantitative and qualitative sonographic feature analysis

OBJECTIVE

Sonographic features are associated with pathological and immunohistochemical characteristics of triple-negative breast cancer (TNBC). To predict the biological property of TNBC, the performance using quantitative high-throughput sonographic feature analysis was compared with that using qualitative feature assessment.

METHODS

We retrospectively reviewed ultrasound images, clinical, pathological, and immunohistochemical (IHC) data of 252 female TNBC patients. All patients were subgrouped according to the histological grade, Ki67 expression level, and human epidermal growth factor receptor 2 (HER2) score. Qualitative sonographic feature assessment included shape, margin, posterior acoustic pattern, and calcification referring to the Breast Imaging Reporting and Data System (BI-RADS). Quantitative sonographic features were acquired based on the computer-aided radiomics analysis. Breast cancer masses were manually segmented from the surrounding breast tissues. For each ultrasound image, 1688 radiomics features of 7 feature classes were extracted. The principal component analysis (PCA), least absolute shrinkage and selection operator (LASSO), and support vector machine (SVM) were used to determine the high-throughput radiomics features that were highly correlated to biological properties. The performance using both quantitative and qualitative sonographic features to predict biological properties of TNBC was represented by the area under the receiver operating characteristic curve (AUC).

RESULTS

In the qualitative assessment, regular tumor shape, no angular or spiculated margin, posterior acoustic enhancement, and no calcification were used as the independent sonographic features for TNBC. Using the combination of these four features to predict the histological grade, Ki67, HER2, axillary lymph node metastasis (ALNM), and lymphovascular invasion (LVI), the AUC was 0.673, 0.680, 0.651, 0.587, and 0.566, respectively. The number of high-throughput features that closely correlated with biological properties was 34 for histological grade (AUC 0.942), 27 for Ki67 (AUC 0.732), 25 for HER2 (AUC 0.730), 34 for ALNM (AUC 0.804), and 34 for LVI (AUC 0.795).

CONCLUSION

High-throughput quantitative sonographic features are superior to traditional qualitative ultrasound features in predicting the biological behavior of TNBC.

KEY POINTS

• Sonographic appearances of TNBCs showed a great variety in accordance with its biological and clinical characteristics. • Both qualitative and quantitative sonographic features of TNBCs are associated with tumor biological characteristics. • The quantitative high-throughput feature analysis is superior to two-dimensional sonographic feature assessment in predicting tumor biological property.