Performance of a deep learning based neural network in the selection of human blastocysts for implantation

Bridging gaps in artificial intelligence adoption for maternal-fetal and obstetric care: Unveiling transformative capabilities and challenges

PURPOSE

This review aims to comprehensively explore the application of Artificial Intelligence (AI) to an area that has not been traditionally explored in depth: the continuum of maternal-fetal health. In doing so, the intent was to examine this physiologically continuous spectrum of mother and child health, as well as to highlight potential pitfalls, and suggest solutions for the same.

METHOD

A systematic search identified studies employing AI techniques for prediction, diagnosis, and decision support employing various modalities like imaging, electrophysiological signals and electronic health records in the domain of obstetrics and fetal health. In the selected articles then, AI applications in fetal morphology, gestational age assessment, congenital defect detection, fetal monitoring, placental analysis, and maternal physiological monitoring were critically examined both from the perspective of the domain and artificial intelligence.

RESULT

AI-driven solutions demonstrate promising capabilities in medical diagnostics and risk prediction, offering automation, improved accuracy, and the potential for personalized medicine. However, challenges regarding data availability, algorithmic transparency, and ethical considerations must be overcome to ensure responsible and effective clinical implementation. These challenges must be urgently addressed to ensure a domain as critical to public health as obstetrics and fetal health, is able to fully benefit from the gigantic strides made in the field of artificial intelligence.

CONCLUSION

Open access to relevant datasets is crucial for equitable progress in this critical public health domain. Integrating responsible and explainable AI, while addressing ethical considerations, is essential to maximize the public health benefits of AI-driven solutions in maternal-fetal care.

External validation of a fully automated evaluation tool: a retrospective analysis of 68,471 scored embryos

OBJECTIVE

To externally validate a fully automated embryo classification system for in vitro fertilization (IVF) treatments.

DESIGN

Retrospective cohort study.

SUBJECTS

A total of 6,434 patients undergoing 7,352 IVF treatments contributed 70,456 embryos.

EXPOSURE

Embryos were evaluated by conventional morphology and retrospectively scored using a fully automated deep learning-based algorithm across conventional IVF, oocyte donation, and preimplantation genetic testing for aneuploidy (PGT-A) cycles.

MAIN OUTCOME MEASURES

The primary outcomes were implantation and live birth, including odds ratios (ORs) from generalized estimating equation models. Secondary outcomes were embryo morphology, euploidy, and miscarriage. Exploratory outcomes included a comparison between conventional methodology and artificial intelligence algorithm with areas under the receiver operating characteristics curves (AUCs), agreement degree between artificial intelligence and embryologists, Cohen's Kappa coefficient, and relative risk.

RESULTS

Implantation and live birth rates increased as the automatic embryo scores increased. The generalized estimating equation model, controlling for confounders, showed that the automatic score was associated with an OR of 1.31 (95% confidence interval [CI], 1.25-1.36) for implantation in treatments using oocytes from patients and an OR of 1.17 (95% CI, 1.14-1.20) in the oocyte donation program, with no significant association with PGT-A treatments. For live birth, the ORs were 1.27 (95% CI, 1.21-1.33) for patients, 1.16 (95% CI, 1.13-1.19) for donors, and 1.05 (95% CI, 1-1.10) for PGT-A cycles. The average score was higher in embryos with better morphology, in euploid embryos compared with aneuploid embryos, and in embryos that resulted in a full-term pregnancy compared with those that miscarried. Concordance between the highest-scoring embryo and the embryo with the best conventional morphology was 71.4% (95% CI, 67.7%-75.0%) in treatments with patient oocytes and 61.0% (95% CI, 58.6%-63.4%) in the oocyte donation program. Overall, the Cohen's Kappa coefficient was 0.63. The automatic embryo score showed similar AUCs to conventional morphology, although implantation was higher when the transferred embryo matched the highest-scoring embryo from each cohort (57.36% vs. 49.98%). Relative risk indicated a 1.14-fold increase in implantation likelihood when the top-ranked embryo was transferred.

CONCLUSIONS

A fully automated embryo scoring system effectively ranked embryos based on their potential for implantation and live birth. The performance of the conventional methodology was comparable to that of the artificial intelligence-based technology; however, better clinical outcomes were observed when the highest-scoring embryo in the cohort was transferred.

Cleavage-stage embryo segmentation using SAM-based dual branch pipeline: development and evaluation with the CleavageEmbryo dataset

MOTIVATION

Embryo selection is one of the critical factors in determining the success of pregnancy in in vitro fertilization procedures. Using artificial intelligence to aid in embryo selection could effectively address the current time-consuming, expensive, subjectively influenced process of embryo assessment by trained embryologists. However, current deep learning-based methods often focus on blastocyst segmentation, grading, or predicting cell development via time-lapse videos, often overlooking morphokinetic parameters or lacking interpretability. Given the significance of both morphokinetic and morphological evaluation in predicting the implantation potential of cleavage-stage embryos, as emphasized by previous research, there is a necessity for an automated method to segment cleavage-stage embryos to improve this process.

RESULTS

In this article, we introduce the SAM-based dual branch segmentation pipeline for automated segmentation of blastomeres in cleavage-stage embryos. Leveraging the powerful segmentation capability of SAM, the instance branch conducts instance segmentation of blastomeres, while the semantic branch performs semantic segmentation of fragments. Due to the lack of publicly available datasets, we construct the CleavageEmbryo dataset, the first dataset of human cleavage-stage embryos with pixel-level annotations containing fragment information. We train and test a series of state-of-the-art segmentation algorithms on CleavageEmbryo. Our experiments demonstrate that our method outperforms existing algorithms in terms of objective metrics (mAP 0.874 on blastomeres, Dice 0.695 on fragments) and visual quality, enabling more accurate segmentation of cleavage-stage embryos.

AVAILABILITY AND IMPLEMENTATION

The code and sample data in this study can be found at: https://github.com/12austincc/Cleavage-StageEmbryoSegmentation.

The integration of artificial intelligence in assisted reproduction: a comprehensive review

Artificial Intelligence (AI) has emerged as a transformative force in healthcare, with its integration into assisted reproduction technologies representing a notable milestone. The utilization of AI in assisted reproduction is rooted in the persistent challenge of optimizing outcomes. Despite years of progress, success rates in assisted reproductive techniques remain a concern. The current landscape of AI applications demonstrates significant potential to revolutionize various facets of assisted reproduction, including stimulation protocol optimization, embryo formation prediction, oocyte and sperm selection, and live birth prediction from embryos. AI's capacity for precise image-based analysis, leveraging convolutional neural networks, stands out as a promising avenue. Personalized treatment plans and enhanced diagnostic accuracy are central themes explored in this review. AI-driven healthcare products demonstrate the potential for real-time, adaptive health programs, fostering improved communication between patients and healthcare teams. Continuous learning systems to address challenges associated with biased training data and the time required for accurate decision-making capabilities to develop is imperative. Challenges and ethical considerations in AI-assisted conception as evident when taking into consideration issues such as the lack of legislation regulating AI in healthcare, a fact that emphasizes the need for transparency and equity in the development and implementation of AI technologies. The regulatory framework, both in the UK and globally, is making efforts to balance innovation with patient safety. This paper delves into the revolutionary impact of Artificial Intelligence (AI) in the realm of assisted reproduction technologies (ART). As AI continues to evolve, its application in the field of reproductive medicine holds great promise for improving success rates, personalized treatments, and overall efficiency. This comprehensive review explores the current state of AI in assisted reproduction, its potential benefits, challenges, and ethical considerations.

Application of a methodological framework for the development and multicenter validation of reliable artificial intelligence in embryo evaluation

BACKGROUND

Artificial intelligence (AI) models analyzing embryo time-lapse images have been developed to predict the likelihood of pregnancy following in vitro fertilization (IVF). However, limited research exists on methods ensuring AI consistency and reliability in clinical settings during its development and validation process. We present a methodology for developing and validating an AI model across multiple datasets to demonstrate reliable performance in evaluating blastocyst-stage embryos.

METHODS

This multicenter analysis utilizes time-lapse images, pregnancy outcomes, and morphologic annotations from embryos collected at 10 IVF clinics across 9 countries between 2018 and 2022. The four-step methodology for developing and evaluating the AI model include: (I) curating annotated datasets that represent the intended clinical use case; (II) developing and optimizing the AI model; (III) evaluating the AI's performance by assessing its discriminative power and associations with pregnancy probability across variable data; and (IV) ensuring interpretability and explainability by correlating AI scores with relevant morphologic features of embryo quality. Three datasets were used: the training and validation dataset (n = 16,935 embryos), the blind test dataset (n = 1,708 embryos; 3 clinics), and the independent dataset (n = 7,445 embryos; 7 clinics) derived from previously unseen clinic cohorts.

RESULTS

The AI was designed as a deep learning classifier ranking embryos by score according to their likelihood of clinical pregnancy. Higher AI score brackets were associated with increased fetal heartbeat (FH) likelihood across all evaluated datasets, showing a trend of increasing odds ratios (OR). The highest OR was observed in the top G4 bracket (test dataset G4 score ≥ 7.5: OR 3.84; independent dataset G4 score ≥ 7.5: OR 4.01), while the lowest was in the G1 bracket (test dataset G1 score < 4.0: OR 0.40; independent dataset G1 score < 4.0: OR 0.45). AI score brackets G2, G3, and G4 displayed OR values above 1.0 (P < 0.05), indicating linear associations with FH likelihood. Average AI scores were consistently higher for FH-positive than for FH-negative embryos within each age subgroup. Positive correlations were also observed between AI scores and key morphologic parameters used to predict embryo quality.

CONCLUSIONS

Strong AI performance across multiple datasets demonstrates the value of our four-step methodology in developing and validating the AI as a reliable adjunct to embryo evaluation.

Clinical Prospects for Artificial Intelligence in Obstetrics and Gynecology

In recent years, artificial intelligence (AI) research in the medical field has been actively conducted owing to the evolution of algorithms, such as deep learning, and advances in hardware, such as graphics processing units, and some such medical devices have been used in clinics. AI research in obstetrics and gynecology has also increased. This review discusses the latest studies in each field. In the perinatal field, there are reports on cardiotocography, studies on the diagnosis of fetal abnormalities using ultrasound scans, and studies on placenta previa using magnetic resonance imaging (MRI). In the reproduction field, numerous studies have been conducted on the efficiency of assisted reproductive technology as well as selection of suitable oocyte and good embryos. As regards gynecologic cancers, there are many reports on diagnosis using MRI and prognosis prediction using histopathology in cervical cancer, diagnosis using hysteroscopy and prediction of molecular subtypes based on histopathology in endometrial cancer, and diagnosis using MRI and ultrasound as well as prediction of anticancer drug efficacy in ovarian cancer. However, concerns related to AI research include handling of personal information, lack of governing laws, and transparency. These must be addressed to facilitate advanced AI research.

A review of artificial intelligence applications in in vitro fertilization

The field of reproductive medicine has witnessed rapid advancements in artificial intelligence (AI) methods, which have significantly enhanced the efficiency of diagnosing and treating reproductive disorders. The integration of AI algorithms into the in vitro fertilization (IVF) has the potential to represent the next frontier in advancing personalized reproductive medicine and enhancing fertility outcomes for patients. The potential of AI lies in its ability to bring about a new era characterized by standardization, automation, and an improved success rate in IVF. At present, the utilization of AI in clinical practice is still in its early stages and faces numerous ethical, regulatory, and technical challenges that require attention. In this review, we present an overview of the latest advancements in various applications of AI in IVF, including follicular monitoring, oocyte assessment, embryo selection, and pregnancy outcome prediction. The aim is to reveal the current state of AI applications in the field of IVF, their limitations, and prospects for future development. Further studies, which involve the development of comprehensive models encompassing multiple functions and the conduct of large-scale randomized controlled trials, could potentially indicate the future direction of AI advancements in the field of IVF.

Large language models to facilitate pregnancy prediction after in vitro fertilization

We evaluated the efficacy of large language models (LLMs), specifically, generative pre-trained transformer-4 (GPT-4), in predicting pregnancy following in vitro fertilization (IVF) treatment and compared its accuracy with results from an original published study. Our findings revealed that GPT-4 can autonomously develop and refine advanced machine learning models for pregnancy prediction with minimal human intervention. The prediction accuracy was 0.79, and the area under the receiver operating characteristic curve (AUROC) was 0.89, exceeding or being at least equivalent to the metrics reported in the original study, that is, 0.78 for accuracy and 0.87 for AUROC. The results suggest that LLMs can facilitate data processing, optimize machine learning models in predicting IVF success rates, and provide data interpretation methods. This capacity can help bridge the knowledge gap between data scientists and medical personnel to solve the most pressing clinical challenges. However, more experiments on diverse and larger datasets are needed to validate and promote broader applications of LLMs in assisted reproduction.

Advanced KPI framework for IVF pregnancy prediction models in IVF protocols

The utilization of neural networks in assisted reproductive technology is essential due to their ability to process complex and multidimensional data inherent in IVF procedures, offering opportunities for clinical outcome prediction, personalized treatment implementation, and overall advancement in fertility treatment. The aim of this study was to develop a novel approach to IVF laboratory data analysis, employing deep neural networks to predict the likelihood of clinical pregnancy occurrence within an individual treatment cycle, integrating both key performance indicators and clinical data. We conducted a retrospective analysis spanning 11 years, encompassing 8732 treatment cycles, to extract the most relevant features to our goal and train the model. Internal validation was performed on 1600 preimplantation genetic testing for aneuploidy embryo transfers, while external was conducted across two independent clinics (over 10,000 cases). Leveraging recurrent neural networks, our model demonstrates high accuracy in predicting the likelihood of clinical pregnancy within specific IVF treatment cycles (AUC = 0.68-0.86; test accuracy = 0.78, F1 score = 0.71, sensitivity = 0.62; specificity = 0.86) comparable to time-lapse system but with a simpler approach. Our model facilitates both retrospective analysis of outcomes and prospective evaluation of clinical pregnancy chances, thus presenting a promising avenue for quality management programs and promotes their realization in medical centers.

Approaching ethical issues in the developmental biology classroom

Over the past decades, Developmental Biology has been moving steadily from a rather academic subject to an increasingly practical discipline. It has played a role in the development of contraceptive and conceptive (e.g. in vitro fertilization) technologies. The advent of embryonic (ES) and induced pluripotent stem (iPS) cells and advances in organoids, embryoids, and human-non-human chimeras offer promises and ethical challenges. Courses in developmental biology provide both opportunities and challenges for discussing the societal and ethical implications of new technologies. Here we present outcomes of a Society for Developmental Biology workshop on "teaching ethical issues in developmental biology." We point out important considerations and possible approaches, as well as the need to set boundaries on discussions of the critical issues posed by the new science of embryonic engineering.

Use of time-lapse technology on fertilization verification, embryo evaluation, and utilization: A national survey in Japan

Background

Time-lapse technology (TLT) has emerged as a significant advancement in the field of assisted reproductive technology (ART), providing continuous observation of embryos. However, limited information exists on the adoption of TLT across ART facilities and the clinical implications of its application in embryo evaluation and fertilization verification. The existing literature has not yet comprehensively examined how TLT data are utilized to optimize ART outcomes, particularly in Japan, where ART practices are highly prevalent.

Objectives

This study aimed to investigate the adoption rate of TLT and its clinical effects on fertilization verification, embryo evaluation, and utilization of ART in Japan.

Study Design

An online survey was conducted from December 23, 2022, to January 16, 2023, in 616 ART facilities with both email and mailed notices. The survey investigated the utilization of TLT in each facility's evaluation of oocyte morphology, fertilization, embryo culture, and morphology.

Results

Overall, 345 responses were analyzed. Of these, only 42.6% confirmed fertilization at 16 to 18 hours after insemination. Most facilities defined normally fertilized eggs as 2 pronuclei (2PN; 53.3%) or a combination of a second polar body extrusion and 2PN (44.9%). Overall, 54.6% of the facilities had adopted TLT, and 76.9% to 96.9% of these facilities used TLT images for fertilization verification. At these centers, the use of 0PN embryos decreased, whereas the use of 2.1PN embryos increased. The rates of culture medium supplemented with antioxidants and hyaluronan were significantly higher in facilities with TLT than in those without TLT. TLT images were used for embryo evaluation in 94.3% of the facilities, while 31.0% used a combination of TLT images and artificial intelligence-based scoring systems.

Conclusions

While TLT use is widespread in Japan, its application in evaluating fertilization and embryo development stages varies across facilities. Reaching a consensus on the optimal use of the TLT system will enhance the effectiveness, safety, and efficiency of ARTs.

Harnessing explainable artificial intelligence for patient-to-clinical-trial matching: A proof-of-concept pilot study using phase I oncology trials

This study aims to develop explainable AI methods for matching patients with phase 1 oncology clinical trials using Natural Language Processing (NLP) techniques to address challenges in patient recruitment for improved efficiency in drug development. A prototype system based on modern NLP techniques has been developed to match patient records with phase 1 oncology clinical trial protocols. Four criteria are considered for the matching: cancer type, performance status, genetic mutation, and measurable disease. The system outputs a summary matching score along with explanations of the evidence. The outputs of the AI system were evaluated against the ground truth matching results provided by the domain expert on a dataset of twelve synthesized dummy patient records and six clinical trial protocols. The system achieved a precision of 73.68%, sensitivity/recall of 56%, accuracy of 77.78%, and specificity of 89.36%. Further investigation into the misclassified cases indicated that ambiguity of abbreviation and misunderstanding of context are significant contributors to errors. The system found evidence of no matching for all false positive cases. To the best of our knowledge, no system in the public domain currently deploys an explainable AI-based approach to identify optimal patients for phase 1 oncology trials. This initial attempt to develop an AI system for patients and clinical trial matching in the context of phase 1 oncology trials showed promising results that are set to increase efficiency without sacrificing quality in patient-trial matching.

Anomaly Detection in Embryo Development and Morphology Using Medical Computer Vision-Aided Swin Transformer with Boosted Dipper-Throated Optimization Algorithm

Infertility affects a significant number of humans. A supported reproduction technology was verified to ease infertility problems. In vitro fertilization (IVF) is one of the best choices, and its success relies on the preference for a higher-quality embryo for transmission. These have been normally completed physically by testing embryos in a microscope. The traditional morphological calculation of embryos shows predictable disadvantages, including effort- and time-consuming and expected risks of bias related to individual estimations completed by specific embryologists. Different computer vision (CV) and artificial intelligence (AI) techniques and devices have been recently applied in fertility hospitals to improve efficacy. AI addresses the imitation of intellectual performance and the capability of technologies to simulate cognitive learning, thinking, and problem-solving typically related to humans. Deep learning (DL) and machine learning (ML) are advanced AI algorithms in various fields and are considered the main algorithms for future human assistant technology. This study presents an Embryo Development and Morphology Using a Computer Vision-Aided Swin Transformer with a Boosted Dipper-Throated Optimization (EDMCV-STBDTO) technique. The EDMCV-STBDTO technique aims to accurately and efficiently detect embryo development, which is critical for improving fertility treatments and advancing developmental biology using medical CV techniques. Primarily, the EDMCV-STBDTO method performs image preprocessing using a bilateral filter (BF) model to remove the noise. Next, the swin transformer method is implemented for the feature extraction technique. The EDMCV-STBDTO model employs the variational autoencoder (VAE) method to classify human embryo development. Finally, the hyperparameter selection of the VAE method is implemented using the boosted dipper-throated optimization (BDTO) technique. The efficiency of the EDMCV-STBDTO method is validated by comprehensive studies using a benchmark dataset. The experimental result shows that the EDMCV-STBDTO method performs better than the recent techniques.

Enhancing predictive models for egg donation: time to blastocyst hatching and machine learning insights

BACKGROUND

Data sciences and artificial intelligence are becoming encouraging tools in assisted reproduction, favored by time-lapse technology incubators. Our objective is to analyze, compare and identify the most predictive machine learning algorithm developed using a known implantation database of embryos transferred in our egg donation program, including morphokinetic and morphological variables, and recognize the most predictive embryo parameters in order to enhance IVF treatments clinical outcomes.

METHODS

Multicenter retrospective cohort study carried out in 378 egg donor recipients who performed a fresh single embryo transfer during 2021. All treatments were performed by Intracytoplasmic Sperm Injection, using fresh or frozen oocytes. The embryos were cultured in Geri® time-lapse incubators until transfer on day 5. The embryonic morphokinetic events of 378 blastocysts with known implantation and live birth were analyzed. Classical statistical analysis (binary logistic regression) and 10 machine learning algorithms were applied including Multi-Layer Perceptron, Support Vector Machines, k-Nearest Neighbor, Cart and C0.5 Classification Trees, Random Forest (RF), AdaBoost Classification Trees, Stochastic Gradient boost, Bagged CART and eXtrem Gradient Boosting. These algorithms were developed and optimized by maximizing the area under the curve.

RESULTS

The Random Forest emerged as the most predictive algorithm for implantation (area under the curve, AUC = 0.725, IC 95% [0.6232-0826]). Overall, implantation and miscarriage rates stood at 56.08% and 18.39%, respectively. Overall live birth rate was 41.26%. Significant disparities were observed regarding time to hatching out of the zona pellucida (p = 0.039). The Random Forest algorithm demonstrated good predictive capabilities for live birth (AUC = 0.689, IC 95% [0.5821-0.7921]), but the AdaBoost classification trees proved to be the most predictive model for live birth (AUC = 0.749, IC 95% [0.6522-0.8452]). Other important variables with substantial predictive weight for implantation and live birth were duration of visible pronuclei (DESAPPN-APPN), synchronization of cleavage patterns (T8-T5), duration of compaction (TM-TiCOM), duration of compaction until first sign of cavitation (TiCAV-TM) and time to early compaction (TiCOM).

CONCLUSIONS

This study highlights Random Forest and AdaBoost as the most effective machine learning models in our Known Implantation and Live Birth Database from our egg donation program. Notably, time to blastocyst hatching out of the zona pellucida emerged as a highly reliable parameter significantly influencing our implantation machine learning predictive models. Processes involving syngamy, genomic imprinting during embryo cleavage, and embryo compaction are also influential and could be crucial for implantation and live birth outcomes.

Artificial intelligence system for outcome evaluations of human in vitro fertilization-derived embryos

BACKGROUND

In vitro fertilization (IVF) has emerged as a transformative solution for infertility. However, achieving favorable live-birth outcomes remains challenging. Current clinical IVF practices in IVF involve the collection of heterogeneous embryo data through diverse methods, including static images and temporal videos. However, traditional embryo selection methods, primarily reliant on visual inspection of morphology, exhibit variability and are contingent on the experience of practitioners. Therefore, an automated system that can evaluate heterogeneous embryo data to predict the final outcomes of live births is highly desirable.

METHODS

We employed artificial intelligence (AI) for embryo morphological grading, blastocyst embryo selection, aneuploidy prediction, and final live-birth outcome prediction. We developed and validated the AI models using multitask learning for embryo morphological assessment, including pronucleus type on day 1 and the number of blastomeres, asymmetry, and fragmentation of blastomeres on day 3, using 19,201 embryo photographs from 8271 patients. A neural network was trained on embryo and clinical metadata to identify good-quality embryos for implantation on day 3 or day 5, and predict live-birth outcomes. Additionally, a 3D convolutional neural network was trained on 418 time-lapse videos of preimplantation genetic testing (PGT)-based ploidy outcomes for the prediction of aneuploidy and consequent live-birth outcomes.

RESULTS

These two approaches enabled us to automatically assess the implantation potential. By combining embryo and maternal metrics in an ensemble AI model, we evaluated live-birth outcomes in a prospective cohort that achieved higher accuracy than experienced embryologists (46.1% vs. 30.7% on day 3, 55.0% vs. 40.7% on day 5). Our results demonstrate the potential for AI-based selection of embryos based on characteristics beyond the observational abilities of human clinicians (area under the curve: 0.769, 95% confidence interval: 0.709-0.820). These findings could potentially provide a noninvasive, high-throughput, and low-cost screening tool to facilitate embryo selection and achieve better outcomes.

CONCLUSIONS

Our study underscores the AI model's ability to provide interpretable evidence for clinicians in assisted reproduction, highlighting its potential as a noninvasive, efficient, and cost-effective tool for improved embryo selection and enhanced IVF outcomes. The convergence of cutting-edge technology and reproductive medicine has opened new avenues for addressing infertility challenges and optimizing IVF success rates.

Generative artificial intelligence to produce high-fidelity blastocyst-stage embryo images

STUDY QUESTION

Can generative artificial intelligence (AI) models produce high-fidelity images of human blastocysts?

SUMMARY ANSWER

Generative AI models exhibit the capability to generate high-fidelity human blastocyst images, thereby providing substantial training datasets crucial for the development of robust AI models.

WHAT IS KNOWN ALREADY

The integration of AI into IVF procedures holds the potential to enhance objectivity and automate embryo selection for transfer. However, the effectiveness of AI is limited by data scarcity and ethical concerns related to patient data privacy. Generative adversarial networks (GAN) have emerged as a promising approach to alleviate data limitations by generating synthetic data that closely approximate real images.

STUDY DESIGN, SIZE, DURATION

Blastocyst images were included as training data from a public dataset of time-lapse microscopy (TLM) videos (n = 136). A style-based GAN was fine-tuned as the generative model.

PARTICIPANTS/MATERIALS, SETTING, METHODS

We curated a total of 972 blastocyst images as training data, where frames were captured within the time window of 110-120 h post-insemination at 1-h intervals from TLM videos. We configured the style-based GAN model with data augmentation (AUG) and pretrained weights (Pretrained-T: with translation equivariance; Pretrained-R: with translation and rotation equivariance) to compare their optimization on image synthesis. We then applied quantitative metrics including Fréchet Inception Distance (FID) and Kernel Inception Distance (KID) to assess the quality and fidelity of the generated images. Subsequently, we evaluated qualitative performance by measuring the intelligence behavior of the model through the visual Turing test. To this end, 60 individuals with diverse backgrounds and expertise in clinical embryology and IVF evaluated the quality of synthetic embryo images.

MAIN RESULTS AND THE ROLE OF CHANCE

During the training process, we observed consistent improvement of image quality that was measured by FID and KID scores. Pretrained and AUG + Pretrained initiated with remarkably lower FID and KID values compared to both Baseline and AUG + Baseline models. Following 5000 training iterations, the AUG + Pretrained-R model showed the highest performance of the evaluated five configurations with FID and KID scores of 15.2 and 0.004, respectively. Subsequently, we carried out the visual Turing test, such that IVF embryologists, IVF laboratory technicians, and non-experts evaluated the synthetic blastocyst-stage embryo images and obtained similar performance in specificity with marginal differences in accuracy and sensitivity.

LIMITATIONS, REASONS FOR CAUTION

In this study, we primarily focused the training data on blastocyst images as IVF embryos are primarily assessed in blastocyst stage. However, generation of an array of images in different preimplantation stages offers further insights into the development of preimplantation embryos and IVF success. In addition, we resized training images to a resolution of 256 × 256 pixels to moderate the computational costs of training the style-based GAN models. Further research is needed to involve a more extensive and diverse dataset from the formation of the zygote to the blastocyst stage, e.g. video generation, and the use of improved image resolution to facilitate the development of comprehensive AI algorithms and to produce higher-quality images.

WIDER IMPLICATIONS OF THE FINDINGS

Generative AI models hold promising potential in generating high-fidelity human blastocyst images, which allows the development of robust AI models as it can provide sufficient training datasets while safeguarding patient data privacy. Additionally, this may help to produce sufficient embryo imaging training data with different (rare) abnormal features, such as embryonic arrest, tripolar cell division to avoid class imbalances and reach to even datasets. Thus, generative models may offer a compelling opportunity to transform embryo selection procedures and substantially enhance IVF outcomes.

STUDY FUNDING/COMPETING INTEREST(S)

This study was supported by a Horizon 2020 innovation grant (ERIN, grant no. EU952516) and a Horizon Europe grant (NESTOR, grant no. 101120075) of the European Commission to A.S. and M.Z.E., the Estonian Research Council (grant no. PRG1076) to A.S., and the EVA (Erfelijkheid Voortplanting & Aanleg) specialty program (grant no. KP111513) of Maastricht University Medical Centre (MUMC+) to M.Z.E.

TRIAL REGISTRATION NUMBER

Not applicable.

Evaluation of the Clinical Efficacy and Trust in AI-Assisted Embryo Ranking: Survey-Based Prospective Study

BACKGROUND

Current embryo assessment methods for in vitro fertilization depend on subjective morphological assessments. Recently, artificial intelligence (AI) has emerged as a promising tool for embryo assessment; however, its clinical efficacy and trustworthiness remain unproven. Simulation studies may provide additional evidence, provided that they are meticulously designed to mitigate bias and variance.

OBJECTIVE

The primary objective of this study was to evaluate the benefits of an AI model for predicting clinical pregnancy through well-designed simulations. The secondary objective was to identify the characteristics of and potential bias in the subgroups of embryologists with varying degrees of experience.

METHODS

This simulation study involved a questionnaire-based survey conducted on 61 embryologists with varying levels of experience from 12 in vitro fertilization clinics. The survey was conducted via Google Forms (Google Inc) in three phases: (1) phase 1, an initial assessment (December 23, 2022, to January 22, 2023); (2) phase 2, a validation assessment (March 6, 2023, to April 5, 2023); and (3) phase 3 an AI-guided assessment (March 6, 2023, to April 5, 2023). Inter- and intraobserver assessments and the accuracy of embryo selection from 360 day-5 embryos before and after AI guidance were analyzed for all embryologists and subgroups of senior and junior embryologists.

RESULTS

With AI guidance, the interobserver agreement increased from 0.355 to 0.527 and from 0.440 to 0.524 for junior and senior embryologists, respectively, thus reaching similar levels of agreement. In a test of accurate embryo selection with 90 questions, the numbers of correct responses by the embryologists only, embryologists with AI guidance, and AI only were 34 (38%), 45 (50%), and 59 (66%), respectively. Without AI, the average score (accuracy) of the junior group was 33.516 (37%), while that of the senior group was 35.967 (40%), with P<.001 in the t test. With AI guidance, the average score (accuracy) of the junior group increased to 46.581 (52%), reaching a level similar to that of the senior embryologists of 44.833 (50%), with P=.34. Junior embryologists had a higher level of trust in the AI score.

CONCLUSIONS

This study demonstrates the potential benefits of AI in selecting embryos with high chances of pregnancy, particularly for embryologists with 5 years or less of experience, possibly due to their trust in AI. Thus, using AI as an auxiliary tool in clinical practice has the potential to improve embryo assessment and increase the probability of a successful pregnancy.

An artificial intelligence algorithm to select most viable embryos considering current process in IVF labs

Background

The most common Assisted Reproductive Technology is In-Vitro Fertilization (IVF). During IVF, embryologists commonly perform a morphological assessment to evaluate embryo quality and choose the best embryo for transferring to the uterus. However, embryo selection through morphological assessment is subjective, so various embryologists obtain different conclusions. Furthermore, humans can consider only a limited number of visual parameters resulting in a poor IVF success rate. Artificial intelligence (AI) for embryo selection is objective and can include many parameters, leading to better IVF outcomes.

Objectives

This study sought to use AI to (1) predict pregnancy results based on embryo images, (2) assess using more than one image of the embryo in the prediction of pregnancy but based on the current process in IVF labs, and (3) compare results of AI-Based methods and embryologist experts in predicting pregnancy.

Methods

A data set including 252 Time-lapse Videos of embryos related to IVF performed between 2017 and 2020 was collected. Frames related to 19 ± 1, 43 ± 1, and 67 ± 1 h post-insemination were extracted. Well-Known CNN architectures with transfer learning have been applied to these images. The results have been compared with an algorithm that only uses the final image of embryos. Furthermore, the results have been compared with five experienced embryologists.

Results

To predict the pregnancy outcome, we applied five well-known CNN architectures (AlexNet, ResNet18, ResNet34, Inception V3, and DenseNet121). DeepEmbryo, using three images, predicts pregnancy better than the algorithm that only uses one final image. It also can predict pregnancy better than all embryologists. Different well-known architectures can successfully predict pregnancy chances with up to 75.0% accuracy using Transfer Learning.

Conclusion

We have developed DeepEmbryo, an AI-based tool that uses three static images to predict pregnancy. Additionally, DeepEmbryo uses images that can be obtained in the current IVF process in almost all IVF labs. AI-based tools have great potential for predicting pregnancy and can be used as a proper tool in the future.

Testing the generalizability and effectiveness of deep learning models among clinics: sperm detection as a pilot study

BACKGROUND

Deep learning has been increasingly investigated for assisting clinical in vitro fertilization (IVF). The first technical step in many tasks is to visually detect and locate sperm, oocytes, and embryos in images. For clinical deployment of such deep learning models, different clinics use different image acquisition hardware and different sample preprocessing protocols, raising the concern over whether the reported accuracy of a deep learning model by one clinic could be reproduced in another clinic. Here we aim to investigate the effect of each imaging factor on the generalizability of object detection models, using sperm analysis as a pilot example.

METHODS

Ablation studies were performed using state-of-the-art models for detecting human sperm to quantitatively assess how model precision (false-positive detection) and recall (missed detection) were affected by imaging magnification, imaging mode, and sample preprocessing protocols. The results led to the hypothesis that the richness of image acquisition conditions in a training dataset deterministically affects model generalizability. The hypothesis was tested by first enriching the training dataset with a wide range of imaging conditions, then validated through internal blind tests on new samples and external multi-center clinical validations.

RESULTS

Ablation experiments revealed that removing subsets of data from the training dataset significantly reduced model precision. Removing raw sample images from the training dataset caused the largest drop in model precision, whereas removing 20x images caused the largest drop in model recall. by incorporating different imaging and sample preprocessing conditions into a rich training dataset, the model achieved an intraclass correlation coefficient (ICC) of 0.97 (95% CI: 0.94-0.99) for precision, and an ICC of 0.97 (95% CI: 0.93-0.99) for recall. Multi-center clinical validation showed no significant differences in model precision or recall across different clinics and applications.

CONCLUSIONS

The results validated the hypothesis that the richness of data in the training dataset is a key factor impacting model generalizability. These findings highlight the importance of diversity in a training dataset for model evaluation and suggest that future deep learning models in andrology and reproductive medicine should incorporate comprehensive feature sets for enhanced generalizability across clinics.

BlastAssist: a deep learning pipeline to measure interpretable features of human embryos

STUDY QUESTION

Can the BlastAssist deep learning pipeline perform comparably to or outperform human experts and embryologists at measuring interpretable, clinically relevant features of human embryos in IVF?

SUMMARY ANSWER

The BlastAssist pipeline can measure a comprehensive set of interpretable features of human embryos and either outperform or perform comparably to embryologists and human experts in measuring these features.

WHAT IS KNOWN ALREADY

Some studies have applied deep learning and developed 'black-box' algorithms to predict embryo viability directly from microscope images and videos but these lack interpretability and generalizability. Other studies have developed deep learning networks to measure individual features of embryos but fail to conduct careful comparisons to embryologists' performance, which are fundamental to demonstrate the network's effectiveness.

STUDY DESIGN, SIZE, DURATION

We applied the BlastAssist pipeline to 67 043 973 images (32 939 embryos) recorded in the IVF lab from 2012 to 2017 in Tel Aviv Sourasky Medical Center. We first compared the pipeline measurements of individual images/embryos to manual measurements by human experts for sets of features, including: (i) fertilization status (n = 207 embryos), (ii) cell symmetry (n = 109 embryos), (iii) degree of fragmentation (n = 6664 images), and (iv) developmental timing (n = 21 036 images). We then conducted detailed comparisons between pipeline outputs and annotations made by embryologists during routine treatments for features, including: (i) fertilization status (n = 18 922 embryos), (ii) pronuclei (PN) fade time (n = 13 781 embryos), (iii) degree of fragmentation on Day 2 (n = 11 582 embryos), and (iv) time of blastulation (n = 3266 embryos). In addition, we compared the pipeline outputs to the implantation results of 723 single embryo transfer (SET) cycles, and to the live birth results of 3421 embryos transferred in 1801 cycles.

PARTICIPANTS/MATERIALS, SETTING, METHODS

In addition to EmbryoScope™ image data, manual embryo grading and annotations, and electronic health record (EHR) data on treatment outcomes were also included. We integrated the deep learning networks we developed for individual features to construct the BlastAssist pipeline. Pearson's χ2 test was used to evaluate the statistical independence of individual features and implantation success. Bayesian statistics was used to evaluate the association of the probability of an embryo resulting in live birth to BlastAssist inputs.

MAIN RESULTS AND THE ROLE OF CHANCE

The BlastAssist pipeline integrates five deep learning networks and measures comprehensive, interpretable, and quantitative features in clinical IVF. The pipeline performs similarly or better than manual measurements. For fertilization status, the network performs with very good parameters of specificity and sensitivity (area under the receiver operating characteristics (AUROC) 0.84-0.94). For symmetry score, the pipeline performs comparably to the human expert at both 2-cell (r = 0.71 ± 0.06) and 4-cell stages (r = 0.77 ± 0.07). For degree of fragmentation, the pipeline (acc = 69.4%) slightly under-performs compared to human experts (acc = 73.8%). For developmental timing, the pipeline (acc = 90.0%) performs similarly to human experts (acc = 91.4%). There is also strong agreement between pipeline outputs and annotations made by embryologists during routine treatments. For fertilization status, the pipeline and embryologists strongly agree (acc = 79.6%), and there is strong correlation between the two measurements (r = 0.683). For degree of fragmentation, the pipeline and embryologists mostly agree (acc = 55.4%), and there is also strong correlation between the two measurements (r = 0.648). For both PN fade time (r = 0.787) and time of blastulation (r = 0.887), there's strong correlation between the pipeline and embryologists. For SET cycles, 2-cell time (P < 0.01) and 2-cell symmetry (P < 0.03) are significantly correlated with implantation success rate, while other features showed correlations with implantation success without statistical significance. In addition, 2-cell time (P < 5 × 10-11), PN fade time (P < 5 × 10-10), degree of fragmentation on Day 3 (P < 5 × 10-4), and 2-cell symmetry (P < 5 × 10-3) showed statistically significant correlation with the probability of the transferred embryo resulting in live birth.

LIMITATIONS, REASONS FOR CAUTION

We have not tested the BlastAssist pipeline on data from other clinics or other time-lapse microscopy (TLM) systems. The association study we conducted with live birth results do not take into account confounding variables, which will be necessary to construct an embryo selection algorithm. Randomized controlled trials (RCT) will be necessary to determine whether the pipeline can improve success rates in clinical IVF.

WIDER IMPLICATIONS OF THE FINDINGS

BlastAssist provides a comprehensive and holistic means of evaluating human embryos. Instead of using a black-box algorithm, BlastAssist outputs meaningful measurements of embryos that can be interpreted and corroborated by embryologists, which is crucial in clinical decision making. Furthermore, the unprecedentedly large dataset generated by BlastAssist measurements can be used as a powerful resource for further research in human embryology and IVF.

STUDY FUNDING/COMPETING INTEREST(S)

This work was supported by Harvard Quantitative Biology Initiative, the NSF-Simons Center for Mathematical and Statistical Analysis of Biology at Harvard (award number 1764269), the National Institute of Heath (award number R01HD104969), the Perelson Fund, and the Sagol fund for embryos and stem cells as part of the Sagol Network. The authors declare no competing interests.

TRIAL REGISTRATION NUMBER

Not applicable.

Blastocyst telomere length predicts successful implantation after frozen-thawed embryo transfer

STUDY QUESTION

Do embryos with longer telomere length (TL) at the blastocyst stage have a higher capacity to survive after frozen-thawed embryo transfer (FET)?

SUMMARY ANSWER

Digitally estimated TL using low-pass whole genome sequencing (WGS) data from the preimplantation genetic testing for aneuploidy (PGT-A) process demonstrates that blastocyst TL is the most essential factor associated with likelihood of implantation.

WHAT IS KNOWN ALREADY

The lifetime TL is established in the early cleavage cycles following fertilization through a recombination-based lengthening mechanism and starts erosion beyond the blastocyst stage. In addition, a telomerase-mediated slow erosion of TL in human fetuses has been observed from a gestational age of 6-11 weeks. Finally, an abnormal shortening of telomeres is likely involved in embryo loss during early development.

STUDY DESIGN SIZE DURATION

Blastocyst samples were obtained from patients who underwent PGT-A and FET in an IVF center from March 2015 to May 2018. Digitally estimated mitochondrial copy number (mtCN) and TL were used to study associations with the implantation potential of each embryo.

PARTICIPANTS/MATERIALS SETTING AND METHODS

In total, 965 blastocysts from 232 cycles (164 patients) were available to investigate the biological and clinical relevance of TL. A WGS-based workflow was applied to determine the ploidy of each embryo. Data from low-pass WGS-PGT-A were used to estimate the mtCN and TL for each embryo. Single-variant and multi-variant logistic regression, decision tree, and random forest models were applied to study various factors in association with the implantation potential of each embryo.

MAIN RESULTS AND THE ROLE OF CHANCE

Of the 965 blastocysts originally available, only 216 underwent FET. While mtCN from the transferred embryos is significantly associated with the ploidy call of each embryo, mtCN has no role in impacting IVF outcomes after an embryo transfer in these women. The results indicate that mtCN is a marker of embryo aneuploidy. On the other hand, digitally estimated TL is the most prominent univariant factor and showed a significant positive association with pregnancy outcomes (P < 0.01, odds ratio 79.1). We combined several maternal and embryo parameters to study the joint effects on successful implantation. The machine learning models, namely decision tree and random forest, were trained and yielded classification accuracy of 0.82 and 0.91, respectively. Taken together, these results support the vital role of TL in governing implantation potential, perhaps through the ability to control embryo survival after transfer.

LIMITATIONS REASONS FOR CAUTION

The small sample size limits our study as only 216 blastocysts were transferred. The number was further reduced to 153 blastocysts, where pregnancy outcomes could be accurately traced. The other limitation of this study is that all data were collected from a single IVF center. The uniform and controlled operation of IVF cycles in a single center may cause selection bias.

WIDER IMPLICATIONS OF THE FINDINGS

We present novel findings to show that digitally estimated TL at the blastocyst stage is a predictor of pregnancy capacity after a FET cycle. As elective single-embryo transfer has become the mainstream direction in reproductive medicine, prioritizing embryos based on their implantation potential is crucial for clinical infertility treatment in order to reduce twin pregnancy rate and the time to pregnancy in an IVF center. The AI-powered, random forest prediction model established in this study thus provides a way to improve clinical practice and optimize the chances for people with fertility problems to achieve parenthood.

STUDY FUNDING/COMPETING INTERESTS

This study was supported by a grant from the National Science and Technology Council, Taiwan (MOST 108-2321-B-006-013 -). There were no competing interests.

TRIAL REGISTRATION NUMBER

N/A.

Associations between the artificial intelligence scoring system and live birth outcomes in preimplantation genetic testing for aneuploidy cycles

BACKGROUND

Several studies have demonstrated that iDAScore is more accurate in predicting pregnancy outcomes in cycles without preimplantation genetic testing for aneuploidy (PGT-A) compared to KIDScore and the Gardner criteria. However, the effectiveness of iDAScore in cycles with PGT-A has not been thoroughly investigated. Therefore, this study aims to assess the association between artificial intelligence (AI)-based iDAScore (version 1.0) and pregnancy outcomes in single-embryo transfer (SET) cycles with PGT-A.

METHODS

This retrospective study was approved by the Institutional Review Board of Chung Sun Medical University, Taichung, Taiwan. Patients undergoing SET cycles (n = 482) following PGT-A at a single reproductive center between January 2017 and June 2021. The blastocyst morphology and morphokinetics of all embryos were evaluated using a time-lapse system. The blastocysts were ranked based on the scores generated by iDAScore, which were defined as AI scores, or by KIDScore D5 (version 3.2) following the manufacturer's protocols. A single blastocyst without aneuploidy was transferred after examining the embryonic ploidy status using a next-generation sequencing-based PGT-A platform. Logistic regression analysis with generalized estimating equations was conducted to assess whether AI scores are associated with the probability of live birth (LB) while considering confounding factors.

RESULTS

Logistic regression analysis revealed that AI score was significantly associated with LB probability (adjusted odds ratio [OR] = 2.037, 95% confidence interval [CI]: 1.632-2.542) when pulsatility index (PI) level and types of chromosomal abnormalities were controlled. Blastocysts were divided into quartiles in accordance with their AI score (group 1: 3.0-7.8; group 2: 7.9-8.6; group 3: 8.7-8.9; and group 4: 9.0-9.5). Group 1 had a lower LB rate (34.6% vs. 59.8-72.3%) and a higher rate of pregnancy loss (26% vs. 4.7-8.9%) compared with the other groups (p < 0.05). The receiver operating characteristic curve analysis verified that the iDAScore had a significant but limited ability to predict LB (area under the curve [AUC] = 0.64); this ability was significantly weaker than that of the combination of iDAScore, type of chromosomal abnormalities, and PI level (AUC = 0.67). In the comparison of the LB groups with the non-LB groups, the AI scores were significantly lower in the non-LB groups, both for euploid (median: 8.6 vs. 8.8) and mosaic (median: 8.0 vs. 8.6) SETs.

CONCLUSIONS

Although its predictive ability can be further enhanced, the AI score was significantly associated with LB probability in SET cycles. Euploid or mosaic blastocysts with low AI scores (≤ 7.8) were associated with a lower LB rate, indicating the potential of this annotation-free AI system as a decision-support tool for deselecting embryos with poor pregnancy outcomes following PGT-A.

The Role of Artificial Intelligence and Machine Learning in Assisted Reproductive Technologies

Artificial intelligence (AI) and machine learning, the form most commonly used in medicine, offer powerful tools utilizing the strengths of large data sets and intelligent algorithms. These systems can help to revolutionize delivery of treatments, access to medical care, and improvement of outcomes, particularly in the realm of reproductive medicine. Whether that is more robust oocyte and embryo grading or more accurate follicular measurement, AI will be able to aid clinicians, and most importantly patients, in providing the best possible and individualized care. However, despite all of the potential strengths of AI, algorithms are not immune to bias and are vulnerable to the many socioeconomic and demographic biases that current healthcare systems suffer from. Wrong diagnoses as well is furthering of healthcare discrimination are real possibilities if both the capabilities and limitations of AI are not well understood. Armed with appropriate knowledge of how AI can most appropriately operate within medicine, and specifically reproductive medicine, will enable clinicians to both create and utilize machine learning-based innovations for the furthering of reproductive medicine and ultimately achieving the goal of building of healthy families.

Application of artificial neural networks in reproductive medicine

With the emergence of the age of information, the data on reproductive medicine has improved immensely. Nonetheless, healthcare workers who wish to utilise the relevance and implied value of the various data available to aid clinical decision-making encounter the difficulty of statistically analysing such large data. The application of artificial intelligence becoming widespread in recent years has emerged as a turning point in this regard. Artificial neural networks (ANNs) exhibit beneficial characteristics of comprehensive analysis and autonomous learning, owing to which these are being applied to disease diagnosis, embryo quality assessment, and prediction of pregnancy outcomes. The present report aims to summarise the application of ANNs in the field of reproduction and analyse its further application potential.

Deep learning for embryo evaluation using time-lapse: a systematic review of diagnostic test accuracy

OBJECTIVE

This study aimed to investigate the accuracy of convolutional neural network models in the assessment of embryos using time-lapse monitoring.

DATA SOURCES

A systematic search was conducted in PubMed and Web of Science databases from January 2016 to December 2022. The search strategy was carried out by using key words and MeSH (Medical Subject Headings) terms.

STUDY ELIGIBILITY CRITERIA

Studies were included if they reported the accuracy of convolutional neural network models for embryo evaluation using time-lapse monitoring. The review was registered with PROSPERO (International Prospective Register of Systematic Reviews; identification number CRD42021275916).

METHODS

Two reviewer authors independently screened results using the Covidence systematic review software. The full-text articles were reviewed when studies met the inclusion criteria or in any uncertainty. Nonconsensus was resolved by a third reviewer. Risk of bias and applicability were evaluated using the QUADAS-2 tool and the modified Joanna Briggs Institute or JBI checklist.

RESULTS

Following a systematic search of the literature, 22 studies were identified as eligible for inclusion. All studies were retrospective. A total of 522,516 images of 222,998 embryos were analyzed. Three main outcomes were evaluated: successful in vitro fertilization, blastocyst stage classification, and blastocyst quality. Most studies reported >80% accuracy, and embryologists were outperformed in some. Ten studies had a high risk of bias, mostly because of patient bias.

CONCLUSION

The application of artificial intelligence in time-lapse monitoring has the potential to provide more efficient, accurate, and objective embryo evaluation. Models that examined blastocyst stage classification showed the best predictions. Models that predicted live birth had a low risk of bias, used the largest databases, and had external validation, which heightens their relevance to clinical application. Our systematic review is limited by the high heterogeneity among the included studies. Researchers should share databases and standardize reporting.

Application of artificial intelligence in gametes and embryos selection

Gamete and embryo quality are critical to the success rate of Assisted Reproductive Technology (ART) cycles, but there remains a lack of methods to accurately measure the quality of sperm, oocytes and embryos. The ability of Artificial Intelligence (AI) technology to analyze large amounts of data, especially video and images, is particularly useful in gamete and embryo assessment and selection. The well-trained model has fast calculation speed and high accuracy, which can help embryologists to perform more objective gamete and embryo selection. Various artificial intelligence models have been developed for gamete and embryo assessment, some of which exhibit good performance. In this review, we summarize the latest applications of AI technology in semen analysis, as well as selection for sperm, oocyte and embryo, and discuss the existing problems and development directions of artificial intelligence in this field.

Using Unlabeled Information of Embryo Siblings from the Same Cohort Cycle to Enhance In Vitro Fertilization Implantation Prediction

High-content time-lapse embryo imaging assessed by machine learning is revolutionizing the field of in vitro fertilization (IVF). However, the vast majority of IVF embryos are not transferred to the uterus, and these masses of embryos with unknown implantation outcomes are ignored in current efforts that aim to predict implantation. Here, whether, and to what extent the information encoded within "sibling" embryos from the same IVF cohort contributes to the performance of machine learning-based implantation prediction is explored. First, it is shown that the implantation outcome is correlated with attributes derived from the cohort siblings. Second, it is demonstrated that this unlabeled data boosts implantation prediction performance. Third, the cohort properties driving embryo prediction, especially those that rescued erroneous predictions, are characterized. The results suggest that predictive models for embryo implantation can benefit from the overlooked, widely available unlabeled data of sibling embryos by reducing the inherent noise of the individual transferred embryo.

Embryo selection through artificial intelligence versus embryologists: a systematic review

STUDY QUESTION

What is the present performance of artificial intelligence (AI) decision support during embryo selection compared to the standard embryo selection by embryologists?

SUMMARY ANSWER

AI consistently outperformed the clinical teams in all the studies focused on embryo morphology and clinical outcome prediction during embryo selection assessment.

WHAT IS KNOWN ALREADY

The ART success rate is ∼30%, with a worrying trend of increasing female age correlating with considerably worse results. As such, there have been ongoing efforts to address this low success rate through the development of new technologies. With the advent of AI, there is potential for machine learning to be applied in such a manner that areas limited by human subjectivity, such as embryo selection, can be enhanced through increased objectivity. Given the potential of AI to improve IVF success rates, it remains crucial to review the performance between AI and embryologists during embryo selection.

STUDY DESIGN SIZE DURATION

The search was done across PubMed, EMBASE, Ovid Medline, and IEEE Xplore from 1 June 2005 up to and including 7 January 2022. Included articles were also restricted to those written in English. Search terms utilized across all databases for the study were: ('Artificial intelligence' OR 'Machine Learning' OR 'Deep learning' OR 'Neural network') AND ('IVF' OR 'in vitro fertili*' OR 'assisted reproductive techn*' OR 'embryo'), where the character '*' refers the search engine to include any auto completion of the search term.

PARTICIPANTS/MATERIALS SETTING METHODS

A literature search was conducted for literature relating to AI applications to IVF. Primary outcomes of interest were accuracy, sensitivity, and specificity of the embryo morphology grade assessments and the likelihood of clinical outcomes, such as clinical pregnancy after IVF treatments. Risk of bias was assessed using the Modified Down and Black Checklist.

MAIN RESULTS AND THE ROLE OF CHANCE

Twenty articles were included in this review. There was no specific embryo assessment day across the studies-Day 1 until Day 5/6 of embryo development was investigated. The types of input for training AI algorithms were images and time-lapse (10/20), clinical information (6/20), and both images and clinical information (4/20). Each AI model demonstrated promise when compared to an embryologist's visual assessment. On average, the models predicted the likelihood of successful clinical pregnancy with greater accuracy than clinical embryologists, signifying greater reliability when compared to human prediction. The AI models performed at a median accuracy of 75.5% (range 59-94%) on predicting embryo morphology grade. The correct prediction (Ground Truth) was defined through the use of embryo images according to post embryologists' assessment following local respective guidelines. Using blind test datasets, the embryologists' accuracy prediction was 65.4% (range 47-75%) with the same ground truth provided by the original local respective assessment. Similarly, AI models had a median accuracy of 77.8% (range 68-90%) in predicting clinical pregnancy through the use of patient clinical treatment information compared to 64% (range 58-76%) when performed by embryologists. When both images/time-lapse and clinical information inputs were combined, the median accuracy by the AI models was higher at 81.5% (range 67-98%), while clinical embryologists had a median accuracy of 51% (range 43-59%).

LIMITATIONS REASONS FOR CAUTION

The findings of this review are based on studies that have not been prospectively evaluated in a clinical setting. Additionally, a fair comparison of all the studies were deemed unfeasible owing to the heterogeneity of the studies, development of the AI models, database employed and the study design and quality.

WIDER IMPLICATIONS OF THE FINDINGS

AI provides considerable promise to the IVF field and embryo selection. However, there needs to be a shift in developers' perception of the clinical outcome from successful implantation towards ongoing pregnancy or live birth. Additionally, existing models focus on locally generated databases and many lack external validation.

STUDY FUNDING/COMPETING INTERESTS

This study was funded by Monash Data Future Institute. All authors have no conflicts of interest to declare.

REGISTRATION NUMBER

CRD42021256333.

Deep learning system for classification of ploidy status using time-lapse videos

OBJECTIVE

To develop a spatiotemporal model for de prediction of euploid and aneuploid embryos using time-lapse videos from 10-115 hours after insemination (hpi).

DESIGN

Retrospective study.

MAIN OUTCOME MEASURES

The research used an end-to-end approach to develop an automated artificial intelligence system capable of extracting features from images and classifying them, considering spatiotemporal dependencies. A convolutional neural network extracted the most relevant features from each video frame. A bidirectional long short-term memory layer received this information and analyzed the temporal dependencies, obtaining a low-dimensional feature vector that characterized each video. A multilayer perceptron classified them into 2 groups, euploid and noneuploid.

RESULTS

The model performance in accuracy fell between 0.6170 and 0.7308. A multi-input model with a gate recurrent unit module performed better than others; the precision (or positive predictive value) is 0.8205 for predicting euploidy. Sensitivity, specificity, F1-Score and accuracy are 0.6957, 0.7813, 0.7042, and 0.7308, respectively.

CONCLUSIONS

This article proposes an artificial intelligence solution for prioritizing euploid embryo transfer. We can highlight the identification of a noninvasive method for chromosomal status diagnosis using a deep learning approach that analyzes raw data provided by time-lapse incubators. This method demonstrated potential automation of the evaluation process, allowing spatial and temporal information to encode.

Exploring the Intersection of Artificial Intelligence and Clinical Healthcare: A Multidisciplinary Review

Artificial intelligence (AI) plays a more and more important role in our everyday life due to the advantages that it brings when used, such as 24/7 availability, a very low percentage of errors, ability to provide real time insights, or performing a fast analysis. AI is increasingly being used in clinical medical and dental healthcare analyses, with valuable applications, which include disease diagnosis, risk assessment, treatment planning, and drug discovery. This paper presents a narrative literature review of AI use in healthcare from a multi-disciplinary perspective, specifically in the cardiology, allergology, endocrinology, and dental fields. The paper highlights data from recent research and development efforts in AI for healthcare, as well as challenges and limitations associated with AI implementation, such as data privacy and security considerations, along with ethical and legal concerns. The regulation of responsible design, development, and use of AI in healthcare is still in early stages due to the rapid evolution of the field. However, it is our duty to carefully consider the ethical implications of implementing AI and to respond appropriately. With the potential to reshape healthcare delivery and enhance patient outcomes, AI systems continue to reveal their capabilities.

An annotated human blastocyst dataset to benchmark deep learning architectures for in vitro fertilization

Medical Assisted Reproduction proved its efficacy to treat the vast majority forms of infertility. One of the key procedures in this treatment is the selection and transfer of the embryo with the highest developmental potential. To assess this potential, clinical embryologists routinely work with static images (morphological assessment) or short video sequences (time-lapse annotation). Recently, Artificial Intelligence models were utilized to support the embryo selection procedure. Even though they have proven their great potential in different in vitro fertilization settings, there is still considerable room for improvement. To support the advancement of algorithms in this research field, we built a dataset consisting of static blastocyst images and additional annotations. As such, Gardner criteria annotations, depicting a morphological blastocyst rating scheme, and collected clinical parameters are provided. The presented dataset is intended to be used to train deep learning models on static morphological images to predict Gardner's criteria and clinical outcomes such as live birth. A benchmark of human expert's performance in annotating Gardner criteria is provided.

Development and validation of deep learning based embryo selection across multiple days of transfer

This work describes the development and validation of a fully automated deep learning model, iDAScore v2.0, for the evaluation of human embryos incubated for 2, 3, and 5 or more days. We trained and evaluated the model on an extensive and diverse dataset including 181,428 embryos from 22 IVF clinics across the world. To discriminate the transferred embryos with known outcome, we show areas under the receiver operating curve ranging from 0.621 to 0.707 depending on the day of transfer. Predictive performance increased over time and showed a strong correlation with morphokinetic parameters. The model's performance is equivalent to the KIDScore D3 model on day 3 embryos while it significantly surpasses the performance of KIDScore D5 v3 on day 5+ embryos. This model provides an analysis of time-lapse sequences without the need for user input, and provides a reliable method for ranking embryos for their likelihood of implantation, at both cleavage and blastocyst stages. This greatly improves embryo grading consistency and saves time compared to traditional embryo evaluation methods.

Smartphone-based platforms implementing microfluidic detection with image-based artificial intelligence

The frequent outbreak of global infectious diseases has prompted the development of rapid and effective diagnostic tools for the early screening of potential patients in point-of-care testing scenarios. With advances in mobile computing power and microfluidic technology, the smartphone-based mobile health platform has drawn significant attention from researchers developing point-of-care testing devices that integrate microfluidic optical detection with artificial intelligence analysis. In this article, we summarize recent progress in these mobile health platforms, including the aspects of microfluidic chips, imaging modalities, supporting components, and the development of software algorithms. We document the application of mobile health platforms in terms of the detection objects, including molecules, viruses, cells, and parasites. Finally, we discuss the prospects for future development of mobile health platforms.

Quality assurance (QA) for monitoring the performance of assisted reproductive technology (ART) staff using artificial intelligence (AI)

PURPOSE

Deep learning neural networks have been used to predict the developmental fate and implantation potential of embryos with high accuracy. Such networks have been used as an assistive quality assurance (QA) tool to identify perturbations in the embryo culture environment which may impact clinical outcomes. The present study aimed to evaluate the utility of an AI-QA tool to consistently monitor ART staff performance (MD and embryologist) in embryo transfer (ET), embryo vitrification (EV), embryo warming (EW), and trophectoderm biopsy (TBx).

METHODS

Pregnancy outcomes from groups of 20 consecutive elective single day 5 blastocyst transfers were evaluated for the following procedures: MD performed ET (N = 160 transfers), embryologist performed ET (N = 160 transfers), embryologist performed EV (N = 160 vitrification procedures), embryologist performed EW (N = 160 warming procedures), and embryologist performed TBx (N = 120 biopsies). AI-generated implantation probabilities for the same embryo cohorts were estimated, as were mean AI-predicted and actual implantation rates for each provider and compared using Wilcoxon singed-rank test.

RESULTS

Actual implantation rates following ET performed by one MD provider: "H" was significantly lower than AI-predicted (20% vs. 61%, p = 0.001). Similar results were observed for one embryologist, "H" (30% vs. 60%, p = 0.011). Embryos thawed by embryologist "H" had lower implantation rates compared to AI prediction (25% vs. 60%, p = 0.004). There were no significant differences between actual and AI-predicted implantation rates for EV, TBx, or for the rest of the clinical staff performing ET or EW.

CONCLUSIONS

AI-based QA tools could provide accurate, reproducible, and efficient staff performance monitoring in an ART practice.

Does embryo categorization by existing artificial intelligence, morphokinetic or morphological embryo selection models correlate with blastocyst euploidy rates?

RESEARCH QUESTION

Does embryo categorization by existing artificial intelligence (AI), morphokinetic or morphological embryo selection models correlate with blastocyst euploidy?

DESIGN

A total of 834 patients (mean maternal age 40.5 ± 3.4 years) who underwent preimplantation genetic testing for aneuploidies (PGT-A) on a total of 3573 tested blastocysts were included in this retrospective study. The cycles were stratified into five maternal age groups according to the Society for Assisted Reproductive Technology age groups (<35, 35-37, 38-40, 41-42 and >42 years). The main outcome of this study was the correlation of euploidy rates in stratified maternal age groups and an automated AI model (iDAScore® v1.0), a morphokinetic embryo selection model (KIDScore Day 5 ver 3, KS-D5) and a traditional morphological grading model (Gardner criteria), respectively.

RESULTS

Euploidy rates were significantly correlated with iDAScore (P = 0.0035 to <0.001) in all age groups, and expect for the youngest age group, with KS-D5 and Gardner criteria (all P < 0.0001). Additionally, multivariate logistic regression analysis showed that for all models, higher scores were significantly correlated with euploidy (all P < 0.0001).

CONCLUSION

These results show that existing blastocyst scoring models correlate with ploidy status. However, as these models were developed to indicate implantation potential, they cannot accurately diagnose if an embryo is euploid or aneuploid. Instead, they may be used to support the decision of how many and which blastocysts to biopsy, thus potentially reducing patient costs.

The use of voting ensembles to improve the accuracy of deep neural networks as a non-invasive method to predict embryo ploidy status

PURPOSE

To determine if creating voting ensembles combining convolutional neural networks (CNN), support vector machine (SVM), and multi-layer neural networks (NN) alongside clinical parameters improves the accuracy of artificial intelligence (AI) as a non-invasive method for predicting aneuploidy.

METHODS

A cohort of 699 day 5 PGT-A tested blastocysts was used to train, validate, and test a CNN to classify embryos as euploid/aneuploid. All embryos were analyzed using a modified FAST-SeqS next-generation sequencing method. Patient characteristics such as maternal age, AMH level, paternal sperm quality, and total number of normally fertilized (2PN) embryos were processed using SVM and NN. To improve model performance, we created voting ensembles using CNN, SVM, and NN to combine our imaging data with clinical parameter variations. Statistical significance was evaluated with a one-sample t-test with 2 degrees of freedom.

RESULTS

When assessing blastocyst images alone, the CNN test accuracy was 61.2% (± 1.32% SEM, n = 3 models) in correctly classifying euploid/aneuploid embryos (n = 140 embryos). When the best CNN model was assessed as a voting ensemble, the test accuracy improved to 65.0% (AMH; p = 0.1), 66.4% (maternal age; p = 0.06), 65.7% (maternal age, AMH; p = 0.08), 66.4% (maternal age, AMH, number of 2PNs; p = 0.06), and 71.4% (maternal age, AMH, number of 2PNs, sperm quality; p = 0.02) (n = 140 embryos).

CONCLUSIONS

By combining CNNs with patient characteristics, voting ensembles can be created to improve the accuracy of classifying embryos as euploid/aneuploid from CNN alone, allowing for AI to serve as a potential non-invasive method to aid in karyotype screening and selection of embryos.

A non-invasive artificial intelligence approach for the prediction of human blastocyst ploidy: a retrospective model development and validation study

BACKGROUND

One challenge in the field of in-vitro fertilisation is the selection of the most viable embryos for transfer. Morphological quality assessment and morphokinetic analysis both have the disadvantage of intra-observer and inter-observer variability. A third method, preimplantation genetic testing for aneuploidy (PGT-A), has limitations too, including its invasiveness and cost. We hypothesised that differences in aneuploid and euploid embryos that allow for model-based classification are reflected in morphology, morphokinetics, and associated clinical information.

METHODS

In this retrospective study, we used machine-learning and deep-learning approaches to develop STORK-A, a non-invasive and automated method of embryo evaluation that uses artificial intelligence to predict embryo ploidy status. Our method used a dataset of 10 378 embryos that consisted of static images captured at 110 h after intracytoplasmic sperm injection, morphokinetic parameters, blastocyst morphological assessments, maternal age, and ploidy status. Independent and external datasets, Weill Cornell Medicine EmbryoScope+ (WCM-ES+; Weill Cornell Medicine Center of Reproductive Medicine, NY, USA) and IVI Valencia (IVI Valencia, Health Research Institute la Fe, Valencia, Spain) were used to test the generalisability of STORK-A and were compared measuring accuracy and area under the receiver operating characteristic curve (AUC).

FINDINGS

Analysis and model development included the use of 10 378 embryos, all with PGT-A results, from 1385 patients (maternal age range 21-48 years; mean age 36·98 years [SD 4·62]). STORK-A predicted aneuploid versus euploid embryos with an accuracy of 69·3% (95% CI 66·9-71·5; AUC 0·761; positive predictive value [PPV] 76·1%; negative predictive value [NPV] 62·1%) when using images, maternal age, morphokinetics, and blastocyst score. A second classification task trained to predict complex aneuploidy versus euploidy and single aneuploidy produced an accuracy of 74·0% (95% CI 71·7-76·1; AUC 0·760; PPV 54·9%; NPV 87·6%) using an image, maternal age, morphokinetic parameters, and blastocyst grade. A third classification task trained to predict complex aneuploidy versus euploidy had an accuracy of 77·6% (95% CI 75·0-80·0; AUC 0·847; PPV 76·7%; NPV 78·0%). STORK-A reported accuracies of 63·4% (AUC 0·702) on the WCM-ES+ dataset and 65·7% (AUC 0·715) on the IVI Valencia dataset, when using an image, maternal age, and morphokinetic parameters, similar to the STORK-A test dataset accuracy of 67·8% (AUC 0·737), showing generalisability.

INTERPRETATION

As a proof of concept, STORK-A shows an ability to predict embryo ploidy in a non-invasive manner and shows future potential as a standardised supplementation to traditional methods of embryo selection and prioritisation for implantation or recommendation for PGT-A.

FUNDING

US National Institutes of Health.

Using artificial intelligence to avoid human error in identifying embryos: a retrospective cohort study

PURPOSE

To determine whether convolutional neural networks (CNN) can be used to accurately ascertain the patient identity (ID) of cleavage and blastocyst stage embryos based on image data alone.

METHODS

A CNN model was trained and validated over three replicates on a retrospective cohort of 4889 time-lapse embryo images. The algorithm processed embryo images for each patient and produced a unique identification key that was associated with the patient ID at a timepoint on day 3 (~ 65 hours post-insemination (hpi)) and day 5 (~ 105 hpi) forming our data library. When the algorithm evaluated embryos at a later timepoint on day 3 (~ 70 hpi) and day 5 (~ 110 hpi), it generates another key that was matched with the patient's unique key available in the library. This approach was tested using 400 patient embryo cohorts on day 3 and day 5 and number of correct embryo identifications with the CNN algorithm was measured.

RESULTS

CNN technology matched the patient identification within random pools of 8 patient embryo cohorts on day 3 with 100% accuracy (n = 400 patients; 3 replicates). For day 5 embryo cohorts, the accuracy within random pools of 8 patients was 100% (n = 400 patients; 3 replicates).

CONCLUSIONS

This study describes an artificial intelligence-based approach for embryo identification. This technology offers a robust witnessing step based on unique morphological features of each embryo. This technology can be integrated with existing imaging systems and laboratory protocols to improve specimen tracking.

Embryologist agreement when assessing blastocyst implantation probability: is data-driven prediction the solution to embryo assessment subjectivity?

STUDY QUESTION

What is the accuracy and agreement of embryologists when assessing the implantation probability of blastocysts using time-lapse imaging (TLI), and can it be improved with a data-driven algorithm?

SUMMARY ANSWER

The overall interobserver agreement of a large panel of embryologists was moderate and prediction accuracy was modest, while the purpose-built artificial intelligence model generally resulted in higher performance metrics.

WHAT IS KNOWN ALREADY

Previous studies have demonstrated significant interobserver variability amongst embryologists when assessing embryo quality. However, data concerning embryologists' ability to predict implantation probability using TLI is still lacking. Emerging technologies based on data-driven tools have shown great promise for improving embryo selection and predicting clinical outcomes.

STUDY DESIGN, SIZE, DURATION

TLI video files of 136 embryos with known implantation data were retrospectively collected from two clinical sites between 2018 and 2019 for the performance assessment of 36 embryologists and comparison with a deep neural network (DNN).

PARTICIPANTS/MATERIALS, SETTING, METHODS

We recruited 39 embryologists from 13 different countries. All participants were blinded to clinical outcomes. A total of 136 TLI videos of embryos that reached the blastocyst stage were used for this experiment. Each embryo's likelihood of successfully implanting was assessed by 36 embryologists, providing implantation probability grades (IPGs) from 1 to 5, where 1 indicates a very low likelihood of implantation and 5 indicates a very high likelihood. Subsequently, three embryologists with over 5 years of experience provided Gardner scores. All 136 blastocysts were categorized into three quality groups based on their Gardner scores. Embryologist predictions were then converted into predictions of implantation (IPG ≥ 3) and no implantation (IPG ≤ 2). Embryologists' performance and agreement were assessed using Fleiss kappa coefficient. A 10-fold cross-validation DNN was developed to provide IPGs for TLI video files. The model's performance was compared to that of the embryologists.

MAIN RESULTS AND THE ROLE OF CHANCE

Logistic regression was employed for the following confounding variables: country of residence, academic level, embryo scoring system, log years of experience and experience using TLI. None were found to have a statistically significant impact on embryologist performance at α = 0.05. The average implantation prediction accuracy for the embryologists was 51.9% for all embryos (N = 136). The average accuracy of the embryologists when assessing top quality and poor quality embryos (according to the Gardner score categorizations) was 57.5% and 57.4%, respectively, and 44.6% for fair quality embryos. Overall interobserver agreement was moderate (κ = 0.56, N = 136). The best agreement was achieved in the poor + top quality group (κ = 0.65, N = 77), while the agreement in the fair quality group was lower (κ = 0.25, N = 59). The DNN showed an overall accuracy rate of 62.5%, with accuracies of 62.2%, 61% and 65.6% for the poor, fair and top quality groups, respectively. The AUC for the DNN was higher than that of the embryologists overall (0.70 DNN vs 0.61 embryologists) as well as in all of the Gardner groups (DNN vs embryologists-Poor: 0.69 vs 0.62; Fair: 0.67 vs 0.53; Top: 0.77 vs 0.54).

LIMITATIONS, REASONS FOR CAUTION

Blastocyst assessment was performed using video files acquired from time-lapse incubators, where each video contained data from a single focal plane. Clinical data regarding the underlying cause of infertility and endometrial thickness before the transfer was not available, yet may explain implantation failure and lower accuracy of IPGs. Implantation was defined as the presence of a gestational sac, whereas the detection of fetal heartbeat is a more robust marker of embryo viability. The raw data were anonymized to the extent that it was not possible to quantify the number of unique patients and cycles included in the study, potentially masking the effect of bias from a limited patient pool. Furthermore, the lack of demographic data makes it difficult to draw conclusions on how representative the dataset was of the wider population. Finally, embryologists were required to assess the implantation potential, not embryo quality. Although this is not the traditional approach to embryo evaluation, morphology/morphokinetics as a means of assessing embryo quality is believed to be strongly correlated with viability and, for some methods, implantation potential.

WIDER IMPLICATIONS OF THE FINDINGS

Embryo selection is a key element in IVF success and continues to be a challenge. Improving the predictive ability could assist in optimizing implantation success rates and other clinical outcomes and could minimize the financial and emotional burden on the patient. This study demonstrates moderate agreement rates between embryologists, likely due to the subjective nature of embryo assessment. In particular, we found that average embryologist accuracy and agreement were significantly lower for fair quality embryos when compared with that for top and poor quality embryos. Using data-driven algorithms as an assistive tool may help IVF professionals increase success rates and promote much needed standardization in the IVF clinic. Our results indicate a need for further research regarding technological advancement in this field.

STUDY FUNDING/COMPETING INTEREST(S)

Embryonics Ltd is an Israel-based company. Funding for the study was partially provided by the Israeli Innovation Authority, grant #74556.

TRIAL REGISTRATION NUMBER

N/A.

Correlation between an annotation-free embryo scoring system based on deep learning and live birth/neonatal outcomes after single vitrified-warmed blastocyst transfer: a single-centre, large-cohort retrospective study

Propose

Does an annotation-free embryo scoring system based on deep learning and time-lapse sequence images correlate with live birth (LB) and neonatal outcomes?

Methods

Patients who underwent SVBT cycles (3010 cycles, mean age: 39.3 ± 4.0). Scores were calculated using the iDAScore software module in the Vitrolife Technology Hub (Vitrolife, Gothenburg, Sweden). The correlation between iDAScore, LB rates, and total miscarriage (TM), including 1st- and 2nd-trimester miscarriage, was analysed using a trend test and multivariable logistic regression analysis. Furthermore, the correlation between the iDAScore and neonatal outcomes was analysed.

Results

LB rates decreased as iDAScore decreased (P < 0.05), and a similar inverse trend was observed for the TM rates. Additionally, multivariate logistic regression analysis showed that iDAScore significantly correlated with increased LB (adjusted odds ratio: 1.811, 95% CI: 1.666–1.976, P < 0.05) and decreased TM (adjusted odds ratio: 0.799, 95% CI: 0.706–0.905, P < 0.05). There was no significant correlation between iDAScore and neonatal outcomes, including congenital malformations, sex, gestational age, and birth weight. Multivariate logistic regression analysis, which included maternal and paternal age, maternal body mass index, parity, smoking, and presence or absence of caesarean section as confounding factors, revealed no significant difference in any neonatal characteristics.

Conclusion

Automatic embryo scoring using iDAScore correlates with decreased miscarriage and increased LB and has no correlation with neonatal outcomes.

Supplementary information

The online version contains supplementary material available at 10.1007/s10815-022-02562-5.

Unique Deep Radiomic Signature Shows NMN Treatment Reverses Morphology of Oocytes from Aged Mice

The purpose of this study is to develop a deep radiomic signature based on an artificial intelligence (AI) model. This radiomic signature identifies oocyte morphological changes corresponding to reproductive aging in bright field images captured by optical light microscopy. Oocytes were collected from three mice groups: young (4- to 5-week-old) C57BL/6J female mice, aged (12-month-old) mice, and aged mice treated with the NAD+ precursor nicotinamide mononucleotide (NMN), a treatment recently shown to rejuvenate aspects of fertility in aged mice. We applied deep learning, swarm intelligence, and discriminative analysis to images of mouse oocytes taken by bright field microscopy to identify a highly informative deep radiomic signature (DRS) of oocyte morphology. Predictive DRS accuracy was determined by evaluating sensitivity, specificity, and cross-validation, and was visualized using scatter plots of the data associated with three groups: Young, old and Old + NMN. DRS could successfully distinguish morphological changes in oocytes associated with maternal age with 92% accuracy (AUC~1), reflecting this decline in oocyte quality. We then employed the DRS to evaluate the impact of the treatment of reproductively aged mice with NMN. The DRS signature classified 60% of oocytes from NMN-treated aged mice as having a ‘young’ morphology. In conclusion, the DRS signature developed in this study was successfully able to detect aging-related oocyte morphological changes. The significance of our approach is that DRS applied to bright field oocyte images will allow us to distinguish and select oocytes originally affected by reproductive aging and whose quality has been successfully restored by the NMN therapy.

Automatic characterization of human embryos at day 4 post-insemination from time-lapse imaging using supervised contrastive learning and inductive transfer learning techniques

BACKGROUND

Embryo morphology is a predictive marker for implantation success and ultimately live births. Viability evaluation and quality grading are commonly used to select the embryo with the highest implantation potential. However, the traditional method of manual embryo assessment is time-consuming and highly susceptible to inter- and intra-observer variability. Automation of this process results in more objective and accurate predictions.

METHOD

In this paper, we propose a novel methodology based on deep learning to automatically evaluate the morphological appearance of human embryos from time-lapse imaging. A supervised contrastive learning framework is implemented to predict embryo viability at day 4 and day 5, and an inductive transfer approach is applied to classify embryo quality at both times.

RESULTS

Results showed that both methods outperformed conventional approaches and improved state-of-the-art embryology results for an independent test set. The viability result achieved an accuracy of 0.8103 and 0.9330 and the quality results reached values of 0.7500 and 0.8001 for day 4 and day 5, respectively. Furthermore, qualitative results kept consistency with the clinical interpretation.

CONCLUSIONS

The proposed methods are up to date with the artificial intelligence literature and have been proven to be promising. Furthermore, our findings represent a breakthrough in the field of embryology in that they study the possibilities of embryo selection at day 4. Moreover, the grad-CAMs findings are directly in line with embryologists' decisions. Finally, our results demonstrated excellent potential for the inclusion of the models in clinical practice.

Lab on a chip devices for fertility: from proof-of-concept to clinical impact

Microfluidics offers tremendous opportunities to understand the underlying biology of fertilization at the single-cell level and improve infertility management, however, its true clinical impact is yet to be realized. Lab-on-a-chip devices have generally failed to diffuse into clinical practice due to issues associated with their translation or their practicality and performance in clinical settings. In this perspective, I reflect on how the full potential of microfluidic technologies for fertility can be realized by considering regulatory and manufacturing considerations at the development stage and by redefining our developmental goals to directly target the ultimate clinical needs. I also challenge the common rationale around developing technologies for infertility treatment based on reducing cost and complexity in operation as the ultimate outcome is invaluable, human life.

Reporting on the Value of Artificial Intelligence in Predicting the Optimal Embryo for Transfer: A Systematic Review including Data Synthesis

Artificial intelligence (AI) has been gaining support in the field of in vitro fertilization (IVF). Despite the promising existing data, AI cannot yet claim gold-standard status, which serves as the rationale for this study. This systematic review and data synthesis aims to evaluate and report on the predictive capabilities of AI-based prediction models regarding IVF outcome. The study has been registered in PROSPERO (CRD42021242097). Following a systematic search of the literature in Pubmed/Medline, Embase, and Cochrane Central Library, 18 studies were identified as eligible for inclusion. Regarding live-birth, the Area Under the Curve (AUC) of the Summary Receiver Operating Characteristics (SROC) was 0.905, while the partial AUC (pAUC) was 0.755. The Observed: Expected ratio was 1.12 (95%CI: 0.26–2.37; 95%PI: 0.02–6.54). Regarding clinical pregnancy with fetal heartbeat, the AUC of the SROC was 0.722, while the pAUC was 0.774. The O:E ratio was 0.77 (95%CI: 0.54–1.05; 95%PI: 0.21–1.62). According to this data synthesis, the majority of the AI-based prediction models are successful in accurately predicting the IVF outcome regarding live birth, clinical pregnancy, clinical pregnancy with fetal heartbeat, and ploidy status. This review attempted to compare between AI and human prediction capabilities, and although studies do not allow for a meta-analysis, this systematic review indicates that the AI-based prediction models perform rather similarly to the embryologists’ evaluations. While AI models appear marginally more effective, they still have some way to go before they can claim to significantly surpass the clinical embryologists’ predictive competence.

In vitro investigation of mammalian peri-implantation embryogenesis†

The embryos attach and invade into the uterus and establish the connection with their mother in peri-implantation development. During this period, the pluripotent epiblast cells of embryo undergo symmetry breaking, cell lineage allocation, and morphogenetic remodeling, accompanying with the dramatic changes of transcriptome, epigenome, and signal pathways, to prepare a state for their differentiation and gastrulation. The progresses in mouse genetics and stem cell biology have largely advanced the knowledge of these transformations which are largely hindered by the hard accessibility of natural embryos. To gain insight into mammalian peri-implantation development, great efforts have been made in the field. Recently, the advances in the prolonged in vitro culture of blastocysts, the derivation of multiple pluripotent stem cells, as well as the construction of stem cell-based embryo-like models have opened novel avenues to investigate peri-implantation development in mammals, especially for the humans. Combining with other emerging new technologies, these new models will substantially promote the comprehension of mammalian peri-implantation development, accelerating the progress of reproductive and regenerative medicine.

Stain-free detection of embryo polarization using deep learning

Polarization of the mammalian embryo at the right developmental time is critical for its development to term and would be valuable in assessing the potential of human embryos. However, tracking polarization requires invasive fluorescence staining, impermissible in the in vitro fertilization clinic. Here, we report the use of artificial intelligence to detect polarization from unstained time-lapse movies of mouse embryos. We assembled a dataset of bright-field movie frames from 8-cell-stage embryos, side-by-side with corresponding images of fluorescent markers of cell polarization. We then used an ensemble learning model to detect whether any bright-field frame showed an embryo before or after onset of polarization. Our resulting model has an accuracy of 85% for detecting polarization, significantly outperforming human volunteers trained on the same data (61% accuracy). We discovered that our self-learning model focuses upon the angle between cells as one known cue for compaction, which precedes polarization, but it outperforms the use of this cue alone. By compressing three-dimensional time-lapsed image data into two-dimensions, we are able to reduce data to an easily manageable size for deep learning processing. In conclusion, we describe a method for detecting a key developmental feature of embryo development that avoids clinically impermissible fluorescence staining.

Characterization of an artificial intelligence model for ranking static images of blastocyst stage embryos

OBJECTIVE

To perform a series of analyses characterizing an artificial intelligence (AI) model for ranking blastocyst-stage embryos. The primary objective was to evaluate the benefit of the model for predicting clinical pregnancy, whereas the secondary objective was to identify limitations that may impact clinical use.

DESIGN

Retrospective study.

SETTING

Consortium of 11 assisted reproductive technology centers in the United States.

PATIENT(S)

Static images of 5,923 transferred blastocysts and 2,614 nontransferred aneuploid blastocysts.

INTERVENTION(S)

None.

MAIN OUTCOME MEASURE(S)

Prediction of clinical pregnancy (fetal heartbeat).

RESULT(S)

The area under the curve of the AI model ranged from 0.6 to 0.7 and outperformed manual morphology grading overall and on a per-site basis. A bootstrapped study predicted improved pregnancy rates between +5% and +12% per site using AI compared with manual grading using an inverted microscope. One site that used a low-magnification stereo zoom microscope did not show predicted improvement with the AI. Visualization techniques and attribution algorithms revealed that the features learned by the AI model largely overlap with the features of manual grading systems. Two sources of bias relating to the type of microscope and presence of embryo holding micropipettes were identified and mitigated. The analysis of AI scores in relation to pregnancy rates showed that score differences of ≥0.1 (10%) correspond with improved pregnancy rates, whereas score differences of <0.1 may not be clinically meaningful.

CONCLUSION(S)

This study demonstrates the potential of AI for ranking blastocyst stage embryos and highlights potential limitations related to image quality, bias, and granularity of scores.

Live-Birth Prediction of Natural-Cycle In Vitro Fertilization Using 57,558 Linked Cycle Records: A Machine Learning Perspective

BACKGROUND

Natural-cycle in vitro fertilization (NC-IVF) is an in vitro fertilization (IVF) cycle without gonadotropins or any other stimulation of follicular growth. Previous studies on live-birth prediction of NC-IVF were very few; the sample size was very limited. This study aims to construct a machine learning model to predict live-birth occurrence of NC-IVF using 57,558 linked cycle records and help clinicians develop treatment strategies.

DESIGN AND METHODS

The dataset contained 57,558 anonymized register patient records undergoing NC-IVF cycles from 2005 to 2016 filtered from 7bsp;60,732 records in the Human Fertilisation and Embryology Authority (HFEA) data. We selected matching records and features through data filtering and feature selection methods. Two groups of twelve machine learning models were trained and tested. Eight metrics, e.g., F1 score, Matthews correlation coefficient (MCC), the area under the receiver operating characteristic curve (AUC), etc., were computed to evaluate the performance of each model.

RESULTS

Two groups of twelve models were trained and tested. The artificial neural network (ANN) model performed the best in the machine learning group (F1 score, 70.87%; MCC, 50.37%; and AUC score, 0.7939). The LogitBoost model obtained the best scores in the ensemble learning group (F1 score, 70.57%; MCC, 50.75%; and AUC score, 0.7907). After the comparison between the two models, the LogitBoost model was recognized as an optimal one.

CONCLUSION

In this study, NC-IVF-related datasets were extracted from the HFEA data, and a machine learning-based prediction model was successfully constructed through this largest NC-IVF dataset currently. This model is universal and stable, which can help clinicians predict the live-birth success rate of NC-IVF in advance before developing IVF treatment strategies and then choose the best benefit treatment strategy according to the patients' wishes. As "use less stimulation and back to natural condition" becomes more and more popular, this model is more meaningful in the decision-making assistance system for IVF.