Interobserver agreement and intraobserver reproducibility of embryo quality assessments

Prediction of embryo euploidy and pregnancy outcome by blastocyst morphology and development speed for women receiving single embryo transfer

BACKGROUND

Selection of high-quality blastocysts is the most important factor determining the success of assisted reproductive technology. The objective of this study is to assess the values of blastocyst morphological quality and development speed for predicting euploidy and clinical pregnancy outcome.

METHODS

A total of 155 preimplantation genetic testing cycles including 959 blastocysts and 154 euploid blastocyst transfer cycles conducted between January 2018 and December 2019 were retrospectively analysed. The associations of blastocyst morphological quality and development speed (D) with chromosomal status, clinical pregnancy rate, early miscarriage rate, and ongoing pregnancy rate were evaluated by univariate and multivariate regression.

RESULTS

The euploidy rate of development speed D5 blastocysts was significantly greater than that of D6 blastocysts (61.4% vs. 38.1%, P < 0.001), and the euploid rate of morphologically high-grade blastocysts was significantly greater than that of non-high-grade blastocysts. Development speed D5 (OR = 1.6, 95% CI 1.2-2.2, P = 0.02) and high-grade morphology (OR = 2.1, 95% CI 1.5-2.9, P = 0.01) were independent predictors of euploidy. The ongoing pregnancy rate of D5 blastocysts was significantly higher than that of D6 blastocysts (62.3% vs. 43.8%, P = 0.04). Transfer of euploid blastocysts with high-grade morphology resulted in a greater ongoing pregnancy rate than transfer of non-high-grade euploid blastocysts (60.7% vs. 43.2%, P = 0.049). Alternatively, D6 development speed was an independent risk factor for early pregnancy loss after euploid blastocyst transfer. Multivariate regression analysis adjusting for confounding factors identified maternal age, blastocyst development speed, and blastocyst morphological grade as independent predictors of euploidy but not of clinical pregnancy.

CONCLUSION

The recommended sequence of embryo transfer based on the present study is D5 high-grade > D6 high-grade > D5 non-high-grade > D6 non-high-grade.

A comparison of morphokinetic models and morphological selection for prioritizing euploid embryos: a multicentre cohort study

STUDY QUESTION

Are morphokinetic models better at prioritizing a euploid embryo for transfer over morphological selection by an embryologist?

SUMMARY ANSWER

Morphokinetic algorithms lead to an improved prioritization of euploid embryos when compared to embryologist selection.

WHAT IS KNOWN ALREADY

PREFER (predicting euploidy for embryos in reproductive medicine) is a previously published morphokinetic model associated with live birth and miscarriage. The second model uses live birth as the target outcome (LB model).

STUDY DESIGN, SIZE, DURATION

Data for this cohort study were obtained from 1958 biopsied blastocysts at nine IVF clinics across the UK from January 2021 to December 2022.

PARTICIPANTS/MATERIALS, SETTING, METHODS

The ability of the PREFER and LB models to prioritize a euploid embryo was compared against arbitrary selection and the prediction of four embryologists using the timelapse video, blinded to the morphokinetic time stamp. The comparisons were made using calculated percentages and normalized discounted cumulative gain (NDCG), whereby an NDCG score of 1 would equate to all euploid embryos being ranked first. In arbitrary selection, the ploidy status was randomly assigned within each cycle and the NDGC calculated, and this was then repeated 100 times and the mean obtained.

MAIN RESULTS AND THE ROLE OF CHANCE

Arbitrary embryo selection would rank a euploid embryo first 37% of the time, embryologist selection 39%, and the LB and PREFER ploidy morphokinetic models 46% and 47% of the time, respectively. The AUC for LB and PREFER model was 0.62 and 0.63, respectively. Morphological selection did not significantly improve the performance of both morphokinetic models when used in combination. There was a significant difference between the NDGC metric of the PREFER model versus embryologist selection at 0.96 and 0.87, respectively (t = 14.1, P < 0.001). Similarly, there was a significant difference between the LB model and embryologist selection with an NDGC metric of 0.95 and 0.87, respectively (t = 12.0, P < 0.001). All four embryologists ranked embryos similarly, with an intraclass coefficient of 0.91 (95% CI 0.82-0.95, P < 0.001).

LIMITATIONS, REASONS FOR CAUTION

Aside from the retrospective study design, limitations include allowing the embryologist to watch the time lapse video, potentially providing more information than a truly static morphological assessment. Furthermore, the embryologists at the participating centres were familiar with the significant variables in time lapse, which could bias the results.

WIDER IMPLICATIONS OF THE FINDINGS

The present study shows that the use of morphokinetic models, namely PREFER and LB, translates into improved euploid embryo selection.

STUDY FUNDING/COMPETING INTEREST(S)

This study received no specific grant funding from any funding agency in the public, commercial or not-for-profit sectors. Dr Alison Campbell is minor share holder of Care Fertility. All other authors have no conflicts of interest to declare. Time lapse is a technology for which patients are charged extra at participating centres.

TRIAL REGISTRATION NUMBER

N/A.

Effect of chromosomal polymorphisms on the outcome of in vitro fertilization and embryo transfer

PURPOSE

The incidence of chromosomal polymorphisms (CP) is increased in infertile couples, but its impact on reproduction is uncertain, especially undergoing assisted reproductive technology treatment. The purpose of the present study was to investigate the effect of CP on the outcomes of in vitro fertilization/intracytoplasmic sperm injection-embryo transfer (IVF/ICSI-ET) treatment METHODS: A total of 1331 infertile couples undergoing IVF/ICSI treatment were involved in this retrospective case-control study. The participants were divided into 4 groups according to CP variations: (i) normal chromosomes (NC) group; (ii) CP group; (iii) both chromosomal polymorphisms (BCP) group; and (iv) double chromosomal polymorphisms (DCP) group. The CP group was further divided into five subgroups: qh+, D/G, inv(9), Yqh+ and Yqh-. The outcomes of IVF/ICSI-ET treatment were compared among the groups.

RESULTS

There were no differences observed between the eight groups in terms of number of oocytes retrieved, MII rate, fertilization rate, cleaved embryo rate, and quality embryo rate for both females and males (p > 0.05). In both male and female, some of the CP subgroups experienced more oocyte retrieval operations and more embryo transfer operations to achieve pregnancy than the NC groups (p < 0.05). The rates of live births were significantly lower in some of the CP subgroups compared to the NC group (p < 0.05).

CONCLUSION

In conclusion, the pregnancy outcomes of ET were affected by CP. It was speculated that this may be associated with the effect of chromosome polymorphism on embryo quality, although this could not be observed or determined by morphological evaluation.

Embryologist agreement when assessing blastocyst implantation probability: is data-driven prediction the solution to embryo assessment subjectivity?

STUDY QUESTION

What is the accuracy and agreement of embryologists when assessing the implantation probability of blastocysts using time-lapse imaging (TLI), and can it be improved with a data-driven algorithm?

SUMMARY ANSWER

The overall interobserver agreement of a large panel of embryologists was moderate and prediction accuracy was modest, while the purpose-built artificial intelligence model generally resulted in higher performance metrics.

WHAT IS KNOWN ALREADY

Previous studies have demonstrated significant interobserver variability amongst embryologists when assessing embryo quality. However, data concerning embryologists' ability to predict implantation probability using TLI is still lacking. Emerging technologies based on data-driven tools have shown great promise for improving embryo selection and predicting clinical outcomes.

STUDY DESIGN, SIZE, DURATION

TLI video files of 136 embryos with known implantation data were retrospectively collected from two clinical sites between 2018 and 2019 for the performance assessment of 36 embryologists and comparison with a deep neural network (DNN).

PARTICIPANTS/MATERIALS, SETTING, METHODS

We recruited 39 embryologists from 13 different countries. All participants were blinded to clinical outcomes. A total of 136 TLI videos of embryos that reached the blastocyst stage were used for this experiment. Each embryo's likelihood of successfully implanting was assessed by 36 embryologists, providing implantation probability grades (IPGs) from 1 to 5, where 1 indicates a very low likelihood of implantation and 5 indicates a very high likelihood. Subsequently, three embryologists with over 5 years of experience provided Gardner scores. All 136 blastocysts were categorized into three quality groups based on their Gardner scores. Embryologist predictions were then converted into predictions of implantation (IPG ≥ 3) and no implantation (IPG ≤ 2). Embryologists' performance and agreement were assessed using Fleiss kappa coefficient. A 10-fold cross-validation DNN was developed to provide IPGs for TLI video files. The model's performance was compared to that of the embryologists.

MAIN RESULTS AND THE ROLE OF CHANCE

Logistic regression was employed for the following confounding variables: country of residence, academic level, embryo scoring system, log years of experience and experience using TLI. None were found to have a statistically significant impact on embryologist performance at α = 0.05. The average implantation prediction accuracy for the embryologists was 51.9% for all embryos (N = 136). The average accuracy of the embryologists when assessing top quality and poor quality embryos (according to the Gardner score categorizations) was 57.5% and 57.4%, respectively, and 44.6% for fair quality embryos. Overall interobserver agreement was moderate (κ = 0.56, N = 136). The best agreement was achieved in the poor + top quality group (κ = 0.65, N = 77), while the agreement in the fair quality group was lower (κ = 0.25, N = 59). The DNN showed an overall accuracy rate of 62.5%, with accuracies of 62.2%, 61% and 65.6% for the poor, fair and top quality groups, respectively. The AUC for the DNN was higher than that of the embryologists overall (0.70 DNN vs 0.61 embryologists) as well as in all of the Gardner groups (DNN vs embryologists-Poor: 0.69 vs 0.62; Fair: 0.67 vs 0.53; Top: 0.77 vs 0.54).

LIMITATIONS, REASONS FOR CAUTION

Blastocyst assessment was performed using video files acquired from time-lapse incubators, where each video contained data from a single focal plane. Clinical data regarding the underlying cause of infertility and endometrial thickness before the transfer was not available, yet may explain implantation failure and lower accuracy of IPGs. Implantation was defined as the presence of a gestational sac, whereas the detection of fetal heartbeat is a more robust marker of embryo viability. The raw data were anonymized to the extent that it was not possible to quantify the number of unique patients and cycles included in the study, potentially masking the effect of bias from a limited patient pool. Furthermore, the lack of demographic data makes it difficult to draw conclusions on how representative the dataset was of the wider population. Finally, embryologists were required to assess the implantation potential, not embryo quality. Although this is not the traditional approach to embryo evaluation, morphology/morphokinetics as a means of assessing embryo quality is believed to be strongly correlated with viability and, for some methods, implantation potential.

WIDER IMPLICATIONS OF THE FINDINGS

Embryo selection is a key element in IVF success and continues to be a challenge. Improving the predictive ability could assist in optimizing implantation success rates and other clinical outcomes and could minimize the financial and emotional burden on the patient. This study demonstrates moderate agreement rates between embryologists, likely due to the subjective nature of embryo assessment. In particular, we found that average embryologist accuracy and agreement were significantly lower for fair quality embryos when compared with that for top and poor quality embryos. Using data-driven algorithms as an assistive tool may help IVF professionals increase success rates and promote much needed standardization in the IVF clinic. Our results indicate a need for further research regarding technological advancement in this field.

STUDY FUNDING/COMPETING INTEREST(S)

Embryonics Ltd is an Israel-based company. Funding for the study was partially provided by the Israeli Innovation Authority, grant #74556.

TRIAL REGISTRATION NUMBER

N/A.

RNA-Seq Reveals the Underlying Molecular Mechanism of First Cleavage Time Affecting Porcine Embryo Development

The selection and evaluation of high-quality embryos are the key factors affecting in vitro embryo development and pregnancy outcome. The timing of first embryonic cleavage has been considered a positive indicator of the in vitro developmental potential of embryos, while the underlying molecular mechanism is still not fully understood. In this study, the embryos generated by parthenogenetic activation (PA) or in vitro fertilization (IVF) were monitored and recorded every 2 h and divided into two groups (early cleavage or late cleavage) based on the cleavage rate and blastocyst formation data. RNA sequencing was used to analyze the gene expression pattern of the embryos. We identified 667 and 71 different expression genes (DEGs) in early cleavage and late cleavage porcine PA and IVF embryos, respectively. Further Gene Ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) analyses showed that the DEGs are mainly enriched in pathways concerning the proteasome, DNA repair, cell cycle arrest, autophagy, and apoptosis, suggesting that severe endoplasmic reticulum stress (ERS) and DNA damage may be the key factors that led to the low development potential of late cleavage embryos. This study provides a theoretical basis for the following application and offers important information about the understanding of the timely manner of porcine embryo development.

OUP accepted manuscript

STUDY QUESTION

Can use of a commercially available time-lapse algorithm for Day 5 blastocyst selection improve pregnancy rates compared with morphology alone?

SUMMARY ANSWER

The use of a time-lapse selection model to choose blastocysts for fresh single embryo transfer on Day 5 did not improve ongoing pregnancy rate compared to morphology alone.

WHAT IS KNOWN ALREADY

Evidence from time-lapse monitoring suggests correlations between timing of key developmental events and embryo viability. No good quality evidence exists to support improved pregnancy rates following time-lapse selection.

STUDY DESIGN, SIZE, DURATION

A prospective multicenter randomized controlled trial including 776 randomized patients was performed between 2018 and 2021. Patients with at least two good quality blastocysts on Day 5 were allocated by a computer randomization program in a proportion of 1:1 into either the control group, whereby single blastocysts were selected for transfer by morphology alone, or the intervention group whereby final selection was decided by a commercially available time-lapse model. The embryologists at the time of blastocyst morphological scoring were blinded to which study group the patients would be randomized, and the physician and patients were blind to which group they were allocated until after the primary outcome was known. The primary outcome was number of ongoing pregnancies in the two groups.

PARTICIPANTS/MATERIALS, SETTING, METHODS

From 10 Nordic IVF clinics, 776 patients with a minimum of two good quality blastocysts on Day 5 (D5) were randomized into one of the two study groups. A commercial time-lapse model decided the final selection of blastocysts for 387 patients in the intervention (time-lapse) group, and blastocysts with the highest morphological score were transferred for 389 patients in the control group. Only single embryo transfers in fresh cycles were performed.

MAIN RESULTS AND THE ROLE OF CHANCE

In the full analysis set, the ongoing pregnancy rate for the time-lapse group was 47.4% (175/369) and 48.1% (181/376) in the control group. No statistically significant difference was found between the two groups: mean difference −0.7% (95% CI −8.2, 6.7, P = 0.90). Pregnancy rate (60.2% versus 59.0%, mean difference 1.1%, 95% CI −6.2, 8.4, P = 0.81) and early pregnancy loss (21.2% versus 18.5%, mean difference 2.7%, 95% CI −5.2, 10.6, P = 0.55) were the same for the time-lapse and the control group. Subgroup analyses showed that patient and treatment characteristics did not significantly affect the commercial time-lapse model D5 performance. In the time-lapse group, the choice of best blastocyst changed on 42% of occasions (154/369, 95% CI 36.9, 47.2) after the algorithm was applied, and this rate was similar for most treatment clinics.

LIMITATIONS, REASONS FOR CAUTION

During 2020, the patient recruitment rate slowed down at participating clinics owing to coronavirus disease-19 restrictions, so the target sample size was not achieved as planned and it was decided to stop the trial prematurely. The study only investigated embryo selection at the blastocyst stage on D5 in fresh IVF transfer cycles. In addition, only blastocysts of good morphological quality were considered for transfer, limiting the number of embryos for selection in both groups: also, it could be argued that this manual preselection of blastocysts limits the theoretical selection power of time-lapse, as well as restricting the results mainly to a good prognosis patient group. Most patients were aimed for blastocyst stage transfer when a minimum of five zygotes were available for extended culture. Finally, the primary clinical outcome evaluated was pregnancy to only 6–8 weeks.

WIDER IMPLICATIONS OF THE FINDINGS

The study suggests that time-lapse selection with a commercially available time-lapse model does not increase chance of ongoing pregnancy after single blastocyst transfer on Day 5 compared to morphology alone.

STUDY FUNDING/COMPETING INTEREST(S)

The study was financed by a grant from the Swedish state under the ALF-agreement between the Swedish government and the county councils (ALFGBG-723141). Vitrolife supported the study with embryo culture dishes and culture media. During the study period, T.H. changed his employment from Livio AB to Vitrolife AB. All other authors have no conflicts of interests to disclose.

TRIAL REGISTRATION NUMBER

ClinicalTrials.gov registration number NCT03445923.

TRIAL REGISTRATION DATE

26 February 2018.

DATE OF FIRST PATIENT’S ENROLMENT

11 June 2018.

Inter-centre reliability in embryo grading across several IVF clinics is limited: implications for embryo selection

RESEARCH QUESTION

What is the intra- and inter-centre reliability in embryo grading performed according to the Istanbul Consensus across several IVF clinics?

DESIGN

Forty Day 3 embryos and 40 blastocysts were photographed on three focal planes. Senior and junior embryologists from 65 clinics were invited to grade them according to the Istanbul Consensus (Study Phase I). All participants then attended interactive training where a panel of experts graded the same embryos (Study Phase II). Finally, a second set of pictures was sent to both embryologists and experts for a blinded evaluation (Study Phase III). Intra-centre reliability was reported for Study Phase I as Cohen's kappa between senior and junior embryologists; inter-centre reliability was instead calculated between senior/junior embryologists and experts in Study Phase I versus III to outline improvements after training (i.e. upgrade of Cohen's kappa category according to Landis and Koch).

RESULTS

Thirty-six embryologists from 18 centres participated (28% participation rate). The intra-centre reliability was (i) substantial (0.63) for blastomere symmetry (range -0.02 to 1.0), (ii) substantial (0.72) for fragmentation (range 0.29-1.0), (iii) substantial (0.66) for blastocyst expansion (range 0.19-1.0), (iv) moderate (0.59) for inner cell mass quality (range 0.07-0.92), (v) moderate (0.56) for trophectoderm quality (range 0.01-0.97). The inter-centre reliability showed an overall improvement from Study Phase I to III, from fair (0.21-0.4) to moderate (0.41-0.6) for all parameters under analysis, except for blastomere fragmentation among senior embryologists, which was already moderate before training.

CONCLUSIONS

Intra-centre reliability was generally moderate/substantial, while inter-centre reliability was just fair. The interactive training improved it to moderate, hence this workflow was deemed helpful. The establishment of external quality assessment services (e.g. UK NEQAS) and the avant-garde of artificial intelligence might further improve the reliability of this key practice for embryo selection.

Granulocyte-Macrophage Colony Stimulating Factor in Single Blastocyst Conditioned Medium as a Biomarker for Predicting Implantation Outcome of Embryo

Background

It is highly desirable to develop new strategies based on secretomics to more accurately selection of embryos with the highest developmental potential for transfer. Granulocyte-macrophage colony-stimulating factor (GM-CSF) has been reported to promote embryo development and pregnancy establishment. However, the predictive value of GM-CSF in single blastocyst selection remains unclear. This study is to determine the concentration of GM-CSF in human single-blastocyst conditioned medium (SBCM) and to evaluate its association with embryo quality and pregnancy outcome.

Methods

The patients with ≤38 years of age receiving the first cycle of assisted reproductive therapy were included in this study. The patients who had <4 top-quality embryos formed by the fertilized two pronuclear zygotes on day 3 were excluded. A total of 126 SBCM samples (SBCMs) were included, of which blastocysts from 77 SBCMs were later transferred in subsequent frozen-thawed embryo transfer. The concentrations of GM-CSF were detected by single-molecule array (SIMOA) and analyzed for their possible association with embryo quality and pregnancy outcomes. The top-quality embryo (TQ), positive HCG (HP), clinical pregnancy (CP), and ongoing pregnancy (OP) rates were determined and compared between groups divided based on GM-CSF concentrations.

Results

The detection rate of GM-CSF was found to be 50% in all SBCMs. There were significant differences in TQ rate, HP rate, CP rate and OP rate among high concentration group, medium concentration group and low concentration group. Both GM-CSF alone or GM-CSF combined with the morphological score (MS) had a greater AUC of ROC curve than that of MS alone to predict the pregnancy outcome, and GM-CSF combined with MS had the highest AUC.

Conclusions

The concentration of GM-CSF in SBCM was detected at fg/ml levels, which was associated with embryo quality and pregnancy outcome. Collectively, GM-CSF may be used as a biomarker for prediction of pregnancy outcome and selection of embryos with high developmental potential for transfer in assisted reproductive technology (ART).

The presence of cytoplasmic strings in human blastocysts is associated with the probability of clinical pregnancy with fetal heart

PURPOSE

Is the presence of cytoplasmic strings (CS) in human blastocysts associated with the probability of clinical pregnancy with fetal heart (CPFH) after transfer.

METHODS

This case-control study involved 300 single blastocyst transfers. 150 of these resulted in a CPFH (cases) while 150 did not (controls). All embryos were cultured in Embryoscope+ and AI software (IVY) was used to select the blastocyst with the highest score from the cohort for transfer. An embryologist, blind to the transfer outcome, recorded the CS number, location, and duration of their activity.

RESULTS

There was a significant difference in the number of blastocysts that contained CS, with 97.3% of women's blastocysts resulting in +CPFH containing the CS compared to 88.7% of blastocysts in women who did not have a pregnancy (p = 0.007, OR; 4.67, CI 95% 1.5-14.2). CS appeared 2.4 h earlier in embryo development in the +CPFH group compared to their negative counterparts (p = 0.007). There was a significant difference in the average number of CS/blastocyst with a higher number being present in those that achieved a clinical pregnancy (mean: 6.2, SD 2.9) compared to those that did not (mean: 4.6, SD 3.0) (p ≤ 0.0001). There was a significant increase in the number of vesicles seen traveling along the CS with more seen in the blastocysts resulting in a +CPFH (mean: 4.3 SD 2.1) compared to those in the -CPFH group (mean: 3.1, SD 2.1).

CONCLUSION

This study has shown that the presence of cytoplasmic strings in human blastocysts is associated with the probability of clinical pregnancy with fetal heart.

Clinical implementation of algorithm-based embryo selection is associated with improved pregnancy outcomes in single vitrified warmed euploid embryo transfers

PURPOSE

To assess whether utilization of a mathematical ranking algorithm for assistance with embryo selection improves clinical outcomes compared with traditional embryo selection via morphologic grading in single vitrified warmed euploid embryo transfers (euploid SETs).

METHODS

A retrospective cohort study in a single, academic center from September 2016 to February 2020 was performed. A total of 4320 euploid SETs met inclusion criteria and were included in the study. Controls included all euploid SETs in which embryo selection was performed by a senior embryologist based on modified Gardner grading (traditional approach). Cases included euploid SETs in which embryo selection was performed using an automated algorithm-based approach (algorithm-based approach). Our primary outcome was implantation rate. Secondary outcomes included ongoing pregnancy/live birth rate and clinical loss rate.

RESULTS

The implantation rate and ongoing pregnancy/live birth rate were significantly higher when using the algorithm-based approach compared with the traditional approach (65.3% vs 57.8%, p<0.0001 and 54.7% vs 48.1%, p=0.0001, respectively). After adjusting for potential confounding variables, utilization of the algorithm remained significantly associated with improved odds of implantation (aOR 1.51, 95% CI 1.04, 2.18, p=0.03) ongoing pregnancy/live birth (aOR 1.99, 95% CI 1.38, 2.86, p=0.0002), and decreased odds of clinical loss (aOR 0.42, 95% CI 0.21, 0.84, p=0.01).

CONCLUSIONS

Clinical implementation of an automated mathematical algorithm for embryo ranking and selection is significantly associated with improved implantation and ongoing pregnancy/live birth as compared with traditional embryo selection in euploid SETs.

Early embryo morphokinetics is a better predictor of post-ICSI live birth than embryo morphology: speed is more important than beauty at the cleavage stage

Given the importance of embryo developmental competence assessment in reproductive medicine and biology, the aim of this study was to compare the performance of fertilization and cleavage morphokinetics with embryo morphology to predict post-ICSI live birth. Data from embryos cultured in a time-lapse microscopy (TLM) incubator and with known live birth outcomes (LB: embryos achieving live birth, n = 168; NLB: embryos not achieving live birth, n = 1633) were used to generate receiver operating characteristic (ROC) curves based on morphokinetic or morphological scores, and the respective areas under the curve (AUC) were compared. The association between live birth and 12 combinations of four morphokinetic quality degrees (A-D) with three morphological quality degrees (A-C) was assessed using multivariate analysis. Morphokinetic parameters from tPNa to t8 were reached earlier in LB compared with NLB embryos. The ROC curve analysis indicated that morphokinetic information is more accurate than conventional morphology to predict live birth [AUC = 0.64 (95% CI 0.58-0.70) versus AUC = 0.58 (95% CI 0.51-0.65)]. The multivariate analysis was in line with AUCs, revealing that embryos with poor morphokinetics, independently of their morphology, provide lower live birth rates (P < 0.001). A considerable percentage of embryos with top morphology presented poor morphokinetics (20.10%), accompanied by a severely reduced live birth rate in comparison with embryos with top morphology and morphokinetics (P < 0.001). In conclusion, TLM-derived early morphokinetic parameters were more predictive of live-birth achievement following ICSI than conventional morphology.

Development of deep learning algorithms for predicting blastocyst formation and quality by time-lapse monitoring

Approaches to reliably predict the developmental potential of embryos and select suitable embryos for blastocyst culture are needed. The development of time-lapse monitoring (TLM) and artificial intelligence (AI) may help solve this problem. Here, we report deep learning models that can accurately predict blastocyst formation and usable blastocysts using TLM videos of the embryo’s first three days. The DenseNet201 network, focal loss, long short-term memory (LSTM) network and gradient boosting classifier were mainly employed, and video preparation algorithms, spatial stream and temporal stream models were developed into ensemble prediction models called STEM and STEM⁺. STEM exhibited 78.2% accuracy and 0.82 AUC in predicting blastocyst formation, and STEM⁺ achieved 71.9% accuracy and 0.79 AUC in predicting usable blastocysts. We believe the models are beneficial for blastocyst formation prediction and embryo selection in clinical practice, and our modeling methods will provide valuable information for analyzing medical videos with continuous appearance variation.

Liao et al. propose a deep learning model to predict blastocyst formation using TLM videos following the first three days of embryogenesis. The authors develop an ensemble prediction model, STEM and STEM⁺, which were found to exhibit 78.2% and 71.9% accuracy at predicting blastocyst formation and useable blastocysts respectively.

Blastocyst age, expansion, trophectoderm morphology, and number cryopreserved are variables predicting clinical implantation in single blastocyst frozen embryo transfers in freeze-only-IVF

PURPOSE

To determine which blastocyst assessment variables predict clinical implantations in single blastocyst frozen embryo transfers (FET) of freeze-only-IVF cycles, following improved vitrified-warmed blastocyst survival and developmental competence preservation.

METHOD

In this retrospective cohort study performed at a single private IVF center, the pregnancy outcomes of 1795 single blastocyst FET cycles were analyzed, from freeze-only-IVF retrievals performed between January 2017 and January 2020. Stepwise forward logistic regressions with clinical implantation (i.e., normal gestational sac and cardiac activity) as dependent variable were performed to identify the significant predictors. All blastocysts were vitrified using Cryotop technology, with before transfer (post-warming) blastocyst morphology scores used in all analyses.

RESULT(S)

The 1795 blastocysts transferred were vitrifıed on embryo days 4 (1057), 5 (716), and 6 (22). The overall clinical implantation rate was 50.9%; however, using blastocyst age and blastocyst morphological score the clinical implantation rates increased from 49.0% (day-4 1 and 2) and 25.2% (day-5 1 and 2) to 71.2% (day-4 4AA) and 64.3% (day-5 4AA), respectively. Whereas full (≥3) blastocysts with scores of AA and BA had similar clinical implantation rates (66.2 vs. 66.7%), the rate of full blastocysts with scores of AB was lower (58.9%). In stepwise forward logistic regressions, female age, blastocyst age, blastocyst expansion score, blastocyst trophectoderm score, and number of blastocysts vitrified were significant predictors of clinical implantation.

CONCLUSION(S)

Using blastocyst age and before transfer blastocyst expansion and trophectoderm morphology scores to select blastocysts, clinical implantation rates greater than 70% could be achieved for top-scoring blastocysts.

Comparison of single euploid blastocyst transfer cycle outcome derived from embryos with normal or abnormal cleavage patterns

RESEARCH QUESTION

To assess incidence of abnormal cleavage among biopsied blastocysts; to compare euploidy rates of the blastocysts with abnormal and normal cleavage; and to compare single euploid blastocyst transfer (SEBT) outcome derived from embryos with normal or abnormal cleavage.

DESIGN

Retrospective analysis of prospectively collected data in a private IVF clinic. Consecutive 554 patients (749 cycles) undergoing preimplantation genetic testing for aneuploidy (n = 497; 671 cycles) or monogenic diseases (n = 57; 78 cycles) were included. All assessments for abnormal cleavage were carried out retrospectively; presence of abnormal cleavage was not a factor in deciding which euploid embryo to transfer. A total of 1015 blastocysts were biopsied and 295 SEBT procedures were carried out. Main outcome measure was live birth rate (LBR).

RESULTS

Incidence of reverse cleavage, direct cleavage, and reverse plus direct cleavage, were 7.7%, 6.4% and 2.3%, respectively. Of the 1015 biopsied blastocysts, 35.0% were euploid. Blastocysts with abnormal cleavage, in total, had a significantly higher euploidy rate compared with blastocysts with normal cleavage (44.6% [74/166] versus 33.1% [281/849]; P = 0.017). The LBR after SEBT with normal, reverse and direct cleavage, and direct cleavage plus reverse cleavage, was 133/238 (55.9%), 6/26 (23.1%), 8/24 (33.3%) and 0/3 (0.0%) (P < 0.001). Generalized estimating equation analysis showed that the presence of abnormal cleavage pattern was the only independent predictor of LBR (OR 0.316; 95% CI 0.115 to 0.867; P = 0.013).

CONCLUSIONS

Blastocysts with direct or reverse cleavage should be biopsied in preimplantation genetic testing cycles if they are morphologically eligible. Euploid blastocysts with abnormal cleavage, however, have approximately half the LBR of those euploid blastocyst with normal cleavage, hence, blastocysts with abnormal cleavage should have lower priority for transfer.

Deep learning enables robust assessment and selection of human blastocysts after in vitro fertilization

Visual morphology assessment is routinely used for evaluating of embryo quality and selecting human blastocysts for transfer after in vitro fertilization (IVF). However, the assessment produces different results between embryologists and as a result, the success rate of IVF remains low. To overcome uncertainties in embryo quality, multiple embryos are often implanted resulting in undesired multiple pregnancies and complications. Unlike in other imaging fields, human embryology and IVF have not yet leveraged artificial intelligence (AI) for unbiased, automated embryo assessment. We postulated that an AI approach trained on thousands of embryos can reliably predict embryo quality without human intervention. We implemented an AI approach based on deep neural networks (DNNs) to select highest quality embryos using a large collection of human embryo time-lapse images (about 50,000 images) from a high-volume fertility center in the United States. We developed a framework (STORK) based on Google’s Inception model. STORK predicts blastocyst quality with an AUC of >0.98 and generalizes well to images from other clinics outside the US and outperforms individual embryologists. Using clinical data for 2182 embryos, we created a decision tree to integrate embryo quality and patient age to identify scenarios associated with pregnancy likelihood. Our analysis shows that the chance of pregnancy based on individual embryos varies from 13.8% (age ≥41 and poor-quality) to 66.3% (age <37 and good-quality) depending on automated blastocyst quality assessment and patient age. In conclusion, our AI-driven approach provides a reproducible way to assess embryo quality and uncovers new, potentially personalized strategies to select embryos.

Clinical application of immunomagnetic reduction for quantitative analysis of beta-subunit of human chorionic gonadotropin in blastocyst culture media to differentiate embryo quality

BACKGROUND

The most important factor for a successful pregnancy after in vitro fertilization is embryo quality. The aim of this study was to explore the possibility that using the immunomagnetic reduction (IMR) assay to quantitatively measure β-subunit of human chorionic gonadotropin (β-hCG) in blastocyst culture media to differentiate embryo quality.

METHODS

This was a prospective case-control study including 28 samples of blastocyst culture media. We used single-step blastocyst culture and IMR assay to analyze β-hCG concentrations in culture media. We also explored the relationship between IMR signals of β-hCG and morphological grading of blastocysts.

RESULTS

β-hCG concentration-dependent IMR signals were highly correlated with blastocyst morphological quality (Spearman correlation coefficient: 0.731). Receiver-operating characteristic curve analysis showed a cut-off IMR value to differentiate embryo quality of 0.873%, with an area under the curve of 0.947, sensitivity of 0.882 and specificity of 0.818. Furthermore, subanalysis also revealed a positive correlation between β-hCG concentration-dependent IMR signals and trophectoderm grading, with a Spearman correlation coefficient of 0.576.

CONCLUSIONS

An IMR assay can quantitatively measure β-hCG in blastocyst culture media, and may be a potential clinical tool to assist in the assessment of good blastocyst quality before embryo transfer.

Morphology vs morphokinetics: a retrospective comparison of inter-observer and intra-observer agreement between embryologists on blastocysts with known implantation outcome

Objective

Our primary aim was to compare the morphology and morphokinetics on inter- and intra-observer agreement for blastocyst with known implantation outcome. Our secondary aim was to validate the morphokinetic parameters' ability to predict pregnancy using a previous published selection algorithm, and to compare this to standard morphology assessments.

Methods

Two embryologists made independent blinded annotations on two occasions using time-lapse images and morphology evaluations using the Gardner Schoolcraft criteria of 99 blastocysts with known implantation outcome. Inter- and intra-observer agreement was calculated and compared using the two methods. The embryos were grouped based on their morphological score, and on their morphokinetic class using a previous published selection algorithm. The implantation rates for each group was calculated and compared.

Results

There was moderate agreement for morphology, with agreement on the same embryo score in 55 of 99 cases. The highest agreement rate was found for expansion grade, followed by trophectoderm and inner cell mass. Correlation with pregnancy was inconclusive. For morphokinetics, almost perfect agreement was found for early and late embryo development events, and strong agreement for day-2 and day-3 events. When applying the selection algorithm, the embryo distributions were uneven, and correlation to pregnancy was inconclusive.

Conclusions

Time-lapse annotation is consistent and accurate, but our external validation of a previously published selection algorithm was unsuccessful.

High reliability of morphokinetic annotations among embryologists

STUDY QUESTION

Are morphokinetic measurements of time lapse-videos of human embryos comparable among operators?

SUMMARY ANSWER

There is little variation among morphokinetic measurements taken by different operators when analyzing the same time lapse-videos of human embryos.

WHAT IS KNOWN ALREADY

Morphokinetic analysis of preimplantation embryo development is a complementary method of embryo assessment increasingly used in IVF laboratories. Time-lapse videos of embryo development are normally viewed by trained embryologists and annotated with the times when specific developmental events occur. Such annotations form the basis of embryo selection algorithms, used to rank the embryos for transfer. It is unknown whether the reliability of morphokinetic annotations is related to the morphological characteristics of the analyzed embryo or to the ability of the embryologists performing the annotation. One study so far reported the reliability of morphokinetic annotations among three embryologists using the time-lapse system (TLS), but larger studies with different setups are needed to address this issue further.

STUDY DESIGN SIZE DURATION

A prospective study was carried out between October 2015 and June 2016. Six embryologists with various degrees of experience in static, morphology-based evaluation, individually annotated the same 93 videos of preimplantation development, corresponding to 18 IVF/ICSI cycles, recorded with a TLS.

PARTICIPANTS/MATERIALS SETTING METHODS

Times of second polar body extrusion, appearance and disappearance of pronuclei, and embryo cleavages (times from 2-cell to 5-cell stage: t2, t3, t4, t5) were annotated. Each embryologist was blinded to the annotations of the others. Intra- and inter-observer agreement was evaluated by computing intra-class correlation coefficients (ICCs).

MAIN RESULTS AND THE ROLE OF CHANCE

In the inter-observer analysis, most ICCs obtained were higher than 0.80, indicating a high level of agreement: t2: 0.93; t3: 0.80; t4: 0.89; t5: 0.89; disappearance of two pronuclei: 0.98. However, the ICCs obtained for second polar body extrusion and the appearance of two pronuclei annotations was lower: 0.51 and 0.63, respectively, indicating an average level of agreement. The ICCs obtained from the intra-observer analysis were also higher than 0.80 (t2: 0.96; t3: 0.89; t4: 0.88; t5: 0.86; disappearance of two pronuclei: 0.96). The ICCs obtained from second polar body extrusion and the appearance of two pronuclei annotations were 0.77 and 0.66, respectively. These results indicate that developmental timings, annotated in time-lapse videos, are highly reliable both within and among observers.

LIMITATIONS REASONS FOR CAUTION

The events at the developmental stages from 6-cells to blastocyst were not evaluated; since some morphokinetic algorithms use times past the 6-cell stage in their calculations, further studies should be carried out to understand the variations among observers in these cases.

WIDER IMPLICATIONS OF THE FINDINGS

Time-lapse measurement should be as objective as possible, especially for the first embryo cleavages, because they are often measured to define algorithms to assess the embryonic implantation potential. Our results show that measurements using this particular TLS are consistent and reliable both within and among operators.

STUDY FUNDING/COMPETING INTERESTS

None.

TRIAL REGISTRATION NUMBER

Not applicable.

Time-lapse algorithms and morphological selection of day-5 embryos for transfer: a preclinical validation study

OBJECTIVE

To determine the agreement between published time-lapse algorithms in selecting the best day-5 embryo for transfer, as well as the agreement between these algorithms and embryologists.

DESIGN

Prospective study.

SETTING

Private in vitro fertilization center.

PATIENT(S)

Four hundred and twenty-eight embryos from 100 cycles cultured in the EmbryoScope.

INTERVENTION(S)

None.

MAIN OUTCOME MEASURE(S)

Interalgorithm agreement as assessed by the Fleiss kappa coefficient.

RESULT(S)

Of seven published algorithms analyzed in this study, only one of the 18 possible pairs showed very good agreement (κ = 0.867); one pair showed good agreement (κ = 0.725), four pairs showed fair agreement (κ = 0.226-0.334), and the remaining 12 pairs showed poor agreement (κ = 0.008-0.149). Even in the best-case scenario, the majority of algorithms showed poor to moderate kappa scores (κ = 0.337-0.722) for the assessment of agreement between the embryo(s) selected as "best" by the algorithms and the embryo that was chosen by the majority (>5) of embryologists, as well as with the embryo that was actually selected in the laboratory on the day of transfer (κ = 0.315-0.802).

CONCLUSION(S)

The results of this study raise concerns as to whether the tested algorithms are applicable in different clinical settings, emphasizing the need for proper external validation before clinical use.

Inter-laboratory agreement on embryo classification and clinical decision: Conventional morphological assessment vs. time lapse

The aim of this study is to determine inter-laboratory variability on embryo assessment using time-lapse platform and conventional morphological assessment. This study compares the data obtained from a pilot study of external quality control (EQC) of time lapse, performed in 2014, with the classical EQC of the Spanish Society for the Study of Reproductive Biology (ASEBIR) performed in 2013 and 2014. In total, 24 laboratories (8 using EmbryoScope™, 15 using Primo Vision™ and one with both platforms) took part in the pilot study. The clinics that used EmbryoScope™ analysed 31 embryos and those using Primo Vision™ analysed 35. The classical EQC was implemented by 39 clinics, based on an analysis of 25 embryos per year. Both groups were required to evaluate various qualitative morphological variables (cell fragmentation, the presence of vacuoles, blastomere asymmetry and multinucleation), to classify the embryos in accordance with ASEBIR criteria and to stipulate the clinical decision taken. In the EQC time-lapse pilot study, the groups were asked to determine, as well as the above characteristics, the embryo development times, the number, opposition and size of pronuclei, the direct division of 1 into 3 cells and/or of 3 into 5 cells and false divisions. The degree of agreement was determined by calculating the intra-class correlation coefficients and the coefficient of variation for the quantitative variables and the Gwet index for the qualitative variables. For both EmbryoScope™ and Primo Vision™, two periods of greater inter-laboratory variability were observed in the times of embryo development events. One peak of variability was recorded among the laboratories addressing the first embryo events (extrusion of the second polar body and the appearance of pronuclei); the second peak took place between the times corresponding to the 8-cell and morula stages. In most of the qualitative variables analysed regarding embryo development, there was almost-perfect inter-laboratory agreement among conventional morphological assessment (CMA), EmbryoScope™ and Primo Vision™, except for false divisions, vacuoles and asymmetry (users of all methods) and multinucleation (users of Primo Vision™), where the degree of agreement was lower. The inter-laboratory agreement on embryo classification according to the ASEBIR criteria was moderate-substantial (Gwet 0.41-0.80) for the laboratories using CMA and EmbryoScope™, and fair-moderate (Gwet 0.21-0.60) for those using Primo Vision™. The inter-laboratory agreement for clinical decision was moderate (Gwet 0.41-0.60) on day 5 for CMA users and almost perfect (Gwet 0.81-1) for time-lapse users. In conclusion, time-lapse technology does not improve inter-laboratory agreement on embryo classification or the analysis of each morphological variable. Moreover, depending on the time-lapse platform used, inter-laboratory agreement may be lower than that obtained by CMA. However, inter-laboratory agreement on clinical decisions is improved with the use of time lapse, regardless of the platform used.

Inter-observer and intra-observer agreement between embryologists during selection of a single Day 5 embryo for transfer: a multicenter study

STUDY QUESTION

What is the inter-observer and intra-observer agreement between embryologists when selecting a single Day 5 embryo for transfer?

SUMMARY ANSWER

The inter-observer and intra-observer agreement between embryologists when selecting a single Day 5 embryo for transfer was generally good, although not optimal, even among experienced embryologists.

WHAT IS KNOWN ALREADY

Previous research on the morphological assessment of early stage (two pronuclei to Day 3) embryos has shown varying levels of inter-observer and intra-observer agreement. However, single blastocyst transfer is now becoming increasingly popular and there are no published data that assess inter-observer and intra-observer agreement when selecting a single embryo for Day 5 transfer.

STUDY DESIGN, SIZE, DURATION

This was a prospective study involving 10 embryologists working at five different IVF clinics within a single organization between July 2013 and November 2015.

PARTICIPANTS/MATERIALS, SETTING, METHODS

The top 10 embryologists were selected based on their yearly Quality Assurance Program scores for blastocyst grading and were asked to morphologically grade all Day 5 embryos and choose a single embryo for transfer in a survey of 100 cases using 2D images. A total of 1000 decisions were therefore assessed. For each case, Day 5 images were shown, followed by a Day 3 and Day 5 image of the same embryo. Subgroup analyses were also performed based on the following characteristics of embryologists: the level of clinical embryology experience in the laboratory; amount of research experience; number of days per week spent grading embryos. The agreement between these embryologists and the one that scored the embryos on the actual day of transfer was also evaluated. Inter-observer and intra-observer variability was assessed using the kappa coefficient to evaluate the extent of agreement.

MAIN RESULTS AND THE ROLE OF CHANCE

This study showed that all 10 embryologists agreed on the embryo chosen for transfer in 50 out of 100 cases. In 93 out of 100 cases, at least 6 out of the 10 embryologists agreed. The inter-observer and intra-observer agreement among embryologists when selecting a single Day 5 embryo for transfer was generally good as assessed by the kappa scores (kappa = 0.734, 95% CI: 0.665-0.791 and 0.759, 95% CI: 0.622-0.833, respectively). The subgroup analyses did not substantially alter the inter-observer and intra-observer agreement among embryologists. The agreement when Day 3 images were included alongside Day 5 images of the same embryos resulted in a change of mind at least three times by each embryologist (on average for <10% of cases) and resulted in a small decrease in inter-observer and intra-observer agreement between embryologists (kappa = 0.676, 95% CI: 0.617-0.724 and 0.752, 95% CI: 0.656-808, respectively).The assessment of the inter-observer agreement with regard to morphological grading of Day 5 embryos showed only a fair-to-moderate agreement, which was observed across all subgroup analyses. The highest overall kappa coefficient was seen for the grading of the developmental stage of an embryo (0.513; 95% CI: 0.492-0.538). The findings were similar when the individual embryologists were compared with the embryologist who made the morphological assessments of the available embryos on the actual day of transfer.

LIMITATIONS, REASONS FOR CAUTION

All embryologists had already completed their training and were working under one organization with similar policies between the five clinics. Therefore, the inter-observer agreement might not be as high between embryologists working in clinics with different policies or with different levels of training.

WIDER IMPLICATIONS OF THE FINDINGS

The generally good, although not optimal uniformity between participating embryologists when selecting a Day 5 embryo for transfer, as well as, the surprisingly low agreement when morphologically grading Day 5 embryos could be improved, potentially resulting in increased pregnancy rates. Future studies need to be directed toward technologies that can help achieve this.

STUDY FUNDING/COMPETING INTERESTS

None declared.

TRIAL REGISTRATION NUMBER

Not applicable.

Methods for assessing the quality of mammalian embryos: How far we are from the gold standard?

Morphological embryo classification is of great importance for many laboratory techniques, from basic research to the ones applied to assisted reproductive technology. However, the standard classification method for both human and cattle embryos, is based on quality parameters that reflect the overall morphological quality of the embryo in cattle, or the quality of the individual embryonic structures, more relevant in human embryo classification. This assessment method is biased by the subjectivity of the evaluator and even though several guidelines exist to standardize the classification, it is not a method capable of giving reliable and trustworthy results. Latest approaches for the improvement of quality assessment include the use of data from cellular metabolism, a new morphological grading system, development kinetics and cleavage symmetry, embryo cell biopsy followed by pre-implantation genetic diagnosis, zona pellucida birefringence, ion release by the embryo cells and so forth. Nowadays there exists a great need for evaluation methods that are practical and non-invasive while being accurate and objective. A method along these lines would be of great importance to embryo evaluation by embryologists, clinicians and other professionals who work with assisted reproductive technology. Several techniques shows promising results in this sense, one being the use of digital images of the embryo as basis for features extraction and classification by means of artificial intelligence techniques (as genetic algorithms and artificial neural networks). This process has the potential to become an accurate and objective standard for embryo quality assessment.

Selecting the embryo with the highest implantation potential using a data mining based prediction model

BACKGROUND

Embryo selection has been based on developmental and morphological characteristics. However, the presence of an important intra-and inter-observer variability of standard scoring system (SSS) has been reported. A computer-assisted scoring system (CASS) has the potential to overcome most of these disadvantages associated with the SSS. The aims of this study were to construct a prediction model, with data mining approaches, and compare the predictive performance of models in SSS and CASS and to evaluate whether using the prediction model would impact the selection of the embryo for transfer.

METHODS

A total of 871 single transferred embryos between 2008 and 2013 were included and evaluated with two scoring systems: SSS and CASS. Prediction models were developed using multivariable logistic regression (LR) and multivariate adaptive regression splines (MARS). The prediction models were externally validated with a test set of 109 single transfers between January and June 2014. Area under the curve (AUC) in training data and validation data was compared to determine the utility of the models.

RESULTS

In SSS models, the AUC declined significantly from training data to validation data (p < 0.05). No significant difference was detected in CASS derived models. Two final prediction models derived from CASS were obtained using LR and MARS, which showed moderate discriminative capacity (c-statistic 0.64 and 0.69 respectively) on validation data.

CONCLUSIONS

The study showed that the introduction of CASS improved the generalizability of the prediction models, and the combination of computer-assisted scoring system with data mining based predictive modeling is a promising approach to improve the selection of embryo with the highest implantation potential.

Add-ons in IVF programme - Hype or Hope?

A series of new technologies and adjuvant therapies have been advocated in order to improve the success of IVF treatment. Dehydro-epiandrostenedione, growth hormones, Coenzyme Q 10, calcium ionosphores, immune therapy, heparin, low-dose aspirin, and vasodilators are among commonly prescribed pharmacological adjuvants. New technologies that are proposed to improve IVF outcomes include advanced sperm selection procedures, time- lapse embryo monitoring, preimplantation genetic screening, assisted hatching endometrial injury or embryo-glue. This review looked into current evidence to justify the use of these co-interventions and whether some of them can still be offered while awaiting more robust evidence to con rm or refute their role.

Time-lapse deselection model for human day 3 in vitro fertilization embryos: the combination of qualitative and quantitative measures of embryo growth

OBJECTIVE

To present a time-lapse deselection model involving both qualitative and quantitative parameters for assessing embryos on day 3.

DESIGN

Retrospective cohort study and prospective validation.

SETTING

Private IVF center.

PATIENT(S)

A total of 270 embryos with known implantation data (KID) after day 3 transfer from 212 IVF/intracytoplasmic sperm injection (ICSI) cycles were retrospectively analyzed for building the proposed deselection model, followed by prospective validation using an additional 66 KID embryos.

INTERVENTION(S)

None.

MAIN OUTCOME MEASURE(S)

Morphological score on day 3, embryo morphokinetic parameters, abnormal cleavage patterns, and known implantation results.

RESULT(S)

All included embryos were categorized either retrospectively or prospectively into 7 grades (A+, A, B, C, D, E, F). Qualitative deselection parameters included poor conventional day 3 morphology, abnormal cleavage patterns identified via time-lapse monitoring, and <8 cells at 68 hours postinsemination. Quantitative parameters included time from pronuclear fading (PNF) to 5-cell stage and duration of 3-cell stage. KID implantation rates of embryos graded from A+ to F were 52.9%, 36.1%, 25.0%, 13.8%, 15.6%, 3.1%, and 0 respectively (area under the curve [AUC] = 0.762; 95% confidence interval [CI], 0.701-0.824), and a similar pattern was seen in either IVF (AUC = 0.721; 95% CI, 0.622-0.821) or ICSI embryos (AUC = 0.790; 95% CI, 0.711-0.868). Preliminary prospective validation using 66 KID embryos also showed statistically significant prediction in Medicult (AUC = 0.750; 95% CI, 0.588-0.912) and Vitrolife G-Series (AUC = 0.820; 95% CI, 0.671-0.969) suites of culture media.

CONCLUSION(S)

The proposed model involving both qualitative and quantitative deselection effectively predicts day 3 embryo implantation potential and is applicable to all IVF embryos regardless of insemination method by using PNF as the reference starting time point.

Quality control and standardization of embryo morphology scoring and viability markers

A so-called 'good-quality embryo' may be defined as an embryo that has the potential to implant into the uterine endometrium and give rise to the birth of a healthy child. A standardized and objective scoring of embryo 'quality' is therefore crucial in the classification and selection of embryos. However, embryo scoring is still being performed mainly via ocular evaluation, which often results in different interpretations of embryo quality. The addition of viability markers, such as measuring gene expression or the uptake/release of metabolites, proteins or RNA/DNA molecules in the culture media, would increase the possibility of standardized measurements. However, no single biomarker has yet been introduced into standard clinical practice, mainly due to the complexity of the techniques and the influence of biological variations and differences in culture conditions. In this paper different methods for the scoring of embryos and the possibility of standardizing and implementing quality control systems are discussed.

A clinically useful simplified blastocyst grading system

The aim of this study was to investigate whether a new simplified blastocyst grading system (A: fully expanded, clear inner cell mass, cohesive trophectoderm; B: not yet expanded, clear inner cell mass, cohesive trophectoderm; C: small inner cell mass ± irregular trophectoderm ± excluded/degenerate cells) was clinically useful. All day-5 single embryo transfers between 15 June 2009 and 29 June 2012 were reviewed. Implantation, clinical pregnancy and live birth rates were related to embryo quality. Five embryologists were asked to grade and decide the clinical fate of 80 images of day-5 embryos on two occasions 4-6 weeks apart. Implantation, clinical pregnancy and live birth rates decreased with deteriorating embryo quality. A highly significant (P < 0.01) difference was observed between the groups. Inter-observer agreement was substantial for grade allocation (K = 0.63) and clinical decision-making (K = 0.66). Intra-observer agreement ranged from substantial (K = 0.71) to almost perfect (K = 0.88) for grade allocation, and was almost perfect for clinical fate determination (K ≥ 0.84). This grading system is quick and easy to use, effectively predicts IVF outcome and has levels of agreement similar to, if not better than, those associated with more complex grading systems.

Clinical significance of intercellular contact at the four-cell stage of human embryos, and the use of abnormal cleavage patterns to identify embryos with low implantation potential: a time-lapse study

OBJECTIVE

To investigate the clinical significance of intercellular contact point (ICCP) in four-cell stage human embryos and the effectiveness of morphology and abnormal cleavage patterns in identifying embryos with low implantation potential.

DESIGN

Retrospective cohort study.

SETTING

Private IVF center.

PATIENT(S)

A total of 223 consecutive IVF and intracytoplasmic sperm injection treatment cycles, with all resulting embryos cultured in the Embryoscope, and a subset of 207 cycles analyzed for ICCP number where good-quality four-cell embryos were available on day 2 (n = 373 IVF and n = 392 intracytoplasmic sperm injection embryos).

INTERVENTION(S)

None.

MAIN OUTCOME MEASURE(S)

Morphologic score on day 3, embryo morphokinetic parameters, incidence of abnormal biological events, and known implantation results.

RESULT(S)

Of 765 good-quality four-cell embryos, 89 (11.6%) failed to achieve six ICCPs; 166 of 765 (21.7%) initially had fewer than six ICCPs but were able to establish six ICCPs before subsequent division. Embryos with fewer than six ICCPs at the end of four-cell stage had a lower implantation rate (5.0% vs. 38.5%), with lower embryology performance in both conventional and morphokinetic assessments, compared with embryos achieving six ICCPs by the end of four-cell stage. Deselecting embryos with poor morphology, direct cleavage, reverse cleavage, and fewer than six ICCPs at the four-cell stage led to a significantly improved implantation rate (33.6% vs. 22.4%).

CONCLUSION(S)

Embryos with fewer than six ICCPs at the end of the four-cell stage show compromised subsequent development and reduced implantation potential. Deselection of embryos with poor morphology and abnormal cleavage revealed via time-lapse imaging could provide the basis of a qualitative algorithm for embryo selection.

Choosing the best embryo by time lapse versus standard morphology

Within the past few years the morphological evaluation of in vitro fertilized embryos has been extended to include continuous surveillance, enabled by the introduction of time-lapse incubators developed specifically for IVF treatment. As a result time-lapse monitoring has been implemented in many clinics worldwide. The proposed benefits compared with culture in a standard incubator and fixed time-point evaluation are uninterrupted culture, a flexible workflow in the laboratory, and improved embryo selection. The latter is based on the reasonable assumption that more frequent observations will provide substantially more information on the relationship between development, timing, and embryo viability. Several retrospective studies have confirmed a relationship between time-lapse parameters and embryo viability evaluated by developmental competence, aneuploidy, and clinical pregnancy. Furthermore a much anticipated randomized study has shown improved pregnancy rates (PRs) after culture in a time-lapse incubator combined with selection using a hierarchical time-lapse selection model. At present this is the only randomized study on possible benefits of time lapse in human embryology. Strict evidence may still seem too weak to introduce time lapse in routine clinical setting. This aim of this review is therefore to perform a balanced discussion of the evidence for time-lapse monitoring.

Morphometric analysis of human embryos to predict developmental competence

Morphometric and morphokinetic approaches toward embryo quality assessment have for many years been difficult due to technical limitations. Today, with improvements in laboratory techniques and subsequent quality, we have a better understanding of the morphometric and kinetics of embryo development. Fertility clinics are moving from "sensing" embryo quality to measuring embryo quality--and this is happening every day in fertility clinics all over the world. However, we cannot select for something that is not there. In daily clinical life it is almost never a question of selecting the optimal embryo, but rather choosing and prioritising between the available embryos. Data suggest that only approximately 5% of aspirated human oocytes have the competence to implant and develop into a child and that, in most treatment cycles, there is no oocyte capable of implanting. The most likely outcome is a negative pregnancy test, no matter what we choose in the laboratory. Still, both with the increasing complexity of infertile patients treated today and the important focus on reducing multiple pregnancies, it becomes increasingly important to improve our ability to predict the developmental competence of each embryo. This involves an improved understanding of the basic biology controlling early embryonic development and, over the years, many groups have tried to identify parameters reflecting embryonic competence.

Inter- and intra-observer variability of time-lapse annotations

STUDY QUESTION

How consistent is the time-lapse annotation of dynamic and static morphologic parameters of embryo development, within and between observers?

SUMMARY ANSWER

The assessment of dynamic parameters is characterized by almost perfect agreement within and between observers.

WHAT IS KNOWN ALREADY

The commonly employed method used to assess embryos in IVF treatments is based on static evaluation of morphology in a microscope, but this is limited by substantial intra- and inter-observer variation. Time-lapse imaging has been proposed as a method to refine embryo selection by adding new dynamic predictors of viability to the assessment. Yet, there are no data regarding the consistency of estimates of the time-lapse parameters.

STUDY DESIGN, SIZE, DURATION

Infertile patients were recruited at the Fertility Clinic, Arhus University Hospital from February 2011 to June 2012. All embryos were cultured for 6 days in a time-lapse incubator (EmbryoScope(™)). Automated image recording was performed every 20 min.

PARTICIPANTS/MATERIALS, SETTING, METHODS

In total, 158 fertilized embryos from 20 different patients were annotated. Three observers made independent annotations on time-lapse recordings. One observer performed the assessment twice. Twenty-five parameters were annotated and the inter- and intra-observer agreement was assessed by calculating intra-class correlation coefficients (ICCs).

MAIN RESULTS AND THE ROLE OF CHANCE

Extremely close agreement (ICC 0.99) was found for dynamic parameters including the timing of the following: pronuclei breakdown, completion of blastocyst hatching and the appearance and disappearance of the first nucleus after the first division. Observations of cleavage divisions were strongly correlated (ICC > 0.8), indicating close agreement. Measurements of the static morphologic parameters, i.e. multi-nucleation and evenness of blastomeres at 2-cell stage showed fair-to-moderate agreement (ICC ≤ 0.5).

LIMITATIONS, REASON FOR CAUTION

The study was conducted at a single clinic. Only embryos with a good prognosis were included. The influence of training sessions was not measured.

WIDER IMPLICATIONS OF THE FINDINGS

Consistency is crucial to the validity of embryo scoring and selection. All of the time-lapse parameters suggested by the literature showed in our study high intra- and inter-observer correlation, thus validating the precision of time-lapse annotations. This provides the basis for further investigation of embryo assessment and selection by time-lapse imaging in prospective trials.

STUDY FUNDING/COMPETING INTEREST(S)

Research at the Fertility Clinic was funded by an unrestricted grant from Ferring and MSD. The authors have no competing interests to declare.

TRIAL REGISTRATION NUMBER

NCT01139268.

Morphological systems of human embryo assessment and clinical evidence

Success rates with IVF have improved remarkably since the procedure was first established for clinical use with the first successful birth in 1978. The main goals today are to perform single-embryo transfer in order to prevent multiple pregnancies and achieve higher overall pregnancy rates. However, the ability to identify the most viable embryo in a cohort remains a challenge despite the numerous scoring systems currently in use. Clinicians still depend on developmental rate and morphological assessment using light microscopy as the first-line approach for embryo selection. Active research in the field involves developing non-invasive methods for scoring embryos and ranking them according to their ability to implant and give rise to a healthy birth. Current attention is particularly being focused on time-lapse evaluation. Available data from preliminary studies indicate that these systems are safe;prospective data now need to be collected to determine whether these methods do improve implantation rates. This review gives brief consideration to the use of morphological evaluations in assisted reproduction treatment, discusses the types of embryo scoring,digital imaging and biometric approaches currently in use and comments on future developments for embryo evaluation.

Human embryo culture media comparisons

Every program of assisted reproduction strives to maximize pregnancy outcomes from in vitro fertilization and selecting an embryo culture medium, or medium pair, consistent with high success rates is key to this process. The common approach is to replace an existing medium with a new one of interest in the overall culture system and then perform enough cycles of IVF to see if a difference is noted both in laboratory measures of embryo quality and in pregnancy. This approach may allow a laboratory to select one medium over another but the outcomes are only relevant to that program, given that there are well over 200 other variables that may influence the results in an IVF cycle. A study design that will allow for a more global application of IVF results, ones due to culture medium composition as the single variable, is suggested. To perform a study of this design, the center must have a patient caseload appropriate to meet study entrance criteria, success rates high enough to reveal a difference if one exists and a strong program of quality assurance and control in both the laboratory and clinic. Sibling oocytes are randomized to two study arms and embryos are evaluated on day 3 for quality grades. Inter and intra-observer variability are evaluated by kappa statistics and statistical power and study size estimates are performed to bring discriminatory capability to the study. Finally, the complications associated with extending such a study to include blastocyst production on day 5 or 6 are enumerated.

Effects of EG-VEGF, VEGF and TGF-β1 on pregnancy outcome in patients undergoing IVF-ET treatment

PURPOSE

To investigate the correlation of endocrine gland-derived vascular endothelial growth factor (EG-VEGF), vascular endothelial growth factor (VEGF) and transforming growth factor beta 1 (TGF-β1) with the corresponding reproductive outcome in patients who received in vitro fertilization-embryo transfer (IVF-ET).

METHODS

Sixty-seven women undergoing IVF-ET at a university tertiary hospital were recruited for a prospective study. Concentrations of EG-VEGF, VEGF and TGF-β1 were measured by enzyme-linked immunosorbent assay (ELISA) in follicular fluid (FF) collected during oocyte retrieval (OR) and in serum collected 2 days after OR.

RESULTS

In FF, concentrations of both EG-VEGF and VEGF were negatively correlated with peak E2 and the number of MII oocytes retrieved, and positively correlated with each other. In serum, concentrations of all the three growth factors were positively correlated with the rate of good quality embryo, and with one another. Patients in the pregnancy group had lower peak E2 concentrations and higher serum EG-VEGF concentrations than those in the non-pregnancy group, but such tendency was not observed in the case of VEGF and TGF-β1.

CONCLUSIONS

Both concentrations of EG-VEGF and VEGF in FF were negatively correlated with ovarian response and oocyte maturation. Concentrations of all the three growth factors in serum were positively correlated with embryo quality, but only serum concentrations of EG-VEGF were associated with the pregnancy outcome.

Reducing inter-observer variability in embryo evaluation by means of training courses

PURPOSE

To study the utility of a training session offered to junior embryologists, comparing the results obtained with those reported by a group of senior embryologists.

METHODS

The 62 junior embryologists participanting were asked to decide on the quality of the embryos and theg clinical decision to be taken.

RESULTS

The junior embryologists' success rate following the training course was significantly higher than before for embryo classification (48.4% ± 20.4 vs. 59.7% ±16.7) (p < 0.05) and for clinical decision (54.7% ± 19.6 vs. 68.7% ± 17.6) (p < 0.005). Comparison of the degree of agreement between the categories assigned by the junior embryologists and those assigned by consensus among the group of senior embryologists revealed kappa values of k = 0.32 before the course and of k = 0.54 after it. The comparison between pre- and post-training junior and senior embryologists also reflected an improvement in the kappa index for clinical decision, from k = 0.54 to k = 0.68.

CONCLUSIONS

Training courses are shown to be an effective tool for increasing the degree of agreement between junior and senior embryologists.

Intra- and interobserver analysis in the morphological assessment of early stage embryos during an IVF procedure: a multicentre study

BACKGROUND

Quality control programs are necessary to maintain good clinical practice. Embryo grading has been described as one of the external quality assurance schemes. Although the evaluation of embryos is based on the assessment of morphological characteristics, considerable intra- and inter-observer variability has been described. In this multicentre study, the variability in the embryo evaluation has been evaluated using morphological characteristics on day 1, day 2 and day 3 of embryo development.

METHODS

Five embryologists of four different IVF centers participated in this study. Multilevel images of embryos were presented on a website at different time points to evaluate intra-and inter-observer agreement in the assessment of embryo morphology. The embryos were evaluated on day 1, day 2 and day 3 of their development and each embryologist had to decide if the embryo had to be transferred, cryopreserved or discarded.

RESULTS

Both intra-observer agreement and inter-observer agreement were good to excellent for the position of the pronuclei on day 1, the number of blastomeres on day 2 and day 3 and the clinical decision (transfer, cryopreservation, discard). For all other characteristics (size of pronuclei, presence of cytoplasomic halo, degree of fragmentation and size of blastomeres) the intra- and inter-observer agreement was moderate to very poor.

CONCLUSIONS

Mono- or multicentre quality control on embryo scoring by morphological assessment can easily be performed through the design of a simple website. In the future the website design can be adapted to generate statistical feedback upon scoring and can even include a training module.

A review of the promises and pitfalls of oocyte and embryo metabolomics

Embryo viability assessment is one of the most important and challenging tasks in IVF. Evaluation of embryo quality is critical when selecting the best embryo(s) to transfer or cryopreserve. Until recently, the only instrument used for embryo evaluation was the inverted light microscope, which provided information based on morphological characteristics. Developmental and morphological information gained from microscopic assessment have been positively associated with IVF outcomes, including pregnancy and implantation rates. However, based on general statistics, it is clear that IVF currently still results in relatively low pregnancy rates, while simultaneously being associated with relatively high multiple implantation rates. Only with novel embryo assessment and selection procedures would it be possible to improve these outcomes. Accordingly, it has been proposed that it is possible to test the culture environment of a developing embryo to gain valuable information regarding its viability. Different approaches have been used. These include the measurement of oxygen consumption by the embryo and testing of the soluble HLA-G in the environment, as it was proposed that secretion of HLA-G is associated with higher implantation rates. Amino acid turnover, which appears to be correlated to blastocyst development, can be measured as an indication of embryo viability. Other approaches, such as time-lapse video observation or cumulus cell gene expression analysis, may be used in the future to gain a broader understanding of embryo viability. Proteomics and metabolomics are also useful tools for assessment of embryo developmental potential. Results from recent studies on predicting embryo viability by analyzing the metabolome of different stage embryos are promising, as increases in pregnancy and implantation rates were obtained using the metabolomic profile for embryo selection. Several novel approaches are currently being developed to aid in viability assessment. These need to be evaluated in prospective clinical trials, while considering their practicality in the clinical laboratory.

Computer-assisted embryo selection: a benefit in the evaluation of embryo quality?

Embryo selection is based on embryo developmental and morphological characteristics. Standard embryo evaluation has some disadvantages. New technology using multilevel images combined with a computer-assisted scoring system (CASS) has the potential to overcome these disadvantages. The aim of this study was to compare the value of a computer-assisted scoring system (CASS) versus a standard scoring system (SSS) in predicting implantation and live birth. This prospective study included 3185 embryos obtained during 502IVF/intracytoplasmic sperm injection cycles with single-embryo transfer on day 3. Embryos were evaluated with two scoring systems: SSS and CASS. Logistic regression analyses were performed using implantation and live birth as outcomes. According to multiple regression analysis, implantation was influenced by number and size of blastomeres on day 3 using CASS and by all embryo parameters on day 3 using SSS. Combined analysis of both scoring systems revealed that implantation was affected by number and size of blastomeres using CASS and by the degree of embryo fragmentation using SSS. Using live birth as outcome, only the number of blastomeres on day 3, evaluated by SSS and CASS, was predictive. Prediction of implantation and live birth may be superior using CASS when compared with SSS. Embryo selection is currently based on embryo developmental and morphological characteristics of an embryo using a standard scoring system. This evaluation system is limited by a number of disadvantages. New technology using multilevel images combined with a computer-assisted scoring system has the potential to overcome these disadvantages. The aim of this study was to compare the value of such computer-assisted scoring system versus a standard scoring system in predicting implantation and live birth rate. This study included 3185 embryos obtained during 502 IVF or intracytoplasmic sperm injection cycles with single-embryo transfer on day 3. All the embryos were evaluated with two types of scoring systems: a standard scoring system and a computer-assisted scoring system. According to the statistical analysis, the implantation of an embryo was influenced by the number and size of blastomeres on day 3 when evaluated with the computer-assisted scoring system, and by all embryo parameters on day 3 using the standard scoring system. Combined analysis of both scoring systems revealed that implantation was affected by number and size of blastomeres using the computer-assisted scoring system and by the degree of embryo fragmentation using the standard scoring system. Live birth was influenced by the number of blastomeres on day 3 evaluated by both scoring systems. Prediction of embryo implantation and live birth was superior using the computer-assisted scoring system. In conclusion, a computer-assisted scoring system may be superior to a standard scoring system in the prediction of implantation and live birth.

Routine morphological scoring systems in assisted reproduction treatment fail to reflect age-related impairment of oocyte and embryo quality

Routine morphological scoring systems in assisted reproduction treatment are based on parameters that presumably correlate with the biological quality of gametes and embryos, including chromosome abnormalities. Maternal age is a key factor predicting pregnancy and live birth, and it is therefore of considerable interest to identify age-related indicators of oocyte and embryo quality in assisted reproduction treatment. The purpose of this study was to examine whether routine morphological scoring systems reflect age-related impact on oocyte and embryo quality among 4587 couples undergoing their first assisted reproduction treatment. This study assessed over 43,000 oocytes, 25,000 embryos and 7900 transferred embryos and analysed the associations among the following parameters: number of oocytes retrieved, oocyte quality, including maturity, fertilization rates, embryo quality, based on morphological features, and treatment outcome. Advanced chronological age was found to be associated with fewer oocytes retrieved, fewer embryos available for cryopreservation, as well as lower pregnancy, implantation, live birth rates and a higher miscarriage rate. No age-related correlation was found between fertilization rates, oocyte or embryo quality. Routinely-used morphological scoring systems, such as assessment of blastomere count, shape and fragmentation, fail to reflect age-related impact on oocyte and embryo quality.