Which key performance indicators are optimal to assess clinical management of assisted reproduction cycles?

Embryology with precision: effective quality control in the in vitro fertilization laboratory

The purpose of this review is to address the critical need for standardization and clarity in the use of key performance indicators (KPIs) within the realm of in vitro fertilization (IVF), particularly emphasizing the integration of preimplantation genetic testing (PGT) processes. This review is timely and relevant given the persistently modest success rates of IVF treatments, which stand at approximately 30%, and the growing complexity of IVF procedures, including PGT practices. The review synthesizes recent findings across studies focusing on technical and clinical KPIs in embryology and genetic laboratories, identifying gaps in current research and practice, particularly the lack of standardized KPIs and terminology. Recent findings highlighted include the critical evaluation of technical KPIs such as Intracytoplasmic Sperm Injection (ICSI) fertilization rates, embryo development rates, and laboratory performance metrics, alongside clinical KPIs like the proportion of mature oocytes and clinical pregnancy rates. Notably, the review uncovers a significant gap in integrating and standardizing KPIs for PGT applications, which is essential for improving IVF outcomes and genetic diagnostic accuracy. The implications of these findings are profound for both clinical practice and research. For clinical practice, establishing a standardized set of KPIs, especially for PGT, could significantly enhance the success rates of IVF treatments by providing clearer benchmarks for quality and performance. For research, this review underscores the necessity for further studies to close the identified gaps, promoting a more integrated and standardized approach to KPIs in IVF and PGT processes. This comprehensive approach will not only aid in improving clinical outcomes but also in advancing the field of reproductive medicine.

Improving success rates by applying interventions in clinical practice and measuring their impact: A multicenter retrospective analysis of more than 240,000 cycles

BACKGROUND

Systematic monitoring of key performance indicators (KPI) is an important component of quality management within the IVF laboratory and, as success of assisted reproduction depends on many variables, it is important to examine how each variable can be optimized to achieve the best possible outcome for patients.

OBJECTIVE

To analyze how the design of a QMS impacts homogenization, safety, and efficacy in multiple fertility centers. Study Design Multicenter, retrospective cohort study with 188,251 patients who underwent 246,988 assisted reproductive treatments at 14 private centers belonging to IVI-RMA clinics between January 2005 and December 2019. Data were stratified by year, clinic, and patient group (standard patient cycles with no PGT-A, standard patients with PGT-A, and oocyte donation patients). Unadjusted and adjusted logistic regression models with other known predictors were made to analyze the impact and the interactions of policies. Main outcomes were determined per clinic and summarized per year as the median of the rates of the clinics; each clinic had the same weight independent of the number of cycles.

RESULTS

Up to 188,251 patients were treated, for a total of 246,988 IVF cycles and 356,433 procedures. The introduction of standard operating procedures, trophectoderm biopsies, and blastocyst-stage transfers, coupled with an increased proportion of PGT-A cycles, led to improved outcomes while maximizing the number of single embryo transfers, driving a significant decrease in the number of multiple pregnancies while improving live birth rates. In terms of the live-birth rate per transfer, the interventions with greater impact over time in logistic regression analysis were 24-chromosome analysis and the introduction of benchtop incubators (odds ratio 1.92 [95% confidence interval 1.81 to 2.05]; p < 0.001). The odd ratios of the policies remained significant and very similar in the unadjusted and adjusted models.

CONCLUSIONS

The greatest impact on live-birth rate per cycle was obtained with a cumulative effect of all policies, especially in egg donation patients. In patients without PGT-A changing embryo culture conditions and blastocyst stage transfer had the greatest impact; in patients with PGT-A, trophectoderm biopsy. Standardizing procedures was essential in reducing variability among clinics and implementing changes.

Indicators of infertility and fertility care: a systematic scoping review

STUDY QUESTION

What is the scope of literature regarding infertility and fertility care indicators in terms of types and dimensions of these indicators?

SUMMARY ANSWER

Most available infertility and fertility care indicators are outcomes indicators of effectiveness and efficiency dimensions.

WHAT IS KNOWN ALREADY

The use of appropriate, relevant and valid indicators of infertility and fertility care is critical for monitoring access, equity and utilization.

STUDY DESIGN SIZE DURATION

A systematic scoping review was conducted. We searched MEDLINE, Pubmed, JSTOR, CINAHL, Web of Science and Scopus electronic databases from inception to May 2022 without imposing language or date restrictions. We searched gray literature and online libraries of relevant organizations. We hand-searched the list of relevant references.

PARTICIPANTS/MATERIALS SETTING METHODS

This scoping systematic review followed the framework of Arksey and O'Malley and the Joanna Briggs Institute guidelines. Records identified by the search were independently screened and data were extracted. We performed conceptual synthesis by grouping the reported indicators by typology and dimensions. Structured tabulation and graphical synthesis were used along with narrative commentary.

MAIN RESULTS AND THE ROLE OF CHANCE

We included 46 reports from 88 countries. The reporting of infertility and fertility care indicators was voluntary in 63 countries (72%) and compulsory in 25 countries (28%). Reporting for cycles or deliveries was based on individual cycles in 56 countries (64%) and on cumulative cycles in 32 countries (36%). Most indicators were utilized as outcome indicators with fewer being process indicators or structural indicators. For the dimension of indicators, most indicators were utilized as effectiveness and efficiency indicators with fewer utilized as indicators of safety, patient-centeredness, equity and timeliness.

LIMITATIONS REASONS FOR CAUTION

Most indicators fall into the domain of assisted reproductive technology and are reported by fertility clinics. Indicators of safety, patient-centeredness, equity and timeliness as well as non-clinical indicators are almost invisible.

WIDER IMPLICATIONS OF THE FINDINGS

A wide range of indicators of infertility and fertility care exist in literature. Most indicators were effectiveness and efficiency indicators, while indicators of safety, patient-centeredness, equity and timeliness remain almost invisible. The scope of the current indicators indicates a predominant focus on clinical metrics, with substantial invisibility of non-clinical indicators and indicators outside the ART domain. These gaps need to be considered in further work of identifying a core set of indicators.

STUDY FUNDING/COMPETING INTERESTS

This work received funding from the UNDP-UNFPA-UNICEF-WHO-World Bank Special Programme of Research, Development and Research Training in Human Reproduction (HRP), a cosponsored program executed by the World Health Organization (WHO). The authors had no competing interests.

TRIAL REGISTRATION NUMBER

Open Science Framework vsu42.

Analysis of the risk of complications during pregnancy in pregnant women with assisted reproductive technology: a retrospective study using registry linkage from 2013 to 2018 in Shanghai, China

Background

To evaluate the differences in pregnancy outcomes between assisted reproductive technology (ART) patients and natural pregnant women in Shanghai, China in the past 6 years objectively. And to assess the feasibility of the research method of registry-database linkage in mainland China.

Methods

This retrospective study was conducted using registry-database linkage. A total of 8102 pregnancies with ART and 8096 parturients with spontaneous conception (SC) from 10 reproductive centers and 111 hospitals composed our retrospective study. The primary outcomes were the rates of obstetric complications (pregnancy-induced hypertention [PIH], gestational diabetes mellitus [GDM], placenta previa, mode of delivery, preterm birth [PTB], low birth weight [LBW], and macrosomia). The prenatal outcomes were compared between ART and SC parturients, frozen-thawed embryo transfer (FET) and fresh embryo transfer, and in vitro fertilization (IVF) and intracytoplasmic sperm injection (ICSI). We calculated odds ratios (ORs) and 95% confidence intervals (CIs).

Results

The final matching rate of the target population was 92% by using registry linkage. ART resulted in a higher rate of multiple birth, PTB, LBW, cesarean section, placenta previa and GDM compared with SC in the singleton cohort. In ART patients, pregnant women with FET had a significantly higher risk of PIH than those with fresh embryo transfer (14.1% Vs 9.3%, AOR1.528, 95% CI 1.303–1.793), but there was no difference between IVF and ICSI. FET is also related to the severity of PIH.

Conclusions

ART increased the rate of complications during pregnancy, the risk and severity of PIH in patients with FET was higher than that in patients with fresh embryo transfer. The registry-database linkage study is an objective and feasible research method in mainland China.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12884-022-04846-1.

Impact of Ovarian Yield-Number of Total and Mature Oocytes Per Antral Follicular Count-On Live Birth Occurrence After IVF Treatment

To assess the relation between oocytes yield including total retrieved oocytes (O)c and total mature oocytes (MII) relative to the antral follicular count (AFC) (3–9 mm in diameter) and relative to anti-müllerian hormone (AMH) ng/mL level: Oc/AFC, MII/AFC, Oc/AMH, and MII/AMH, respectively, and ART outcomes. We included retrospectively 264 IVF cycles after the first embryo transfer (ET) and after the cumulative ET (CET). The implantation rate (IR) and the live birth rate (LBR) after first ET were 31 ± 39% and 32.6%, respectively, and after CET 35 ± 38% and 45.1%, respectively. There was a significantly higher average of Oc/AFC and MII/AFC when live birth (LB) occurred after the first ET (0.82 ± 0.4 vs. 0.71 ± 0.35 and 0.57 ± 0.4 vs. 0.68 ± 0.3, respectively, P < 0.05). We reported a significantly higher average of MII/AFC when LB occurred after CET (0.66 ± 0.3 vs. 0.56 ± 0.30, P = 0.02) in comparison to the group where no LB was obtained. Increased Oc/AFC and MII/AFC ratios were associated with the occurrence of LB and increased IR after first ET (P < 0.05). Increased MII/AFC ratio was associated with the occurrence of LB and IR after CET (P = 0.02 and P = 0.04, respectively). After age-adjusted multivariate analyses, all these trends were confirmed (P < 0.05) except for the effect of MII/AFC ratio on IR after CET. In conclusion, Oc/AMH and MII/AMH ratios have no effect on the occurrence of LBR or on IR after first ET or CET at either age grouping. Ratios Oc/AFC and MII/AFC seem promising indicators to assess ovarian response.

More blastocysts are produced from fewer oocytes in ICSI compared to IVF - results from a sibling oocytes study and definition of a new key performance indicator

BACKGROUND

Which fertilization method, between ICSI and IVF in split insemination treatments, has the highest clinical efficiency in producing clinically usable blastocyst?

METHODS

211 infertile couples underwent split insemination treatments for a non-severe male factor. 1300 metaphase II (MII) oocytes were inseminated by conventional IVF and 1302 MII oocytes were micro-injected with the same partner's semen. Embryo development until blastocyst stage on day V and clinical outcomes were valuated trough conventional key performance indicators (KPI), and new KPIs such as blastocyst rate per used MII oocytes and the number of MII oocytes to produce one clinically usable blastocyst from ICSI and IVF procedures.

RESULTS

The results were  globally analyzed and according to ovarian stimulation protocol, infertility indication, and female age. The conventional KPI were online with the expected values from consensus references. From global results, 2.3 MII oocyte was needed to produce one clinically usable blastocyst after ICSI compared to 2.9 MII oocytes in IVF. On the same way, more blastocysts for clinical use were produced from fewer MII oocytes in ICSI compared to IVF in all sub-groups.

CONCLUSIONS

In split insemination treatments, the yield of clinically usable blastocysts was always superior in ICSI compared to IVF. The new KPI "number of needed oocytes to produce one clinically usable embryo" tests the clinical efficiency of the IVF laboratory.

The Maribor consensus: report of an expert meeting on the development of performance indicators for clinical practice in ART

STUDY QUESTION

Is it possible to define a set of performance indicators (PIs) for clinical work in ART, which can create competency profiles for clinicians and for specific clinical process steps?

SUMMARY ANSWER

The current paper recommends six PIs to be used for monitoring clinical work in ovarian stimulation for ART, embryo transfer, and pregnancy achievement: cycle cancellation rate (before oocyte pick-up (OPU)) (%CCR), rate of cycles with moderate/severe ovarian hyperstimulation syndrome (OHSS) (%mosOHSS), the proportion of mature (MII) oocytes at ICSI (%MII), complication rate after OPU (%CoOPU), clinical pregnancy rate (%CPR), and multiple pregnancy rate (%MPR).

WHAT IS KNOWN ALREADY

PIs are objective measures for evaluating critical healthcare domains. In 2017, ART laboratory key PIs (KPIs) were defined.

STUDY DESIGN SIZE DURATION

A list of possible indicators was defined by a working group. The value and limitations of each indicator were confirmed through assessing published data and acceptability was evaluated through an online survey among members of ESHRE, mostly clinicians, of the special interest group Reproductive Endocrinology.

PARTICIPANTS/MATERIALS SETTING METHODS

The online survey was open for 5 weeks and 222 replies were received. Statements (indicators, indicator definitions, or general statements) were considered accepted when ≥70% of the responders agreed (agreed or strongly agreed). There was only one round to seek levels of agreement between the stakeholders.Indicators that were accepted by the survey responders were included in the final list of indicators. Statements reaching less than 70% were not included in the final list but were discussed in the paper.

MAIN RESULTS AND THE ROLE OF CHANCE

Cycle cancellation rate (before OPU) and the rate of cycles with moderate/severe OHSS, calculated on the number of started cycles, were defined as relevant PIs for monitoring ovarian stimulation. For monitoring ovarian response, trigger and OPU, the proportion of MII oocytes at ICSI and complication rate after OPU were listed as PIs: the latter PI was defined as the number of complications (any) that require an (additional) medical intervention or hospital admission (apart from OHSS) over the number of OPUs performed. Finally, clinical pregnancy rate and multiple pregnancy rate were considered relevant PIs for embryo transfer and pregnancy. The defined PIs should be calculated every 6 months or per 100 cycles, whichever comes first. Clinical pregnancy rate and multiple pregnancy rate should be monitored more frequently (every 3 months or per 50 cycles). Live birth rate (LBR) is a generally accepted and an important parameter for measuring ART success. However, LBR is affected by many factors, even apart from ART, and it cannot be adequately used to monitor clinical practice. In addition to monitoring performance in general, PIs are essential for managing the performance of staff over time, and more specifically the gap between expected performance and actual performance measured. Individual clinics should determine which indicators are key to the success in their organisation based on their patient population, protocols, and procedures, and as such, which are their KPIs.

LIMITATIONS REASONS FOR CAUTION

The consensus values are based on data found in the literature and suggestions of experts. When calculated and compared to the competence/benchmark limits, prudent interpretation is necessary taking into account the specific clinical practice of each individual centre.

WIDER IMPLICATIONS OF THE FINDINGS

The defined PIs complement the earlier defined indicators for the ART laboratory. Together, both sets of indicators aim to enhance the overall quality of the ART practice and are an essential part of the total quality management. PIs are important for education and can be applied during clinical subspecialty.

STUDY FUNDING/COMPETING INTERESTS

This paper was developed and funded by ESHRE, covering expenses associated with meetings, literature searches, and dissemination. The writing group members did not receive payment.Dr G.G. reports personal fees from Merck, MSD, Ferring, Theramex, Finox, Gedeon-Richter, Abbott, Biosilu, ReprodWissen, Obseva, PregLem, and Guerbet, outside the submitted work. Dr A.D. reports personal fees from Cook, outside the submitted work; Dr S.A. reports starting a new employment in May 2020 at Vitrolife. Previously, she has been part of the Nordic Embryology Academic Team, with meetings were sponsored by Gedeon Richter. The other authors have no conflicts of interest to declare.

DISCLAIMER

This document represents the views of ESHRE, which are the result of consensus between the relevant ESHRE stakeholders and where relevant based on the scientific evidence available at the time of preparation.The recommendations should be used for informational and educational purposes. They should not be interpreted as setting a standard of care, or be deemed inclusive of all proper methods of care nor exclusive of other methods of care reasonably directed to obtaining the same results. They do not replace the need for application of clinical judgment to each individual presentation, nor variations based on locality and facility type.Furthermore, ESHREs recommendations do not constitute or imply the endorsement, recommendation, or favouring of any of the included technologies by ESHRE.

Adjuvant Vaginal Use of Sildenafil Citrate in a Hormone Replacement Cycle Improved Live Birth Rates Among 10,069 Women During First Frozen Embryo Transfers

Purpose

To investigate the effects of sildenafil citrate (SC) on live birth rates (LBR) during women undergoing their first frozen embryo transfers (FET) with hormone replacement therapy (HRT).

Patients and Methods

This retrospective cohort study included a total of 10,069 infertile women with adequate endometrial thickness (≥7 mm when progesterone was initiated) in their first FET cycle with hormone replacement therapy. Women received either vaginal SC or no adjuvant during their first transfer cycle depending on patient or physician preference. In the sildenafil group, 1098 women underwent HRT FET with adjuvant vaginal use of SC, and 8971 women were included as controls. The primary outcome measure was LBR, defined as the likelihood of live birth per transfer cycle. Endometrial thickness (EMT), implantation, chemical pregnancy, clinical pregnancy, miscarriage, ongoing pregnancy, birth weight and preterm delivery (PTB) were also recorded.

Results

Baseline characteristics were comparable between the two groups. In the crude analysis, the unadjusted LBR was significantly higher in the vaginal SC group (scHRT-FET) than in the control group (HRT-FET) (40.3% vs 36.1%). After adjustment for 12 pregnancy-related confounding factors, logistic regression analysis showed that LBR remained significantly higher in the scHRT-FET group than in the HRT-FET group (adjusted odds ratio [aOR] 1.31, 95% confidence interval [CI] 1.14–1.49). Furthermore, after adjustment, the ongoing pregnancy rate was significantly higher (aOR 1.29, 95% CI 1.13–1.47), and the miscarriage rate was significantly lower (aOR 0.58, 95% CI 0.43–0.77), in the scHRT-FET group compared to the HRT-FET group. Adjuvant vaginal use of SC did not increase the endometrial thickness and had no significant effect on birth weight or PTB.

Conclusion

Adjuvant vaginal use of SC in HRT FET was associated with higher LBR and improved pregnancy outcomes in an infertile population with adequate endometrial thickness. The beneficial effect of SC may be due not to an increase in EMT but instead to improve endometrial blood flow and receptivity, which might merit clinicians’ attention for improving general IVF practices.

Why are multiple pregnancy rates and single embryo transfer rates so different globally, and what do we do about it?

In the early years of in vitro fertilization, overall pregnancy rates were low, and it was considered necessary to transfer more than one embryo to increase the chances of pregnancy. It was not until advances in assisted reproductive technologies resulting in increased pregnancy rates that the concept of transferring just one embryo was considered possible. A consequence of improvements in implantation rates was also an increase in multiple pregnancies when more than one embryo was transferred. Although some countries have reduced the number of embryos transferred, international data show that in many parts of the world high twin and higher order multiple pregnancy rates still exist. Even in developed countries these problems persist depending on clinical practice, funding of health services, and patient demands. Perinatal and other outcomes are significantly worse with twins compared with singleton pregnancies and there is an urgent need to reduce multiple pregnancy rates to at least 10%. This has been achieved in several countries and clinics by introducing single embryo transfer but there are many barriers to the introduction of this technique in most clinics worldwide. We discuss the background to the high multiple rate in assisted reproduction and the factors that contribute to its persistence even in excellent clinics and in high-quality health services. Practices that may promote single embryo transfer are discussed.