Assessment of sonographer nuchal translucency measurement performance – central tendency and dispersion

A Pain in the Neck: Lessons Learnt from Genetic Testing in Fetuses Detected with Nuchal Fluid Collections, Increased Nuchal Translucency versus Cystic Hygroma-Systematic Review of the Literature, Meta-Analysis and Case Series

Fetal Nuchal fluid collections can manifest with two distinct presentations attributable to the same phenotypic spectrum: increased nuchal translucency (iNT) and cystic hygroma. The prenatal detection of these findings should prompt an accurate assessment through genetic counseling and testing, including karyotype, chromosomal microarray analysis (CMA) and multigene RASopathy panel. We performed a systematic review of the literature and meta-analysis, to calculate diagnostic yields of genetic testing in fetuses with iNT and cystic hygroma. We compared the results with a cohort of 96 fetuses with these isolated findings. Fetuses with isolated NT ≥ 2.5 mm showed karyotype anomalies in 22.76% of cases and CMA presented an incremental detection rate of 2.35%. Fetuses with isolated NT ≥ 3 mm presented aneuploidies in 14.36% of cases and CMA had an incremental detection rate of 3.89%. When the isolated NT measured at least 3.5 mm the diagnostic yield of karyotyping was 34.35%, the incremental CMA detection rate was 4.1%, the incremental diagnostic rate of the RASopathy panel was 1.44% and it was 2.44% for exome sequencing. Interestingly, CMA presents a considerable diagnostic yield in the group of fetuses with NT ≥ 3.5 mm. Similarly, exome sequencing appears to show promising results and could be considered after a negative CMA result.

Impact of replacing or adding pregnancy-associated plasma protein-A at 11-13 weeks on screening for preterm pre-eclampsia

OBJECTIVE

To assess whether pregnancy-associated plasma protein-A (PAPP-A) alters or provides equivalent screening performance as placental growth factor (PlGF) when screening for preterm pre-eclampsia (PE) at 11-13 weeks of gestation.

METHODS

This was a secondary analysis of a non-intervention screening study of 6546 singleton pregnancies that were screened prospectively for preterm PE in the first trimester between December 2016 and June 2018. Patient-specific risks for preterm PE were estimated by maternal history, mean arterial pressure (MAP), uterine artery pulsatility index (UtA-PI), PlGF and PAPP-A. A competing-risks model with biomarkers expressed as multiples of the median was used. All women and clinicians were blinded to the risk for preterm PE. The performance of screening for preterm PE using PlGF vs PAPP-A vs both PAPP-A and PlGF was assessed by comparing areas under the receiver-operating-characteristics (AUC) curves. McNemar's test was used to compare detection rate at a fixed false-positive rate (FPR) of 10%.

RESULTS

PlGF and PAPP-A were measured in 6546 women, of whom 37 developed preterm PE. The AUC and detection rate at 10% FPR using PlGF in combination with maternal history, MAP and UtA-PI were 0.854 and 59.46%, respectively. The respective values were 0.813 and 51.35% when replacing PlGF with PAPP-A and 0.855 and 59.46% when using both PAPP-A and PlGF. Statistically non-significant differences were noted in AUC when replacing PlGF with PAPP-A (ΔAUC, 0.04; P = 0.095) and when using both PAPP-A and PlGF (ΔAUC, 0.002; P = 0.423). However, on an individual case basis, screening using PlGF in conjunction with maternal history, MAP and UtA-PI identified three (8.1%) additional pregnancies that developed preterm PE and that were not identified when replacing PlGF with PAPP-A. Screening using PAPP-A in addition to maternal history and other biomarkers did not identify any additional pregnancies.

CONCLUSION

On an individual case basis, adoption of a screening strategy that uses PAPP-A instead of PlGF results in reduced detection of preterm PE, consistent with previous literature. © 2022 International Society of Ultrasound in Obstetrics and Gynecology.

United States' experience in nuchal translucency measurement: variation according to provider characteristics in over five million ultrasound examinations

OBJECTIVE

The Nuchal Translucency Quality Review (NTQR) program has provided standardized education, credentialing and epidemiological monitoring of nuchal translucency (NT) measurements since 2005. Our aim was to review the effect on NT measurement of provider characteristics since the program's inception.

METHODS

We evaluated the distribution of NT measurements performed between January 2005 and December 2019, for each of the three primary performance indicators of NT measurement (NT median multiples of the median (MoM), SD of log₁₀ NT MoM and slope of NT with respect to crown-rump length (CRL)) for all providers within the NTQR program with more than 30 paired NT/CRL results. Provider characteristics explored as potential sources of variability included: number of NT ultrasound examinations performed annually (annual scan volume of the provider), duration of participation in the NTQR program, initial credentialing by an alternative pathway, provider type (physician vs sonographer) and number of NT-credentialed providers within the practice (size of practice). Each of these provider characteristics was evaluated for its effect on NT median MoM and geometric mean of the NT median MoM weighted for the number of ultrasound scans, and multiple regression was performed across all variables to control for potential confounders.

RESULTS

Of 5 216 663 NT measurements from 9340 providers at 3319 sites, the majority (75%) of providers had an NT median MoM within the acceptable range of 0.9-1.1 and 85.5% had NT median MoM not statistically significantly outside this range. Provider characteristics associated with measurement within the expected range of performance included higher volume of NT scans performed annually, practice at a site with larger numbers of other NT-credentialed providers, longer duration of participation in the NTQR program and alternative initial credentialing pathway.

CONCLUSIONS

Annual scan volume, duration of participation in the NTQR program, alternative initial credentialing pathway and number of other NT-credentialed providers within the practice are all associated with outcome metrics indicating quality of performance. It is critical that providers participate in ongoing quality assessment of NT measurement to maintain consistency and precision. Ongoing assessment programs with continuous feedback and education are necessary to maintain quality care. © 2021 International Society of Ultrasound in Obstetrics and Gynecology.

Intracranial translucency as a sonographic marker for detecting open spina bifida at 11-13+6 weeks scan: Our experience

Aims and Objectives

The fourth ventricle, seen as intracranial translucency (IT) at 11-13⁺⁶ weeks, has been reported to be obliterated in cases of open spina bifida (OSB). Our aim was to assess its role in detecting OSB at 11-13⁺⁶ weeks.

Materials and Methods

This prospective study was conducted at foetal medicine unit from January 2014 to June 2015. All women who underwent both first and mid-trimester scan in our unit were included in the study. IT was categorized as normal, obliterated or not clear. Spine was examined during both scans.

Results

Totally, 341 cases were included in the study. IT was found to be obliterated in four cases and not clear in one case. There was demonstrable OSB at 11-13⁺⁶ weeks in two cases, at 15-16 weeks in two cases and at 24 weeks in one case. In the remaining 336 cases with normal IT, spine was found to be normal at target scan.

Conclusion

Mid-sagittal view of face that is routinely used to measure nuchal translucency (NT) can also be used to detect OSB. It is feasible to integrate IT into the routine 11-13⁺⁶ weeks scan.

Impact of replacing or adding placental growth factor on Down syndrome screening: A prospective cohort study

OBJECTIVES

To assess whether adding placental growth factor (PlGF) or replacing pregnancy-associated plasma protein-A (PAPP-A) improves the first trimester combined test performance for trisomy 21.

METHODS

A total of 11,518 women with a singleton pregnancy who underwent the first trimester combined test between December 2016 and December 2019 were included. PlGF was measured and estimated term risk for trisomy 21 was calculated by (1) adding PlGF to the combined test and (2) replacing PAPP-A with PlGF.

RESULTS

Twenty-nine pregnancies had trisomy 21. The combined tests detection rate (DR), false positive rate (FPR) and screen positive rate (SPR) were 89.7%, 5.7% and 6% respectively. DR when adding PlGF to the combined test or replacing PAPP-A remained unchanged. Replacing PAPP-A by PlGF increased FPR and SPR to 6.2% and 6.4% respectively. Adding PlGF to the combined test gave FPR and SPR rates of 5.5% and 5.7% respectively. Change in FPR and SPR was not significant (p > 0.1 for all).

CONCLUSION

Adding PlGF to the combined test or replacing PAPP-A with PlGF did not improve trisomy 21 DR and resulted in a non-significant marginal change in FPR and SPR.

Developing a quality assurance program for transvaginal cervical length measurement at 18-21 weeks' gestation

BACKGROUND

Preterm birth is the leading cause of death in children under the age of five years. Transvaginal cervical length (TVCL) assessment can be used to predict preterm delivery risk at the mid-trimester scan. To optimise the screening tool, developing and maintaining quality standards is important.

AIMS

To develop an Australian reference range for TVCL at 18.0-21.0 weeks' gestation, quality standards for measurement and audit mechanisms for ultrasound operators.

MATERIALS AND METHODS

A retrospective audit was performed of consecutive patients scanned at 18.0-21.0 weeks' gestation. Each TVCL measurement ultrasound image was reviewed, and exclusions were made based on a defined set of quality criteria. Fractional polynomial Bayesian methodology was used to establish a reference range. Central tendency, dispersion plots and cumulative sum charts for operators in the original reference range cohort were created. These plots were then applied to a second validation cohort of operators to establish the efficacy of this quality assurance audit tool.

RESULTS

Median TVCL from 1031 participants was 36.0 mm (interquartile range 32.7-40.0 mm), which was independent of gestational age. The quality audit tool was applied to 15 operators from the reference cohort with a mean cervix length multiple of the median of 1.01 and a mean SD log10 cervix length multiple of the median of 0.06. Of the 22 operators in the validation cohort, 20 (90.9%) demonstrated ideal or acceptable central tendency results, and 19 (86.4%) remained in the appropriate cumulative sum zone.

CONCLUSION

An Australian cervix length measurement reference range at 18.0-21.0 weeks' gestation has been developed along with a validated quality assurance audit tool for ultrasound operators.

Transverse technique: complementary approach to measurement of first-trimester uterine artery Doppler

OBJECTIVES

To define a protocol for the first-trimester assessment of uterine artery pulsatility index (UtA-PI) using the new transverse technique, to evaluate UtA-PI measured using the transverse approach vs that obtained using the conventional sagittal approach and to determine if accelerated onsite training (in both methods) of inexperienced sonographers can achieve reproducible UtA-PI measurements comparable with those obtained by an experienced sonographer.

METHODS

This was a prospective observational study of women with a singleton pregnancy attending for routine combined first-trimester screening at 11 to 13 + 6 weeks' gestation. The study consisted of two parts, each conducted at a different center (Part 1 in Calgary, Canada and Part 2 in Hong Kong). In Part 1, UtA-PI measurements were performed using the transverse and sagittal techniques by four sonographers trained in both methods, in 10 cases each, and measurement indices (PI), time required and subjective difficulty in obtaining satisfactory measurements were compared. The one sample t-test and Wilcoxon signed rank test were used when appropriate. Bland-Altman plots were used to assess measurement agreement, and intraclass correlation coefficient (ICC) was used to evaluate measurement reliability. A target plot was used to assess measures of central tendency and dispersion. In Part 2, one experienced and three inexperienced sonographers prospectively measured UtA-PI using both approaches in 42 and 35 women, respectively. Inexperienced sonographers underwent accelerated onsite training by the experienced sonographer. Measurement approach and sonographer order were on a random basis. ICC, Bland-Altman and Passing-Bablok analyses were performed to assess measurement agreement and reliability and effect of accelerated training.

RESULTS

In Part 1, no difference was observed between the two techniques in mean time to acquire the measurements (118 s for sagittal vs 106 s for transverse; P = 0.38). The four sonographers reported that the transverse technique was subjectively easier to perform (P = 0.04). Bias and ICC for mean UtA-PI between sagittal and transverse measurements were -0.05 (95% limits of agreement, -0.48 to 0.37) and 0.94, respectively. Measurements obtained using the transverse technique after correcting for gestational age were significantly closer to the expected distribution than those obtained using the sagittal technique. In Part 2, there were no significant differences in median UtA-PI measured using the different approaches for both experienced and inexperienced sonographers (P > 0.05 for all sonographers). Mean UtA-PI measurement reliability between approaches was high for the experienced (ICC = 0.92) and inexperienced (ICC > 0.80) sonographers. UtA-PI measurement approaches did not deviate from linearity, while bias ranged from -0.10 to 0.07. The median time required was similar between the techniques (56.1 s for sagittal vs 49.3 s for transverse; P = 0.054).

CONCLUSIONS

This novel transverse approach for the measurement of UtA-PI in the first trimester appears to be comparable with the sagittal approach in terms of reliability, reproducibility and time required, and may be easier to perform. Providing accelerated onsite training can be helpful for improving the reliability of UtA-PI measurements and could potentially facilitate the broad implementation of first-trimester pre-eclampsia screening. Copyright © 2017 ISUOG. Published by John Wiley & Sons Ltd.

Assessing quality standards in measurement of uterine artery pulsatility index at 11 to 13 + 6 weeks' gestation

OBJECTIVES

To assess the effect of audit and feedback on the performance of first-trimester uterine artery pulsatility index (UtA-PI) measurement, to determine whether operator experience affects performance and whether an operator's measurement profile affects the screen-positive rate for early-onset pre-eclampsia (PE).

METHODS

This was a prospective cohort study in which UtA-PI measurements were collected between 11 to 13 + 6 weeks' gestation by 12 operators and were entered into individualized calculators to convert them to multiples of a locally-derived median (MoM). Individual sonographer cumulative sum (CUSUM) and target charts were generated to assess central tendency and dispersion to identify systematic measurement errors and deviation from expected measurement performance. Six of the operators received regular feedback whilst the remaining six received no feedback. Each group consisted of four experienced operators and two relatively inexperienced operators. The average MoM for each operator was compared with their respective screen-positive rates for early-onset PE.

RESULTS

The group that received feedback performed better than that which received none, with results more closely matching the expected measurement distribution. UtA-PI measurements were comparable between the experienced and inexperienced sonographers (mean log10 lowest PI MoM, -0.0089 vs 0.0124, respectively); however the inexperienced sonographers had a higher overall screen-positive rate for early-onset PE (10.0% vs 2.7%, respectively). There was a significant positive correlation between the mean MoM for each operator and the screen-positive rate (r = 0.63).

CONCLUSIONS

CUSUM and target graphs are an effective method of audit for first-trimester UtA-PI measurement. Feedback to operators resulted in improved measurement performance, which will ultimately result in improved screening accuracy for PE.

Analysis of quality of nuchal translucency measurements: its role in prenatal diagnosis

Objective. Quantitative analysis of the quality of nuchal translucency (NT) measurements. Methods. First-trimester combined screening for Down syndrome was performed to all pregnant women attended in our Department from October 2003 to November 2009. NT was measured according to the Fetal Medicine Foundation (FMF) criteria by 20 trained obstetricians. The performance of NT measurements was retrospectively analyzed with regard to several quality control standards. Accuracy according to experience, professional profile, crown rump length (CRL) values, and FMF certification was statistically tested. Results. A total of 14978 NT measurements were assessed. (1) The mean operator-specific median NT-MoM values was 0,98. (2) Mean percentage of cases >95th and <5th centiles were 5,0% and 4,2%, respectively. (3) Logarithmic mean and SD of the NT MoM values were 0,00 and 0,13, respectively. (4) The DR for trisomy 21 at screening time was 90,7% for a FPR of 6,7% for standard screening strategy. (5) According to Cumulative SUM (CUSUM) figures, the performance was more acceptable in FMF-certified operators. Conclusion. Overall, quality standards show optimal NT measurements in our unit. Operator experience, a dedicated profile to fetal medicine, CRL over 60 mm, and FMF certification have a significant positive impact on the quality standards.