Monitoring Quality Control of Nuchal Translucency

United States' experience in nuchal translucency measurement: variation according to provider characteristics in over five million ultrasound examinations

OBJECTIVE

The Nuchal Translucency Quality Review (NTQR) program has provided standardized education, credentialing and epidemiological monitoring of nuchal translucency (NT) measurements since 2005. Our aim was to review the effect on NT measurement of provider characteristics since the program's inception.

METHODS

We evaluated the distribution of NT measurements performed between January 2005 and December 2019, for each of the three primary performance indicators of NT measurement (NT median multiples of the median (MoM), SD of log₁₀ NT MoM and slope of NT with respect to crown-rump length (CRL)) for all providers within the NTQR program with more than 30 paired NT/CRL results. Provider characteristics explored as potential sources of variability included: number of NT ultrasound examinations performed annually (annual scan volume of the provider), duration of participation in the NTQR program, initial credentialing by an alternative pathway, provider type (physician vs sonographer) and number of NT-credentialed providers within the practice (size of practice). Each of these provider characteristics was evaluated for its effect on NT median MoM and geometric mean of the NT median MoM weighted for the number of ultrasound scans, and multiple regression was performed across all variables to control for potential confounders.

RESULTS

Of 5 216 663 NT measurements from 9340 providers at 3319 sites, the majority (75%) of providers had an NT median MoM within the acceptable range of 0.9-1.1 and 85.5% had NT median MoM not statistically significantly outside this range. Provider characteristics associated with measurement within the expected range of performance included higher volume of NT scans performed annually, practice at a site with larger numbers of other NT-credentialed providers, longer duration of participation in the NTQR program and alternative initial credentialing pathway.

CONCLUSIONS

Annual scan volume, duration of participation in the NTQR program, alternative initial credentialing pathway and number of other NT-credentialed providers within the practice are all associated with outcome metrics indicating quality of performance. It is critical that providers participate in ongoing quality assessment of NT measurement to maintain consistency and precision. Ongoing assessment programs with continuous feedback and education are necessary to maintain quality care. © 2021 International Society of Ultrasound in Obstetrics and Gynecology.

Real-time quality control of nuchal translucency measurements using the exponentially weighted moving average chart

OBJECTIVE

The establishment of ongoing audits for first-trimester nuchal translucency (NT) measurements is of paramount importance. The exponentially weighted moving average (EWMA) chart has been published as an efficient tool for NT quality control with the advantages of being suitable for real-time long-term monitoring. This study aimed to assess the efficacy of real-time NT quality control using EWMA charts.

MATERIALS AND METHODS

This was an ongoing prospective study conducted from January 2011 to December 2017 at the Centre for Fetal Medicine Gennet in Prague. The quality of NT measurements was assessed using the NT retrospective distribution parameters and EWMA charts, and the results were presented to the sonographers during collective meetings.

RESULTS

Overall, 28,928 NT measurements obtained from six sonographers were eligible for the study. Looking at individual EWMA charts, we observed four main outcomes. First, there was a clear improvement in the performance of sonographers with initially poor performances. Second, the performance of sonographers with an initially satisfactory quality was maintained. Third, there was an observed deterioration of the performance without the audits. Last, the sonographers appreciated an unequivocal and straightforward graphical presentation of EWMA curves.

CONCLUSION

EWMA proved to be an efficient and suitable tool for real-time monitoring of NT quality and led to an overall improvement of the sonographers' performance.

Quality control of ultrasonography markers for Down's syndrome screening: a retrospective study by the laboratory

OBJECTIVES

Quality control of ultrasonography markers is necessary to ensure greater efficacy of prenatal aneuploidy screening. The aim of this study was to assess the quality of the crown-rump length (CRL) and nuchal translucence (NT) measurement accuracy by the laboratory according to quality indicators.

METHODS

Retrospective observational study on 4,908 single-foetus pregnant women who underwent prenatal aneuploidy screening in the first trimester of pregnancy. Euploid foetuses with CRL between 45 and 84 mm were included, while those with NT≥3.5 mm were excluded. CRL measurement was considered to be accurate if the median multiples of the median (MoM) for pregnancy-associated plasma protein A (PAPP-A) was between 0.90 and 1.10. Fifteen sonographers participated in the study, six of whom comprised the control group. Systematic error for a sonographer was considered when CRL measurement was greater than ±2 mm with respect to the control group. Quality for NT was assured by means of the WHIRI method and each sonographer cumulative sum control chart (CUSUM).

RESULTS

For CRL accuracy, five sonographers underestimated the measurements, while another four overestimated them, with no statistical differences. For smaller sized foetuses, all sonographers met the established specifications. Regarding NT control, three sonographers did not meet the quality criteria for the median MoM. All sonographers met the specifications for the logarithmic standard deviation of the NT MoM levels. Thirteen sonographers met the CUSUM specifications.

CONCLUSIONS

Evaluation of a quality control of ultrasonography parameters by laboratory professionals is necessary to avoid under- or overestimation tendencies for CRL and NT measurements. CUSUM is a useful tool for the immediate correction of errors in NT measurements.

Sonologist's characteristics related to a higher quality in fetal nuchal translucency measured in primary antenatal care centers

OBJECTIVE

To assess the quality of nuchal translucency (NT) measurements in primary care and the sonologist's characteristics related with a higher quality.

METHODS

The median NT expressed in multiples of the median (MoM) was calculated for each sonologist of 14 participating antenatal primary care centers of the Catalan Institute of Health. A survey to the sonologists was used to establish variables related to higher-quality measurements.

RESULTS

The median NT MoM obtained in 16 448 NT measurements, performed by 102 sonologists, was 0.94 MoM. NT underestimation was observed in 46% of the sonologists. Underestimation were less frequent among professionals who performed more than 230 ultrasounds per year (26% vs 53%;p = .022), those who completed the online Fetal Medicine Foundation (FMF) course (22% vs 54%; p = .021), and those who were subject to periodic audits (24% vs 56%; p = .021). Underestimation rate decreased from 60%, to 33% and 14% with the increase of the years of experience from less than 5 years, to 6 to 15 years and more than 15 years of experience, respectively (p = .029).

CONCLUSIONS

Higher-quality measurements were demonstrated in sonologists who performed more ultrasounds per year, those with more years of scanning experience, those who completed the online FMF course, and those periodically audited.

Impact of a shift in nuchal translucency measurements on the detection rate of first-trimester Down syndrome screening: A population-based study

OBJECTIVE

To assess the distribution of nuchal translucency (NT) measurements following a national policy without credentialing and its impact on first-trimester Down syndrome screening (DSS) detection rate.

METHOD

All first-trimester DSS data recorded in France (2010-2014) were collected by the laboratories in charge via an Internet database (https://www.bionuqual.org/echo.php). There was no minimal requirement for image quality to allow sonographers to enter the screening process. A subgroup of DSS with complete DS follow-up corresponded to 1614 sonographers. Based on the distribution of maternal age, DS detection rate was calculated and split as a function of the distribution of NT multiple of the median (MoM).

RESULTS

Four thousand nine hundred forty-three sonographers performed 2,337,372 NT measurements. Median NT expressed in MoM was 0.83. Screenings with complete follow-up consisted of 197,417 screenings, in which DSS detection rates were respectively 70.4%, 70.9%, 79.4%, 87.7%, and 79.5% for the following median NT MoM ranges: <0.7, 0.70 to 0.79, 0.80 to 0.89, 0.90 to 0.99, and >0.99 (trend χ = 12.21; P = .0158).

CONCLUSION

In France, following a policy of quality assessment without standardized credentialing, the distribution of NT measurements did not fit the expected distribution. Down syndrome detection rate was 10% lower in screenings by sonographers with a median NT < 0.80 MoM.

Comparing outcomes and costs between contingent and combined first-trimester screening strategies for Down's syndrome

OBJECTIVE

To compare a contingent strategy with a combined strategy for prenatal detection of Down's syndrome (DS) in terms of cost, outcomes and safety.

STUDY DESIGN

The contingent strategy was based on a simulation, removing measurement of the free beta subunit of human chorionic gonadotropin (free βhCG) and calculating the DS risk retrospectively in 32,371 pregnant women who had been screened with the combined strategy in the first trimester. In the contingent strategy, a risk between 1:31 and 1:1000 in the first trimester indicated further testing in the second trimester (alpha-fetoprotein, inhibin A, unconjugated oestriol and free βhCG). The cut-off risk values for the contingent and combined strategies in the first trimester were 1:30 and 1:250, respectively, and the cut-off risk value for integrated screening in the second trimester was 1:250. Costs were compared in terms of avoided DS births, and the ratio of loss of healthy fetuses following invasive procedures per avoided DS birth was calculated.

RESULTS

The combined strategy had sensitivity of 40/44 (90.9%) and a false-positive rate of 2.8%. Corresponding values for the contingent strategy were 39/44 (88.6%) and 1.3%, respectively. Only 11% of pregnant women required tests in the second trimester, and the approximate cost reduction for each avoided DS birth was 5000€. The ratio of lost healthy fetuses following invasive procedures per avoided DS birth improved by up to 0.65.

CONCLUSION

The contingent strategy has similar effectiveness to the combined strategy, but has lower costs and fewer invasive procedures.

Nuchal Translucency Quality Review (NTQR) program: first one and half million results

OBJECTIVE

To evaluate the performance of first-trimester nuchal translucency (NT) measurement by providers (physician-sonologists and sonographers) within the Nuchal Translucency Quality Review (NTQR) program.

METHODS

After training and credentialing providers, the NTQR monitored performance of NT measurement by the extent to which an individual's median multiple of the normal median (MoM) for crown-rump length (CRL) was within the range 0.9-1.1 MoM of a published normal median curve. The SD of log10 MoM and regression slope of NT on CRL were also evaluated. We report the distribution between providers of these performance indicators and evaluate potential sources of variation.

RESULTS

Among the first 1.5 million scans in the NTQR program, performed between 2005 and 2011, there were 1 485 944 with CRL in the range 41-84 mm, from 4710 providers at 2150 ultrasound units. Among the 3463 providers with at least 30 scans in total, the median of the providers' median NT-MoMs was 0.913. Only 1901 (55%) had a median NT-MoM within the expected range; there were 89 above 1.1 MoM, 1046 at 0.8-0.9 MoM, 344 at 0.7-0.8 MoM and 83 below 0.7 MoM. There was a small increase in the median NT-MoM according to providers' length of time in the NTQR program and number of scans entered annually. On average, physician-sonologists had a higher median NT-MoM than did sonographers, as did those already credentialed before joining the program. The median provider SD was 0.093 and the median slope was 13.5%. SD correlated negatively with the median NT-MoM (r = -0.34) and positively with the slope (r = 0.22).

CONCLUSION

Even with extensive training, credentialing and monitoring, there remains considerable variability between NT providers. There was a general tendency towards under-measurement of NT compared with expected values, although more experienced providers had performance closer to that expected.

The clinical practice patterns of fetal ultrasonography in the first-trimester: A questionnaire survey of members of the Korean Society of Ultrasound in Obstetrics and Gynecology

Objective

This study aimed to survey the current clinical practice of first-trimester ultrasonography among members of the Korean Society of Ultrasound in Obstetrics and Gynecology (KSUOG) and to provide basic data for making practical recommendations about first-trimester ultrasonography scan in Korea.

Methods

This survey was conducted using a self-administered anonymous questionnaire. The first-trimester in this survey was divided into two parts: early and late first-trimester. The survey was focused on safety issue, nuchal translucency (NT) cutoff, the anatomic structures they check, and the need for practical recommendations or educational courses during the first-trimester.

Results

During the study period, 194 KSUOG members participated into this survey. The survey on early first-trimester scan reveal that 173 (89.2%) of respondents had used pulsed-wave Doppler or color Doppler imaging to monitor fetal heart beat. For the late first-trimester scan, 145 (74.7%) of respondents was found to check for fetal anatomical assessments during their NT screening performance; however, the clinical practice patterns were considerably varied among participants. More than half of the respondents used the criterion of NT ≥3.0 mm to define increased NT. Approximately 80% of respondents stated that the screening ultrasonography of fetal structures in the first-trimester was necessary. Furthermore, 187 (96.4%) of respondents were in favor of a recommendation for first-trimester ultrasonography in Korea.

Conclusion

This is the first survey of the current clinical practice of first-trimester ultrasonography in Korea. Our survey findings highlight the need for the practical recommendation or educational course for first-trimester ultrasonography.

Impact of nuchal translucency credentialing by the FMF, the NTQR or both on screening distributions and performance

OBJECTIVE

In the USA, both The Fetal Medicine Foundation (FMF) and the Nuchal Translucency Quality Review Program (NTQR) have operated education, review and credentialing for physicians and sonographers for the measurement of nuchal translucency (NT). We sought to assess differences in the distribution of NT measurements based upon the system from which the operator obtained their education, review and credentialing.

METHODS

398 311 NT measurements by 1541 sonographers who had performed ≥ 50 exams from July 2008 to June 2010 were grouped by organization. Differences between grouped measurements were assessed using analysis of variance of log(10) NT multiples of the median (MoM), with sonographer and organization as factors.

RESULTS

MoM values were significantly lower (P ≤ 0.001) and SD was significantly higher (P < 0.001) for the NTQR group compared with the FMF group or those sonographers credentialed by both. The percentage of individuals with negative bias ≥ 10% was greater for the NTQR group (P < 0.001). The difference was less but still significant (P = 0.009) when bias was adjusted for by the overall median for the organization.

CONCLUSIONS

Although NT MoM measurements were significantly lower and had a wider variance when obtained by the NTQR group, our data cannot distinguish between bias in training or the attributes of the participating sonographers in each program. With these large numbers, it is unlikely that patient characteristics could explain the discrepancy in distributions. Ongoing efforts to monitor sonographer performance with remediation for poor performers may reduce discrepancies between organizations.