Evaluation of an objective method of image assessment for first-trimester nasal bone

Image-scoring system for umbilical and uterine artery pulsed-wave Doppler ultrasound measurement

OBJECTIVES

To develop an objective image-scoring system for pulsed-wave Doppler measurement of maternal uterine and fetal umbilical arteries, and evaluate how this compares with subjective assessment.

METHODS

As an extension to the INTERGROWTH-21^st Project, we developed a scoring system based on six predefined criteria for uterine and umbilical artery pulsed-wave Doppler measurements. Objective evaluation using the scoring system was compared with subjective assessment which consisted of classifying an image as simply acceptable or unacceptable. Based on sample size estimation, a total of 120 umbilical and uterine artery Doppler images were selected randomly from the INTERGROWTH-21^st image database. Two independent reviewers evaluated all images in a blinded fashion, both subjectively and using the six-point scoring system. Percentage agreement and kappa statistic were compared between the two methods.

RESULTS

The overall agreement between reviewers was higher for objective assessment using the scoring system (agreement, 85%; adjusted kappa, 0.70) than for subjective assessment (agreement, 70%; adjusted kappa, 0.47). For the six components of the scoring system, the level of agreement (adjusted kappa) was 0.97 for anatomical site, 0.88 for sweep speed, 0.77 for magnification, 0.68 for velocity scale, 0.68 for image clarity and 0.65 for angle of insonation.

CONCLUSION

In quality assessment of umbilical and uterine artery pulsed-wave Doppler measurements, our proposed objective six-point image-scoring system is associated with greater reproducibility than is subjective assessment. We recommend this as the preferred method for quality control, auditing and teaching. Copyright © 2018 ISUOG. Published by John Wiley & Sons Ltd.

Quality control of ultrasound for fetal biometry: results from the INTERGROWTH-21st Project

OBJECTIVE

To assess a comprehensive package of ultrasound quality control in the Fetal Growth Longitudinal Study of the INTERGROWTH-21^st Project, a large multicenter study of fetal growth.

METHODS

Quality control (QC) measures were performed for 20 313 ultrasound scan images obtained prospectively from 4321 fetuses at 14-41 weeks' gestation in eight geographical locations. At the time of each ultrasound examination, three fetal biometric variables (head circumference (HC), abdominal circumference (AC) and femur length (FL)) were measured in triplicate on separately generated images. All measurements were taken in a blinded fashion. QC had two elements: (1) qualitative QC: visual assessment by sonographers at each study site of their images based on specific criteria, with 10% of images being re-assessed at the Oxford-based Ultrasound Quality Unit (compared using an adjusted kappa statistic); and (2) quantitative QC: assessment of measurement data by comparing the first, second and third measurements (intraobserver variability), remeasurement of caliper replacement in 10% (interobserver variability), both by Bland-Altman plots and plotting frequency histograms of the SD of triplicate measurements and assessing how many were above or below 2 SD of the expected distribution. The system allowed the sonographers' performances to be monitored regularly.

RESULTS

A high level of agreement between self- and external scoring was demonstrated for all measurements (κ = 0.99 (95% CI, 0.98-0.99) for HC, 0.98 (95% CI, 0.97-0.99) for AC and 0.96 (95% CI, 0.95-0.98) for FL). Intraobserver 95% limits of agreement (LoA) of ultrasound measures for HC, AC and FL were ± 3.3%, ± 5.6% and ± 6.2%, respectively; the corresponding values for interobserver LoA were ± 4.4%, ± 6.0% and ± 5.6%. The SD distribution of triplicate measurements for all biometric variables showed excessive variability for three of 31 sonographers, allowing prompt identification and retraining.

CONCLUSIONS

Qualitative and quantitative QC monitoring was feasible and highly reproducible in a large multicenter research study, which facilitated the production of high-quality ultrasound images. We recommend that the QC system we developed is implemented in future research studies and clinical practice. Copyright © 2017 ISUOG. Published by John Wiley & Sons Ltd.

Auditing fetal nasal bone images in the first trimester of pregnancy: results from a peer review program

OBJECTIVE

To establish a structured review process to facilitate the identification of the fetal nasal bone (NB) in the first trimester ultrasound scan to improve the quality images.

METHODS

We conducted a retrospective observational study in fetal NB images obtained during ultrasound exams of singleton pregnancies that underwent first trimester screening (crown-rump length 45-84 mm). When the images were obtained the examiner was not aware of the study. Audit was conducted by an examiner according criteria established by the Fetal Medicine Foundation. Fetal NB images were assessed regarding adequate magnification, mid-sagittal view and transducer held parallel to the direction of the nose. The transvaginal and transabdominal as well as anterior and posterior fetal back groups were compared using χ(2) test.

RESULTS

We considered 874 fetal NB images for auditing. Fetal NB was considered present in 865 images (99%). During the audit process, we identified 72 (8.2%) cases of disagreement between examiner and auditor assessments. Disagreement was higher when image quality was poor (62 cases = 7%). Transvaginal approach performed better in the following criteria: adequate magnification (p < 0.001), midline (p < 0.001) and completely adequate (p < 0.001).

CONCLUSION

A peer reviewed audit program for fetal NB is feasible in a clinical scenario. Image quality appears to play an important role in compliance to image standards audited and in agreement between examiner and auditor.

Image-scoring system for crown-rump length measurement

OBJECTIVE

To develop and evaluate an objective image-scoring system for crown-rump length (CRL) measurements and to determine how this compares with subjective assessment.

METHODS

A total of 125 CRL ultrasound images were selected from the database of the International Fetal and Newborn Growth Consortium for the 21(st) Century study group. Two reviewers, who were blinded to the operators' and to each others' results, evaluated all images both subjectively and objectively. Subjective evaluation consisted of rating an image as acceptable or unacceptable, while objective evaluation was based on six criteria. Reviewer differences for both the subjective and objective evaluations were compared using percentage of agreement and adjusted kappa values.

RESULTS

The distribution of individual scores and differences between subjective and objective evaluation for the two reviewers was similar. Overall agreement between the reviewers was higher for objective evaluation (95.2%; adjusted κ, 0.904), than for subjective evaluation (77.6%; adjusted κ, 0.552). There was a high level of agreement for horizontal position (κ = 0.951), magnification (κ = 0.919), visualization of crown and rump (κ = 0.806) and caliper placement (κ = 0.756), while agreement for mid-sagittal section (κ = 0.629) and neutral position (κ = 0.565) were moderate and poor, respectively.

CONCLUSION

The proposed six-point scoring system for CRL image rating is more reproducible than is subjective evaluation and should be considered as a method of quality assessment and audit.

Validation of first trimester screening for trisomy 21 in Singapore with reference to performance of nasal bone

INTRODUCTION

The aim of this study is to describe the performance of first trimester screening (FTS) for trisomy 21 using maternal age, serum biochemistry and fetal nuchal translucency (NT) in a single center and to evaluate the effect of nasal bone on screening performance.

MATERIAL AND METHODS

In 12,585 singleton pregnancies, the NT and nasal bone were examined. The majority of these mothers also had their serum biochemical markers analyzed. Risk was computed using different combinations of maternal age, biochemistry, NT and nasal bone. Down syndrome cases were confirmed by karyotyping.

RESULTS

There were 12,519 normal pregnancies, 31 with trisomy 21 and 35 with other chromosomal abnormalities. Without considering the nasal bone, the combined FTS detected 87.1% of trisomy 21 fetuses (false positive rate 5.1%), using 1:300 as the risk threshold, and this was further improved to 96.8% with the policy that classifies all fetuses with an absent nasal bone as high risk. Subgroup analysis showed that the detection rate would be 90.9%, with a false positive rate of 3.7%, if nasal bone was incorporated in the risk algorithm, compared to 81.8% and a false positive rate of 5.4% if it was not used.

DISCUSSION

FTS is very effective in early detection of trisomy 21 in Singapore. The nasal bone is a useful marker that can substantially improve the screening performance.