Improvement in thyroid ultrasound report quality with radiologists' adherence to 2015 ATA or 2017 TIRADS: a population study

Quality Improvement Methodology to Improve Standardized Reporting of Pediatric Thyroid Ultrasounds Using TI-RADS

BACKGROUND/PURPOSE

The process of evaluating pediatric thyroid nodules at our institution was inconsistent with a high rate of negative biopsies raising concern of appropriate patient selection for biopsy. Our aim was to institute a standardized risk stratification reporting system for thyroid nodules to increase utilization and agreement of TI-RADS reporting at our institution.

METHODS

Radiology report data were collected and analyzed as part of a quality improvement project. A standardized TI-RADS dictation template was created, ultrasound technicians were trained, a multi-disciplinary conference initiated, and education provided for radiologists and clinicians. Control charts were used to track utilization and agreement of scoring of TI-RADS reporting based upon review by a radiologist trained in TI-RADS scoring.

RESULTS

From January 2019 to January 2021, 218 patients with a thyroid nodule had a thyroid ultrasound performed at our institution. TI-RADS was utilized in 0 % (0 of 57) of children in the four months prior to project initiation. Following creation of the template, utilization increased to 65 % (39 of 60) over 5 months. Utilization further increased after the first training conference and was maintained above 90 % for 13 months. Ultrasound reports were in agreement in 46.7 % (28 of 60) of children initially. Agreement in reporting improved to 71.4 % (10 of 14) in the 3 months following the first training and to 78.4 % (58 of 74) over 12 months. Agreement in reporting was maintained at 80 % in the following 6 months.

CONCLUSIONS

A quality improvement initiative can improve utilization and agreement of scoring using the TI-RADS system in pediatrics. This may ultimately reduce unnecessary biopsies and sedation in children.

LEVEL OF EVIDENCE

Level III.

TYPE OF STUDY

Quality Improvement.

Extracting Thyroid Nodules Characteristics from Ultrasound Reports Using Transformer-based Natural Language Processing Methods

The ultrasound characteristics of thyroid nodules guide the evaluation of thyroid cancer in patients with thyroid nodules. However, the characteristics of thyroid nodules are often documented in clinical narratives such as ultrasound reports. Previous studies have examined natural language processing (NLP) methods in extracting a limited number of characteristics (<9) using rule-based NLP systems. In this study, a multidisciplinary team of NLP experts and thyroid specialists, identified thyroid nodule characteristics that are important for clinical care, composed annotation guidelines, developed a corpus, and compared 5 state-of-the-art transformer-based NLP methods, including BERT, RoBERTa, LongFormer, DeBERTa, and GatorTron, for extraction of thyroid nodule characteristics from ultrasound reports. Our GatorTron model, a transformer-based large language model trained using over 90 billion words of text, achieved the best strict and lenient F1-score of 0.8851 and 0.9495 for the extraction of a total number of 16 thyroid nodule characteristics, and 0.9321 for linking characteristics to nodules, outperforming other clinical transformer models. To the best of our knowledge, this is the first study to systematically categorize and apply transformer-based NLP models to extract a large number of clinical relevant thyroid nodule characteristics from ultrasound reports. This study lays ground for assessing the documentation quality of thyroid ultrasound reports and examining outcomes of patients with thyroid nodules using electronic health records.

Implementation strategies to support ultrasound thyroid nodule risk stratification: A systematic review

BACKGROUND

Ultrasound risk stratification can improve the care of patients with thyroid nodules by providing a structured and systematic approach for the evaluation of thyroid nodule features and thyroid cancer risk. The optimal strategies to support implementation of high quality thyroid nodule risk stratification are unknown. This study seeks to summarise strategies used to support implementation of thyroid nodule ultrasound risk stratification in practice and their effects on implementation and service outcomes.

METHODS

This is a systematic review of studies evaluating implementation strategies published between January 2000 and June 2022 that were identified on Ovid MEDLINE, Ovid EMBASE, Ovid Cochrane, Scopus, or Web of Science. Screening of eligible studies, data collection and assessment for risk of bias was completed independently and in duplicate. Implementation strategies and their effects on implementation and service outcomes were evaluated and summarised.

RESULTS

We identified 2666 potentially eligible studies of which 8 were included. Most implementation strategies were directed towards radiologists. Common strategies to support the implementation of thyroid nodule risk stratification included: tools to standardise thyroid ultrasound reports, education on thyroid nodule risk stratification and use of templates/forms for reporting, and reminders at the point of care. System based strategies, local consensus or audit were less commonly described. Overall, the use of these strategies supported the implementation process of thyroid nodule risk stratification with variable effects on service outcomes.

CONCLUSIONS

Implementation of thyroid nodule risk stratification can be supported by development of standardised reporting templates, education of users on risk stratification and reminders of use at the point of care. Additional studies evaluating the value of implementation strategies in different contexts are urgently needed.

Improvement in neck ultrasound report quality following the implementation of European Thyroid Association guidelines for postoperative cervical ultrasound for thyroid cancer follow-up, a prospective population study

Objective

The aim of this study was to prospectively evaluate the quality of postoperative neck ultrasound (POU) for thyroid cancer patients after implementing European Thyroid Association (ETA) guideline-based POU assessment.

Methods

Our analysis involved 672 differentiated thyroid cancer patients. POU report quality was compared between the implementation radiology group (IRG), which implemented ETA guideline-based assessment in 2018, and all non-implementation radiology groups (NIRG). Differences in POU quality were evaluated before and after the implementation of guideline-based assessment. Additionally, we evaluated the ability of serum thyroglobulin (Tg) level <0.2 ng/mL or between 0.21 and 0.99 ng/mL and normal POU lesion status at 1-year follow-up to predict the absence of persistent disease or relapse at 3-year follow-up.

Results

IRG had significantly higher mean utility scores for POU reports of abnormal thyroid bed nodules compared to NIRG (P < 0.001). IRG's POU reports for suspicious nodules and lymph nodes were considered sufficient in 94% and 85% of cases, respectively, compared to 45% and 68% for NIRG. For patients with normal US lesion status and Tg <0.2 ng/mL or Tg 0.21-0.99 ng/mL at 1-year follow-up, the negative predictive values were 96% for both.

Conclusions

Implementation of 2013 ETA POU-reporting guidelines allowed for the provision of high-quality POU reports, which may lead to increased accuracy in assessing the response to treatment and in estimating the risk of recurrence of thyroid cancer and likely reduce unnecessary repeat POU or FNA.