Evaluation of optimal education level to implement structured reporting into ultrasound training

"3 + X D" structured report in radiology standardized resident training: Can it meet high-level teaching objectives?

PURPOSE

To evaluate the impact of the innovative "3 + X D" structured report (SR) designed based on Bloom's taxonomy on the learning outcomes of radiology residents during standardized training.

METHODS

This is a prospective study that recruited 120 radiology residents from our hospital between 2020 and 2022. Randomly selected 60 residents from the 2020 grade to constituted the control group, and randomly selected 60 residents from the 2021 grade to formed the experimental group. The former group was trained utilizing the Free-text Reports (FTR) template, while the latter group received training with the "3 + X D" structured reports (SR) template. The learning outcomes of both groups was evaluated utilizing both objective and subjective measures. Objective assessments encompassed examinations of theoretical knowledge, diagnostic skills, and total scores, aligning with the cognitive domains of remembering, understanding, applying, and analyzing as outlined by Bloom's Taxonomy. Subjective assessments, on the other hand, comprised survey questionnaires administered to residents and feedback from clinical instructors, which correlated with the higher-order cognitive level of analyzing, evaluating, and creating within Bloom's Taxonomy.

RESULTS

On 60 residents (mean age, 24.15 years ± 2.11[SD]; 25 male) from control group, and 60 residents (mean age, 24.58 years ± 1.88 [SD]; 27 male) from experimental group. Following the training, significant improvements were observed in the theoretical knowledge, diagnostic skills, and total scores for both groups (p < 0.001). Furthermore, the experimental group demonstrated significantly higher diagnostic skills and total scores compared to the control group (p < 0.001). However, no significant difference was observed in the theoretical knowledge exam between the two groups (p = 0.236). The questionnaire used for subjective assessments had good reliability (Cronbach α was 0.826) and acceptable validity (The KMO was 0.692). Additionally, the survey questionnaires indicated that the experimental group rated higher than the control group in terms of cultivating imaging thinking ability, diagnostic confidence, diagnostic speed, and the convenience of the templates (p < 0.001). Clinicians' feedback scores for the experimental group markedly surpassed those for the control group (p < 0.05).

CONCLUSIONS

Utilizing the "3 + X D" SR template grounded in Bloom's taxonomy for training, the professional competency of radiology residents, particularly their diagnostic skills, saw a marked enhancement, successfully meeting the higher-level educational objectives. Consequently, the "3 + X D" SR template is highly recommended for the standardized training of radiology residents.

Structured Reporting of Head and Neck Sonography Achieves Substantial Interrater Reliability

Purpose Ultrasound examinations are often criticized for having higher examiner dependency compared to other imaging techniques. Compared to free-text reporting, structured reporting (SR) of head and neck sonography (HNS) achieves superior time efficiency as well as report quality. However, there are no findings concerning the influence of SR on the interrater reliability (IRR) of HNS. Materials and Methods Typical pathologies (n=4) in HNS were documented by video/images by two certified head and neck ultrasound instructors. Consequently, structured reports of these videos/images were created by n=9 senior physicians at departments of otolaryngology or maxillofacial surgery with DEGUM instructors on staff. Reports (n=36) were evaluated regarding overall completeness and IRR. Additionally, user satisfaction was assessed by a visual analog scale (VAS). Results SR yielded very high report completeness (91.8%) in all four cases with a substantial IRR (Fleiss' κ 0.73). Interrater agreement was high at 87.2% with very good user satisfaction (VAS 8.6). Conclusion SR has the potential to ensure high-quality examination reports with substantial comparability and very high user satisfaction. Furthermore, big data collection and analysis are facilitated by SR. Therefore, process quality, workflow, and scientific output are potentially enhanced by SR.

ENT Residents Benefit from a Structured Operation Planning Approach in the Training of Functional Endoscopic Sinus Surgery

Background and Objectives: Preoperative planning utilizing computed tomographies (CT) is of utmost importance in functional endoscopic sinus surgery (FESS). Frequently, no uniform documentation and planning structures are available to residents in training. Consequently, overall completeness and quality of operation planning may vary greatly. The objective of the present study was to evaluate the impact of a structured operation planning (SOP) approach on the report quality and user convenience during a 4-day sinus surgery course. Materials and Methods: Fifteen participant were requested to plan a FESS procedure based on a CT scan of the paranasal sinuses that exhibited common pathological features, in a conventional manner, using a free text. Afterwards, the participants reevaluated the same scans by means of a specifically designed structured reporting template. Two experienced ENT surgeons assessed the collected conventional operation planning (COP) and SOP methods independently with regard to time requirements, overall quality, and legibility. User convenience data were collected by utilizing visual analogue scales. Results: A significantly greater time expenditure was associated with SOPs (183 s vs. 297 s, p = 0.0003). Yet, legibility (100% vs. 72%, p < 0.0001) and overall completeness (61.3% vs. 22.7%, p < 0.0001) of SOPs was significantly superior to COPs. Additionally, description of highly relevant variants in anatomy and pathologies were outlined in greater detail. User convenience data delineated a significant preference for SOPs (VAS 7.9 vs. 6.9, p = 0.0185). Conclusions: CT-based planning of FESS procedures by residents in training using a structured approach is more time-consuming while producing a superior report quality in terms of detailedness and readability. Consequently, SOP can be considered as a valuable tool in the process of preoperative evaluations, especially within residency.

Diagnostic Performance of Kwak, EU, ACR, and Korean TIRADS as Well as ATA Guidelines for the Ultrasound Risk Stratification of Non-Autonomously Functioning Thyroid Nodules in a Region with Long History of Iodine Deficiency: A German Multicenter Trial

Germany has a long history of insufficient iodine supply and thyroid nodules occur in over 30% of the adult population, the vast majority of which are benign. Non-invasive diagnostics remain challenging, and ultrasound-based risk stratification systems are essential for selecting lesions requiring further clarification. However, no recommendation can yet be made about which system performs the best for iodine deficiency areas. In a German multicenter approach, 1211 thyroid nodules from 849 consecutive patients with cytological or histopathological results were enrolled. Scintigraphically hyperfunctioning lesions were excluded. Ultrasound features were prospectively recorded, and the resulting classifications according to five risk stratification systems were retrospectively determined. Observations determined 1022 benign and 189 malignant lesions. The diagnostic accuracies were 0.79, 0.78, 0.70, 0.82, and 0.79 for Kwak Thyroid Imaging Reporting and Data System (Kwak-TIRADS), American College of Radiology (ACR) TI-RADS, European Thyroid Association (EU)-TIRADS, Korean-TIRADS, and American Thyroid Association (ATA) Guidelines, respectively. Receiver Operating Curves revealed Areas under the Curve of 0.803, 0.795, 0.800, 0.805, and 0.801, respectively. According to the ATA Guidelines, 135 thyroid nodules (11.1%) could not be classified. Kwak-TIRADS, ACR TI-RADS, and Korean-TIRADS outperformed EU-TIRADS and ATA Guidelines and therefore can be primarily recommended for non-autonomously functioning lesions in areas with a history of iodine deficiency.

The role of structured reporting and structured operation planning in functional endoscopic sinus surgery

Computed tomography (CT) scans represent the gold standard in the planning of functional endoscopic sinus surgeries (FESS). Yet, radiologists and otolaryngologists have different perspectives on these scans. In general, residents often struggle with aspects involved in both reporting and operation planning. The aim of this study was to compare the completeness of structured reports (SR) of preoperative CT images and structured operation planning (SOP) to conventional reports (CR) and conventional operation planning (COP) to potentially improve future treatment decisions on an individual level. In total, 30 preoperative CT scans obtained for surgical planning of patients scheduled for FESS were evaluated using SR and CR by radiology residents. Subsequently, otolaryngology residents performed a COP using free texts and a SOP using a specific template. All radiology reports and operation plannings were evaluated by two experienced FESS surgeons regarding their completeness for surgical planning. User satisfaction of otolaryngology residents was assessed by using visual analogue scales. Overall radiology report completeness was significantly higher using SRs regarding surgically important structures compared to CRs (84.4 vs. 22.0%, p<0.001). SOPs produced significantly higher completeness ratings (97% vs. 39.4%, p<0.001) regarding pathologies and anatomical variances. Moreover, time efficiency was not significantly impaired by implementation of SR (148 s vs. 160 s, p = 0.61) and user satisfaction was significantly higher for SOP (VAS 8.1 vs. 4.1, p<0.001). Implementation of SR and SOP results in a significantly increased completeness of radiology reports and operation planning for FESS. Consequently, the combination of both facilitates surgical planning and may decrease potential risks during FESS.