Structured reporting of head and neck ultrasound examinations

Structured reporting of neuroendocrine tumors in PET/CT using [18F]SiTATE - impact on interdisciplinary communication

Our retrospective single-center study aims to evaluate the impact of structured reporting (SR) using a self-developed template on report quality compared to free-text reporting (FTR) in [18F]SiTATE Positron Emission Tomography/Computer Tomography (PET/CT) for the primary staging and therapy monitoring of patients diagnosed with neuroendocrine tumors (NET). In total 50 patients were included. FTRs and SRs were generated post-examination. All reports were evaluated by a radiologist and a surgeon through a questionnaire to determine their contribution to facilitating clinical decision-making and to assess their completeness, linguistic quality, and overall quality. SR significantly increased the capacity of facilitating therapy decision-making from 32% in FTR to 55% in SR (p < 0.001). Trust in the report was significantly higher in SR with a mean of 5.0 (SD = 0.5) vs. 4.7 (SD = 0.5) for FTR (p < 0.001). SR received significantly higher mean ratings regarding linguistic quality with 4.7 for SR vs. 4.4 for FTR (p = 0.004) and overall report quality with a mean of 4.9 for SR vs. 4.6 for FTR (p < 0.001). Concluding that SR enhances the overall quality of reports in [18F]SiTATE-PET/CTs for NET staging, serving as a tool to streamline clinical decision-making and enhance interdisciplinary communication in the future.

[Enhanced quality of documentation for biologic therapy of chronic rhinosinusitis through structured digital reporting and indication?]

BACKGROUND

With targeted inhibition of type 2 inflammation, biologics represent the standard add-on therapy for inadequately controlled severe forms of chronic rhinosinusitis with nasal polyps (CRSwNP). Despite standardization with paper-based checklists, the documentation of medical history and current findings pertinent to indication criteria are a significant challenge for physicians. Through development of an application based on structured reporting, the current study aimed to improve documentation quality and simplify the decision-making process. Previously available paper checklists served as a comparison.

METHODS

For this study, a digital incremental tool was programmed to record current findings and check for fulfilment of indication criteria. The tool was compared with other checklists in terms of completeness, time required, and readability.

RESULTS

A total of 20 findings were collected for each of the three documentation options and included in the analysis. Documentation with the two paper-based checklists had comparable information content: 17.5 ± 5.1/21.7 ± 7.6 points out of a maximum of 43 points; p > 0.05. Documentation using the digital application led to a significant increase in information content compared to all paper-based documentation. The average score was 38.25 ± 3.7 (88.9% of maximum; p < 0.001). On average, user satisfaction was high (9.6/10). Use of the digital application was initially more time consuming, but as more cases were documented, the time taken improved significantly.

CONCLUSION

In the future, structured reporting using apps could replace paper-based reporting for the indication of biologic therapy in CRSwNP patients and offer additional benefits in terms of data quality and traceability of results. The increasing volume of documentation in the future, the progress of digitalization, and the possibility of networking between individual centers make introduction of the app in the near future both likely and economical.

"3 + X D" structured report in radiology standardized resident training: Can it meet high-level teaching objectives?

PURPOSE

To evaluate the impact of the innovative "3 + X D" structured report (SR) designed based on Bloom's taxonomy on the learning outcomes of radiology residents during standardized training.

METHODS

This is a prospective study that recruited 120 radiology residents from our hospital between 2020 and 2022. Randomly selected 60 residents from the 2020 grade to constituted the control group, and randomly selected 60 residents from the 2021 grade to formed the experimental group. The former group was trained utilizing the Free-text Reports (FTR) template, while the latter group received training with the "3 + X D" structured reports (SR) template. The learning outcomes of both groups was evaluated utilizing both objective and subjective measures. Objective assessments encompassed examinations of theoretical knowledge, diagnostic skills, and total scores, aligning with the cognitive domains of remembering, understanding, applying, and analyzing as outlined by Bloom's Taxonomy. Subjective assessments, on the other hand, comprised survey questionnaires administered to residents and feedback from clinical instructors, which correlated with the higher-order cognitive level of analyzing, evaluating, and creating within Bloom's Taxonomy.

RESULTS

On 60 residents (mean age, 24.15 years ± 2.11[SD]; 25 male) from control group, and 60 residents (mean age, 24.58 years ± 1.88 [SD]; 27 male) from experimental group. Following the training, significant improvements were observed in the theoretical knowledge, diagnostic skills, and total scores for both groups (p < 0.001). Furthermore, the experimental group demonstrated significantly higher diagnostic skills and total scores compared to the control group (p < 0.001). However, no significant difference was observed in the theoretical knowledge exam between the two groups (p = 0.236). The questionnaire used for subjective assessments had good reliability (Cronbach α was 0.826) and acceptable validity (The KMO was 0.692). Additionally, the survey questionnaires indicated that the experimental group rated higher than the control group in terms of cultivating imaging thinking ability, diagnostic confidence, diagnostic speed, and the convenience of the templates (p < 0.001). Clinicians' feedback scores for the experimental group markedly surpassed those for the control group (p < 0.05).

CONCLUSIONS

Utilizing the "3 + X D" SR template grounded in Bloom's taxonomy for training, the professional competency of radiology residents, particularly their diagnostic skills, saw a marked enhancement, successfully meeting the higher-level educational objectives. Consequently, the "3 + X D" SR template is highly recommended for the standardized training of radiology residents.

[Increased report completeness and satisfaction with structured neurotological reporting in the interdisciplinary assessment of vertigo]

BACKGROUND

Results of neurotological function diagnostics in the context of interdisciplinary vertigo assessment are usually formulated as free-text reports (FTR). These are often subject to high variability, which may lead to loss of information. The aim of the present study was to evaluate the completeness of structured reports (SR) and referrer satisfaction in the neurotological assessment of vertigo.

MATERIALS AND METHODS

Neurotological function diagnostics performed as referrals (n = 88) were evaluated retrospectively. On the basis of the available raw data, SRs corresponding to FTRs from clinical routine were created by means of a specific SR template for neurotological function diagnostics. FTRs and SRs were evaluated for completeness and referring physician satisfaction (n = 8) using a visual analog scale (VAS) questionnaire.

RESULTS

Compared to FTRs, SRs showed significantly increased overall completeness (73.7% vs. 51.7%, p < 0.001), especially in terms of patient history (92.5% vs. 66.7%, p < 0.001), description of previous findings (87.5% vs. 38%, p < 0.001), and neurotological (33.5% vs. 26.7%, p < 0.001) and audiometric function diagnostics (58% vs. 32.3%, p < 0.001). In addition, SR showed significantly increased referring physician satisfaction (VAS 8.8 vs. 4.9, p < 0.001).

CONCLUSION

Neurotological SRs enable a significantly increased report completeness with higher referrer satisfaction in the context of interdisciplinary assessment of vertigo. Furthermore, SRs are particularly suitable for scientific data analysis, especially in the context of big data analyses.

A Critical Examination of Academic Hospital Practices-Paving the Way for Standardized Structured Reports in Neuroimaging

Background/Objectives: Imaging studies are often an integral part of patient evaluation and serve as the primary means of communication between radiologists and referring physicians. This study aimed to evaluate brain Magnetic Resonance Imaging (MRI) reports and to determine whether these reports follow a standardized or narrative format. Methods: A series of 466 anonymized MRI reports from an academic hospital were downloaded from the Picture Archiving and Communication System (PACS) in portable document format (pdf) for the period between August 2017 and March 2018. Two hundred brain MRI reports, written by four radiologists, were compared to a structured report template from the Radiology Society of North America (RSNA) and were included, whereas MR-modified techniques, such as MRI orbits and MR venography reports, were excluded (n = 266). All statistical analyses were conducted using Statistical Package for the Social Sciences (SPSS) statistical software (version 16.4.1, MedCalc Software). Results: None of the included studies used the RSNA template for structured reports (SRs). The highest number of brain-reported pathologies was for vascular disease (24%), while the lowest was for infections (3.5%) and motor dysfunction (5.5%). Radiologists specified the Technique (n = 170, 85%), Clinical Information (n = 187, 93.5%), and Impression (n = 197, 98.5%) in almost all reports. However, information in the Findings section was often missing. As hypothesized, radiologists with less experience showed a greater commitment to reporting additional elements than those with more experience. Conclusions: The SR template for medical imaging has been accessible online for over a decade. However, many hospitals and radiologists still use the free-text style for reporting. Our study was conducted in an academic hospital with a fellowship program, and we found that structured reporting had not yet been implemented. As the health system transitions towards teleservices and teleradiology, more efforts need to be put into advocating standardized reporting in medical imaging.

Inter-Rater Reliability of Thyroid Ultrasound Risk Criteria: A Systematic Review and Meta-Analysis

OBJECTIVE

The most commonly employed diagnostic criteria for identifying thyroid nodules include Thyroid Imaging and Reporting Data System (TI-RADS) and American Thyroid Association (ATA) guidelines. The purpose of this systematic review and meta-analysis is to determine the inter-rater reliability of thyroid ultrasound criteria.

METHODS

We performed a library search of MEDLINE (Ovid), EMBASE (Ovid), and Web of Science for full-text articles published from January 2005 to June 2022. We included full-text primary research articles that used TI-RADS and/or ATA guidelines to evaluate thyroid nodules in adults. These included studies must have calculated inter-rater reliability using any validated metric. The Quality Appraisal for Reliability Studies (QAREL) was used to assess study quality. We planned for a random-effects meta-analysis, in addition to covariate and publication bias analyses. This study was performed in accordance with Preferred Reporting Items for a Systematic Review and Meta-analysis guidelines and registered prior to conduction (International prospective register of systematic reviews-PROSPERO: CRD42021275072).

RESULTS

Of the 951 articles identified via the database search, 35 met eligibility criteria. All studies were observational. The most commonly utilized criteria were ACR Thyroid Imaging and Reporting Data System (TI-RADS) and/or ATA criteria, while the majority of studies employed Κ statistics. For ACR TI-RADS, the pooled Κ was 0.51 (95% confidence interval [CI]: 0.42, 0.57; n = 7) while for ATA, the pooled Κ was 0.52 (95% CI: 0.37, 0.67; n = 3). Due to the small number of studies, covariate or publication bias analyses were not performed.

CONCLUSION

Ultrasound criteria demonstrate moderate inter-rater reliability, but these findings are impacted by poor study quality and a lack of standardization. Laryngoscope, 133:485-493, 2023.

Structured Reporting of Head and Neck Sonography Achieves Substantial Interrater Reliability

Purpose Ultrasound examinations are often criticized for having higher examiner dependency compared to other imaging techniques. Compared to free-text reporting, structured reporting (SR) of head and neck sonography (HNS) achieves superior time efficiency as well as report quality. However, there are no findings concerning the influence of SR on the interrater reliability (IRR) of HNS. Materials and Methods Typical pathologies (n=4) in HNS were documented by video/images by two certified head and neck ultrasound instructors. Consequently, structured reports of these videos/images were created by n=9 senior physicians at departments of otolaryngology or maxillofacial surgery with DEGUM instructors on staff. Reports (n=36) were evaluated regarding overall completeness and IRR. Additionally, user satisfaction was assessed by a visual analog scale (VAS). Results SR yielded very high report completeness (91.8%) in all four cases with a substantial IRR (Fleiss' κ 0.73). Interrater agreement was high at 87.2% with very good user satisfaction (VAS 8.6). Conclusion SR has the potential to ensure high-quality examination reports with substantial comparability and very high user satisfaction. Furthermore, big data collection and analysis are facilitated by SR. Therefore, process quality, workflow, and scientific output are potentially enhanced by SR.

Thoracic UltrasONOgraphy Reporting: The TUONO Study

Lung ultrasound (LUS) is a validated technique for the prompt diagnosis and bedside monitoring of critically ill patients due to its availability, safety profile, and cost-effectiveness. The aim of this work is to detect similarities and differences among LUS reports performed in ICUs and to provide a common ground for an integrated report form. We collected all LUS reports during an index week in 21 ICUs from the GiViTI network. First, we considered signs, chest areas, and terminology reported. Then, we compared different report structures and categorized them as structured reports (SRs), provided with a predefined model form, and free unstructured text reports (FTRs) that had no predetermined structure. We analyzed 171 reports from 21 ICUs, and 59 reports from 5 ICUs were structured. All the reports presented a qualitative description that mainly focused on the presence of B-lines, consolidations, and pleural effusion. Zones were defined in 66 reports (39%). In SRs, a complete examination of all the regions was more frequently achieved (96% vs. 74%), and a higher impact on therapeutic strategies was observed (17% vs. 6%). LUS reports vary significantly among different centers. Adopting an integrated SR seems to promote a systematic approach in scanning and reporting, with a potential impact on LUS clinical applications.

Head and Neck Ultrasound - EFSUMB Training Recommendations for the Practice of Medical Ultrasound in Europe

Different surgical and medical specialists increasingly use head and neck ultrasound and ultrasound-guided interventions as part of their clinical practice. We need to ensure high quality and standardized practice across specialties, and this position paper of the European Federation of Societies for Ultrasound in Medicine and Biology (EFSUMB) describes the training requirements for head and neck ultrasound. Traditionally, a minimum number of ultrasound examinations indicates competence, but this is unreliable, and a general shift towards competence-based training is ongoing. For each EFSUMB level, we will outline the theoretical knowledge and skills needed for clinical practice. The recommendations follow the three EFSUMB competency levels for medical ultrasound practice. Level 1 describes the skills required to perform essential head and neck ultrasound examinations independently, level 2 includes ultrasound-guided interventions, while level 3 involves the practice of high-level neck ultrasound and use of advanced technologies. Our goal is to ensure high quality and standardized head and neck ultrasound practice performed by different clinical specialists with these recommendations.

Professional Standards in Medical Ultrasound - EFSUMB Position Paper (Short Version) - General Aspects

This first position paper of the European Federation of Societies for Ultrasound in Medicine and Biology (EFSUMB) on professional standards presents a common position across the different medical professions within EFSUMB regarding optimal standards for the performing and reporting of ultrasound examinations by any professional ultrasound operator. It describes general aspects of professionality that ensure procedure quality, effectiveness, efficiency, and sustainability in virtually all application fields of medical ultrasound. Recommendations are given related to safety and indication of ultrasound examinations, requirements for examination rooms, structured examination, systematic reporting of results, and management, communication and archiving of ultrasound data. The print version of this article is a short version. The long version is published online.

Professional Standards in Medical Ultrasound - EFSUMB Position Paper (Long Version) - General Aspects

This first position paper of the European Federation of Societies for Ultrasound in Medicine and Biology (EFSUMB) on professional standards presents a common position across the different medical professions within EFSUMB regarding optimal standards for the performing and reporting of ultrasound examinations by any professional ultrasound operator. It describes general aspects of professionality that ensure procedure quality, effectiveness, efficiency, and sustainability in virtually all application fields of medical ultrasound. Recommendations are given related to safety and indication of ultrasound examinations, requirements for examination rooms, structured examination, systematic reporting of results, and management, communication and archiving of ultrasound data. The print version of this article is a short version. The long version is published online.

An approach to evaluate the quality of radiological reports in Head and Neck cancer loco-regional staging: experience of two Academic Hospitals

OBJECTIVES

To evaluate the quality of the reports of loco-regional staging computed tomography (CT) or magnetic resonance imaging (MRI) in head and neck (H&N) cancer.

METHODS

Consecutive reports of staging CT and MRI of all H&N cancer cases from 2018 to 2020 were collected. We created lists of quality indicators for tumor (T) for each district and for node (N). We marked these as 0 or 1 in the report calculating a report score (RS) and a maximum sum (MS) of each list. Two radiologists and two otolaryngologists in consensus classified reports as low quality (LQ) if the RS fell in the percentage range 0-59% of MS and as high quality (HQ) if it fell in the range 60-100%, annotating technique and district. We evaluated the distribution of reports in these categories.

RESULTS

Two hundred thirty-seven reports (97 CT and 140 MRI) of 95 oral cavity, 52 laryngeal, 47 oropharyngeal, 19 hypo-pharyngeal, 14 parotid, and 10 nasopharyngeal cancers were included. Sixty-six percent of all the reports were LQ for T, 66% out of all the MRI reports, and 65% out of all CT reports were LQ. Eight-five percent of reports were HQ for N, 85% out of all the MRI reports, and 82% out of all CT reports were HQ. Reports of oral cavity, oro-nasopharynx, and parotid were LQ, respectively, in 76%, 73%, 100% and 92 out of cases.

CONCLUSION

Reports of staging CT/MRI in H&N cancer were LQ for T description and HQ for N description.

Ambiguous and Incomplete: Natural Language Processing Reveals Problematic Reporting Styles in Thyroid Ultrasound Reports

OBJECTIVE

 Natural language processing (NLP) systems convert unstructured text into analyzable data. Here, we describe the performance measures of NLP to capture granular details on nodules from thyroid ultrasound (US) reports and reveal critical issues with reporting language.

METHODS

 We iteratively developed NLP tools using clinical Text Analysis and Knowledge Extraction System (cTAKES) and thyroid US reports from 2007 to 2013. We incorporated nine nodule features for NLP extraction. Next, we evaluated the precision, recall, and accuracy of our NLP tools using a separate set of US reports from an academic medical center (A) and a regional health care system (B) during the same period. Two physicians manually annotated each test-set report. A third physician then adjudicated discrepancies. The adjudicated "gold standard" was then used to evaluate NLP performance on the test-set.

RESULTS

 A total of 243 thyroid US reports contained 6,405 data elements. Inter-annotator agreement for all elements was 91.3%. Compared with the gold standard, overall recall of the NLP tool was 90%. NLP recall for thyroid lobe or isthmus characteristics was: laterality 96% and size 95%. NLP accuracy for nodule characteristics was: laterality 92%, size 92%, calcifications 76%, vascularity 65%, echogenicity 62%, contents 76%, and borders 40%. NLP recall for presence or absence of lymphadenopathy was 61%. Reporting style accounted for 18% errors. For example, the word "heterogeneous" interchangeably referred to nodule contents or echogenicity. While nodule dimensions and laterality were often described, US reports only described contents, echogenicity, vascularity, calcifications, borders, and lymphadenopathy, 46, 41, 17, 15, 9, and 41% of the time, respectively. Most nodule characteristics were equally likely to be described at hospital A compared with hospital B.

CONCLUSIONS

 NLP can automate extraction of critical information from thyroid US reports. However, ambiguous and incomplete reporting language hinders performance of NLP systems regardless of institutional setting. Standardized or synoptic thyroid US reports could improve NLP performance.

ENT Residents Benefit from a Structured Operation Planning Approach in the Training of Functional Endoscopic Sinus Surgery

Background and Objectives: Preoperative planning utilizing computed tomographies (CT) is of utmost importance in functional endoscopic sinus surgery (FESS). Frequently, no uniform documentation and planning structures are available to residents in training. Consequently, overall completeness and quality of operation planning may vary greatly. The objective of the present study was to evaluate the impact of a structured operation planning (SOP) approach on the report quality and user convenience during a 4-day sinus surgery course. Materials and Methods: Fifteen participant were requested to plan a FESS procedure based on a CT scan of the paranasal sinuses that exhibited common pathological features, in a conventional manner, using a free text. Afterwards, the participants reevaluated the same scans by means of a specifically designed structured reporting template. Two experienced ENT surgeons assessed the collected conventional operation planning (COP) and SOP methods independently with regard to time requirements, overall quality, and legibility. User convenience data were collected by utilizing visual analogue scales. Results: A significantly greater time expenditure was associated with SOPs (183 s vs. 297 s, p = 0.0003). Yet, legibility (100% vs. 72%, p < 0.0001) and overall completeness (61.3% vs. 22.7%, p < 0.0001) of SOPs was significantly superior to COPs. Additionally, description of highly relevant variants in anatomy and pathologies were outlined in greater detail. User convenience data delineated a significant preference for SOPs (VAS 7.9 vs. 6.9, p = 0.0185). Conclusions: CT-based planning of FESS procedures by residents in training using a structured approach is more time-consuming while producing a superior report quality in terms of detailedness and readability. Consequently, SOP can be considered as a valuable tool in the process of preoperative evaluations, especially within residency.

Structured Reporting of Computed Tomography Examinations in Post-Lung Transplantation Patients

OBJECTIVE

The aim of this study was to evaluate the benefits and potential of structured reports (SR) for chest computed tomography after lung transplantation.

METHODS

Free-text reports (FTR) and SR were generated for 49 computed tomography scans. Clinical routine reports were used as FTR. Two pulmonologists rated formal aspects, completeness, clinical utility, and overall quality. Wilcoxon and McNemar tests were used for statistical analysis.

RESULTS

Structured reports received significantly higher ratings for all formals aspects (P < 0.001, respectively). Completeness was higher in SR with regard to evaluation of bronchiectases, bronchial anastomoses, bronchiolitic and fibrotic changes (P < 0.001, respectively), and air trapping (P = 0.012), but not signs of pneumonia (P = 0.5). Clinical utility and overall quality were rated significantly higher for SR than FTR (P < 0.001, respectively). However, report type did not influence initiation of further diagnostic or therapeutic measures (P = 0.307 and 1.0).

CONCLUSIONS

Structured reports are superior to FTR with regard to formal aspects, completeness, clinical utility, and overall satisfaction of referring pulmonologists.

Structured Reporting of Rectal Cancer Staging and Restaging: A Consensus Proposal

Simple Summary

Structured reporting in oncologic imaging is becoming necessary and has recently been recognized by major scientific societies. Structured reports collect all Patient Clinical Data, Clinical Evaluations and relevant key findings of Rectal Cancer, both in staging and restaging, and can facilitate clinical decision-making.

Abstract

Background: Structured reporting (SR) in oncologic imaging is becoming necessary and has recently been recognized by major scientific societies. The aim of this study was to build MRI-based structured reports for rectal cancer (RC) staging and restaging in order to provide clinicians all critical tumor information. Materials and Methods: A panel of radiologist experts in abdominal imaging, called the members of the Italian Society of Medical and Interventional Radiology, was established. The modified Delphi process was used to build the SR and to assess the level of agreement in all sections. The Cronbach’s alpha (Cα) correlation coefficient was used to assess the internal consistency of each section and to measure the quality analysis according to the average inter-item correlation. The intraclass correlation coefficient (ICC) was also evaluated. Results: After the second Delphi round of the SR RC staging, the panelists’ single scores and sum of scores were 3.8 (range 2–4) and 169, and the SR RC restaging panelists’ single scores and sum of scores were 3.7 (range 2–4) and 148, respectively. The Cα correlation coefficient was 0.79 for SR staging and 0.81 for SR restaging. The ICCs for the SR RC staging and restaging were 0.78 (p < 0.01) and 0.82 (p < 0.01), respectively. The final SR version was built and included 53 items for RC staging and 50 items for RC restaging. Conclusions: The final version of the structured reports of MRI-based RC staging and restaging should be a helpful and promising tool for clinicians in managing cancer patients properly. Structured reports collect all Patient Clinical Data, Clinical Evaluations and relevant key findings of Rectal Cancer, both in staging and restaging, and can facilitate clinical decision-making.

Structured Reporting in the Characterization of Renal Cysts by Contrast-Enhanced Ultrasound (CEUS) Using the Bosniak Classification System-Improvement of Report Quality and Interdisciplinary Communication

BACKGROUND

This study aims to evaluate the potential benefits of structured reporting (SR) compared to conventional free-text reporting (FTR) in contrast-enhanced ultrasound (CEUS) of cystic renal lesions, based on the Bosniak classification.

METHODS

Fifty patients with cystic renal lesions who underwent CEUS were included in this single-center study. FTR created in clinical routine were compared to SR retrospectively generated by using a structured reporting template. Two experienced urologists evaluated the reports regarding integrity, effort for information extraction, linguistic quality, and overall quality.

RESULTS

The required information could easily be extracted by the reviewers in 100% of SR vs. 82% of FTR (p < 0.001). The reviewers trusted the information given by SR significantly more with a mean of 5.99 vs. 5.52 for FTR (p < 0.001). SR significantly improved the linguistic quality (6.0 for SR vs. 5.68 for FTR (p < 0.001)) and the overall report quality (5.98 for SR vs. 5.58 for FTR (p < 0.001)).

CONCLUSIONS

SR significantly increases the quality of radiologic reports in CEUS examinations of cystic renal lesions compared to conventional FTR and represents a promising approach to facilitate interdisciplinary communication in the future.

Structured Reporting Using CEUS LI-RADS for the Diagnosis of Hepatocellular Carcinoma (HCC)-Impact and Advantages on Report Integrity, Quality and Interdisciplinary Communication

Simple Summary

Contrast-enhanced ultrasound (CEUS) is an increasingly accepted imaging modality for visualizing hepatocellular carcinoma (HCC) and is recommended as a secondary imaging option by most leading hepatology societies. In recent years, the use of structured reporting (SR) has been recommended by several societies to standardize report content and improve report quality of various diagnostic modalities when compared to conventional free-text reports (FTR). Our single-center study aimed to evaluate the use of SR using a CEUS LI-RADS software template in CEUS examinations of 50 HCC patients. SR significantly increased report integrity, satisfaction of the referring physicians, linguistic quality and overall report quality compared to FTR. Therefore, the use of SR in CEUS examinations of HCC patients may represent a valuable tool to facilitate clinical decision-making and improve interdisciplinary communication in the future.

Abstract

Background: Our retrospective single-center study aims to evaluate the impact of structured reporting (SR) using a CEUS LI-RADS template on report quality compared to conventional free-text reporting (FTR) in contrast-enhanced ultrasound (CEUS) for the diagnosis of hepatocellular carcinoma (HCC). Methods: We included 50 patients who underwent CEUS for HCC staging. FTR created after these examinations were compared to SR retrospectively generated by using template-based online software with clickable decision trees. The reports were evaluated regarding report completeness, information extraction, linguistic quality and overall report quality by two readers specialized in internal medicine and visceral surgery. Results: SR significantly increased report completeness with at least one key feature missing in 31% of FTR vs. 2% of SR (p < 0.001). Information extraction was considered easy in 98% of SR vs. 86% of FTR (p = 0.004). The trust of referring physicians in the report was significantly increased by SR with a mean of 5.68 for SR vs. 4.96 for FTR (p < 0.001). SR received significantly higher ratings regarding linguistic quality (5.79 for SR vs. 4.83 for FTR (p < 0.001)) and overall report quality (5.75 for SR vs. 5.01 for FTR (p < 0.001)). Conclusions: Using SR instead of conventional FTR increases the overall quality of reports in CEUS examinations of HCC patients and may represent a valuable tool to facilitate clinical decision-making and improve interdisciplinary communication in the future.

[Quality in the appraisal of head and neck sonography results in university hospitals-a random sample]

Hintergrund

Die Ultraschalldiagnostik gilt für den Radiologen, Hals-Nasen-Ohren-Arzt (HNO) oder Mund-Kiefer-Gesichts-Chirurgen als Standard in der Abklärung zahlreicher Pathologien. Es besteht ein Konsens, dass die digitale Dokumentation heute dringend notwendig ist, um die Qualität der sonographischen Dokumentationen zu verbessern und zu standardisieren. Es häufen sich Publikationen zur Implementierung standardisierter Befunddokumentation einschließlich der Kopf- und Halssonographie.

Ziel der Arbeit

Die vorliegende Arbeit zielt darauf ab, die Qualität von routinemäßig angefertigten Kopf- und Halssonographiebefunden nach Kriterien der Kassenärztlichen Vereinigung (KV) Bayern an einer Auswahl deutscher HNO-Universitätskliniken stichprobenartig zu ermitteln.

Material und Methoden

Insgesamt wurden retrospektiv 70 zufällig ausgewählte, anonymisierte schriftliche Befunde einschließlich Bildmaterial von insgesamt 7 HNO-Universitätskliniken stichprobenartig nach KV-Kriterien durch einen erfahrenen Prüfer der KV Bayern ausgewertet und deskriptiv analysiert.

Ergebnisse

Von 70 Befunden konnten 69 ausgewertet werden. Die Dokumentationsvollständigkeit lag im Mittel bei 80,6 %. Neun Befunde waren vollständig korrekt dokumentiert (13 %). Die Dokumentationsvollständigkeit der einzelnen Kliniken lag zwischen 68,1 % und 93 %. Mit 88,5 % vs. 75 % erbrachte eine strukturierte Befundung eine höhere Befundvollständigkeit. In 75 % der Fälle verfügten die Kliniken mit strukturiertem Befund auch über digitale Dokumentationslösungen.

Schlussfolgerung

Die Vollständigkeit und Qualität von routinemäßig angefertigten Kopf- und Halssonographiebefunden an einer Auswahl von HNO-Universitätskliniken ist insgesamt optimierbar. Die Implementierung strukturierter Befundmasken und die Umstellung der analogen Dokumentation auf digitale Lösungen sowie Vernetzung mit dem Klinikinformationssystem (KIS) und Bildarchivierungs- und Kommunikationssystem (PACS) sollte weiter vorangetrieben werden. Darüber hinaus sind leitende Ärzte dazu angehalten, die Befundqualität unerfahrener Kollegen regelmäßig zu prüfen und im Rahmen der Facharztausbildung auf die Erfüllung entsprechender Standards wie der KV-Ultraschallvereinbarung hinzuarbeiten.

The role of structured reporting and structured operation planning in functional endoscopic sinus surgery

Computed tomography (CT) scans represent the gold standard in the planning of functional endoscopic sinus surgeries (FESS). Yet, radiologists and otolaryngologists have different perspectives on these scans. In general, residents often struggle with aspects involved in both reporting and operation planning. The aim of this study was to compare the completeness of structured reports (SR) of preoperative CT images and structured operation planning (SOP) to conventional reports (CR) and conventional operation planning (COP) to potentially improve future treatment decisions on an individual level. In total, 30 preoperative CT scans obtained for surgical planning of patients scheduled for FESS were evaluated using SR and CR by radiology residents. Subsequently, otolaryngology residents performed a COP using free texts and a SOP using a specific template. All radiology reports and operation plannings were evaluated by two experienced FESS surgeons regarding their completeness for surgical planning. User satisfaction of otolaryngology residents was assessed by using visual analogue scales. Overall radiology report completeness was significantly higher using SRs regarding surgically important structures compared to CRs (84.4 vs. 22.0%, p<0.001). SOPs produced significantly higher completeness ratings (97% vs. 39.4%, p<0.001) regarding pathologies and anatomical variances. Moreover, time efficiency was not significantly impaired by implementation of SR (148 s vs. 160 s, p = 0.61) and user satisfaction was significantly higher for SOP (VAS 8.1 vs. 4.1, p<0.001). Implementation of SR and SOP results in a significantly increased completeness of radiology reports and operation planning for FESS. Consequently, the combination of both facilitates surgical planning and may decrease potential risks during FESS.

The use of structured reporting of head and neck ultrasound ensures time-efficiency and report quality during residency

PURPOSE

Free text reports (FTR) of head and neck ultrasound studies are currently deployed in most departments. Because of a lack of composition and language, these reports vary greatly in terms of quality and reliability. This may impair the learning process during residency. The purpose of the study was to analyze the longitudinal effects of using structured reports (SR) of head and neck ultrasound studies during residency.

METHODS

Attending residents (n = 24) of a tripartite course on head and neck ultrasound, accredited by the German Society for Ultrasound in Medicine (DEGUM), were randomly allocated to pictures of common diseases. Both SRs and FTRs were compiled. All reports were analyzed concerning completeness, acquired time and legibility. Overall user contentment was evaluated by a questionnaire.

RESULTS

SRs achieved significantly higher ratings regarding completeness (95.6% vs. 26.4%, p < 0.001), description of pathologies (72.2% vs. 58.9%, p < 0.001) and legibility (100% vs. 52.4%, p < 0.001) with a very high inter-rater reliability (Fleiss' kappa 0.9). Reports were finalized significantly faster (99.1 s vs. 115.0 s, p < 0.001) and user contentment was significantly better when using SRs (8.3 vs. 6.3, p < 0.001). In particular, only SRs showed a longitudinally increasing time efficiency (- 20.1 s, p = 0.036) while maintaining consistent completeness ratings.

CONCLUSIONS

The use of SRs of head and neck ultrasound studies results in an increased longitudinal time-efficiency while upholding the report quality at the same time. This may indicate an additive learning effect of structured reporting. Superior outcomes in terms of comprehensiveness, legibility and time-efficiency can be observed immediately after implementation.

Impact of structured reporting on developing head and neck ultrasound skills

BACKGROUND

Reports of head and neck ultrasound examinations are frequently written by hand as free texts. This is a serious obstacle to the learning process of the modality due to a missing report structure and terminology. Therefore, there is a great inter-observer variability in overall report quality. Aim of the present study was to evaluate the impact of structured reporting on the learning process as indicated by the overall report quality of head and neck ultrasound examinations within medical school education.

METHODS

Following an immersion course on head and neck ultrasound, previously documented images of three common pathologies were handed out to 58 medical students who asked to create both standard free text reports (FTR) and structured reports (SR). A template for structured reporting of head and neck ultrasound examinations was created using a web-based approach. FTRs and SRs were evaluated with regard to overall quality, completeness, required time to completion and readability by two independent raters (Paired Wilcoxon test, 95% CI). Ratings were assessed for inter-rater reliability (Fleiss' kappa). Additionally, a questionnaire was utilized to evaluate user satisfaction.

RESULTS

SRs received significantly better ratings in terms of report completeness (97.7% vs. 53.5%, p < 0.001) regarding all items. In addition, pathologies were described in more detail using SRs (70% vs. 51.1%, p < 0.001). Readability was significantly higher in all SRs when compared to FTRs (100% vs. 54.4%, p < 0.001). Mean time to complete was significantly lower (79.6 vs. 205.4 s, p < 0.001) and user satisfaction was significantly higher when using SRs (8.5 vs. 4.1, p < 0.001). Also, inter-rater reliability was very high (Fleiss' kappa 0.93).

CONCLUSIONS

SRs of head and neck ultrasound examinations provide more detailed information with a better readability in a time-saving manner within medical education. Also, medical students may benefit from SRs in their learning process due to the structured approach and standardized terminology.