Efficacy of a checklist-style structured radiology reporting template in reducing resident misses on cervical spine computed tomography examinations

Impact of an expert-derived, quick hands-on tool on classifying pulmonary hypertension in chest computed tomography: a study on inexperienced readers using RAPID-CT-PH

PURPOSE

To test the inter-reader agreement in classifying pulmonary hypertension (PH) on chest contrast-enhanced computed tomography (CECT) between a consensus of two cardio-pulmonary-devoted radiologists (CRc) and inexperienced readers (radiology residents, RRs) when using a CECT-based quick hands-on tool built upon PH imaging literature, i.e., the "Rapid Access and Practical Information Digest on Computed Tomography for PH-RAPID-CT-PH".

MATERIAL AND METHODS

The observational study retrospectively included 60 PH patients who underwent CECT between 2015 and 2022. Four RRs independently reviewed all CECTs and classified each case into one of the five PH groups per the 2022 ESC/ERS guidelines. While RR3 and RR4 (RAPID-CT-PH group) used RAPID-CT-PH, RR1 and RR2 (control group) did not. RAPID-CT-PH and control groups' reports were compared with CRc using unweighted Cohen's Kappa (k) statistics. RRs' report completeness and reporting time were also compared using the Wilcoxon-Mann-Whitney test.

RESULTS

The inter-reader agreement in classifying PH between the RAPID-CT-PH group and CRc was substantial (k = 0.75 for RR3 and k = 0.65 for RR4); while, it was only moderate for the control group (k = 0.57 for RR1 and k = 0.49 for RR2). Using RAPID-CT-PH resulted in significantly higher report completeness (all p < 0.0001) and significantly lower reporting time (p < 0.0001) compared to the control group.

CONCLUSION

RRs using RAPID-CT-PH showed a substantial agreement with CRc on CECT-based PH classification. RAPID-CT-PH improved report completeness and reduced reporting time. A quick hands-on tool for classifying PH on chest CECT may help inexperienced radiologists effectively contribute to the PH multidisciplinary team.

Influence of residency discipline and seniority on traumatic musculoskeletal radiographs interpretation accuracy: a multicenter study

OBJECTIVES

Imaging studies are a significant and integral part of the initial assessment of patients admitted to the emergency department. Developing imaging diagnostic abilities early in residency is of paramount importance. The purpose of this study was to evaluate and compare diagnosis accuracy of common musculoskeletal X-rays (XR) between residency disciplines and seniority.

METHODS

A multicenter study which evaluated orthopedic surgery, emergency medicine (EM), and radiology residents, through a test set of common MSK XR. Residents were classified as "beginner" or "advanced" according to postgraduate year per residency. Residents were asked to answer whether the radiograph shows normal or pathological findings (success rate) and what is the diagnosis ("diagnosis accuracy"). Residents' answers were analyzed and assessed compared to experts' consensus.

RESULTS

A total of 100 residents (62% beginners) participated in this study. Fifty-four were orthopedic surgeons, 29 were EM residents and 17 were radiologists. The entire cohort's overall success rate was 88.5%. The overall mean success rates for orthopedic, EM, and radiology residents were 93.2%, 82.8%, and 83.3%, respectively, and were significantly different (p < 0.0001). Orthopedic residents had significantly higher diagnostic accuracy rates compared with both radiology and EM residents (p < 0.001). Advanced orthopedic and EM residents demonstrated higher diagnostic accuracy rates compared to beginner residents (p = 0.001 and p = 0.03, respectively).

CONCLUSION

Orthopedic residents presented higher diagnosis accuracy of MSK imaging compared to EM and radiology residents. Seniority had a positive effect on diagnosis accuracy. The development of an educational program on MSK XR is necessary to enhance the competency of physicians in their daily practice.

Eye tracking validation: Improving radiologist reporting and interpretation

RATIONALE AND OBJECTIVES

This study aims to validate a new radiology reporting style using eye tracking to maximize radiologist interpretation time, increase accuracy, and minimize dictation time, ultimately providing a clinically relevant, concise, and accurate reporting style.

MATERIALS AND METHODS

The positive findings only dictation style using a podcast stand-alone microphone (n = 76) was compared with the standard check-list dictation style using a handheld microphone (n = 81). Experienced board-certified radiologists used each style for various imaging modalities. The number of voice recognition corrections per case was tracked. Eye-tracking glasses captured eye movement to document dictation, interpretation, and total examination times. This device also generated thermal heat maps for each style. The statistical difference between the two methods was assessed via descriptive analysis and inferential statistics.

RESULTS

Eye tracking revealed that the new positive findings dictation style led to a noteworthy shift in radiologists' visual attention, with reduced heat map overlaying the reporting software compared to the standard check-list style, indicating greater focus on medical images. Cases with at least one voice recognition correction significantly decreased using the positive findings dictation style versus the standard check-list style (5.26 % vs. 14.81 %; p = 0.0240). The positive findings dictation style significantly decreased average dictation time (16.54 s [s] vs. 29.39 s; p = 0.0003) without impacting interpretation time (70.90 s vs. 64.30 s; p = 0.7799) or total examination time (87.45 s vs. 93.69 s; p = 0.3756) compared to the standard style.

CONCLUSION

Positive findings only dictation style significantly decreased dictation time and enhanced accuracy without compromising total interpretation time.

PROSER: A Web-Based Peripheral Blood Smear Interpretation Support Tool Utilizing Electronic Health Record Data

OBJECTIVES

Peripheral blood smear (PBS) interpretation represents a cornerstone of pathology practice and resident training but has remained largely static for decades. Here, we describe a novel PBS interpretation support tool.

METHODS

In a mixed-methods quality improvement study, a web-based clinical decision support (CDS) tool to assist pathologists in PBS interpretation, PROSER, was deployed in an academic hospital over a 2-month period in 2022. PROSER interfaced with the hospital system's electronic health record and data warehouse to obtain and display relevant demographic, laboratory, and medication information for patients with pending PBS consults. PROSER used these data along with morphologic findings entered by the pathologist to draft a PBS interpretation using rule-based logic. We evaluated users' perceptions of PROSER with a Likert-type survey.

RESULTS

PROSER displayed 46 laboratory values with corresponding reference ranges and abnormal flags, allowed for entry of 14 microscopy findings, and computed 2 calculations based on laboratory values; it composed automated PBS reports using a library of 92 prewritten phrases. Overall, PROSER was well received by residents.

CONCLUSIONS

In this quality improvement study, we successfully deployed a web-based CDS tool for PBS interpretation. Future work is needed to quantitatively evaluate this intervention's effects on clinical outcomes and resident training.

Impact of a structured reporting template on the quality of HRCT radiology reports for interstitial lung disease

PURPOSE

This QI study compared the completeness of HRCT radiology reports before and after the implementation of a disease-specific structured reporting template for suspected cases of interstitial lung disease (ILD).

MATERIALS AND METHODS

A pre-post study of radiology reports for HRCT of the thorax at a multicenter health system was performed. Data was collected in 6-month period intervals before (June 2019-November 2019) and after (January 2021-June 2021) the implementation of a disease-specific template. The use of the template was voluntary. The primary outcome measure was the completeness of HRCT reports graded based on the documentation of ten descriptors. The secondary outcome measure assessed which descriptor(s) improved after the intervention.

RESULTS

521 HRCT reports before and 557 HRCT reports after the intervention were reviewed. Of the 557 reports, 118 reports (21%) were created using the structured reporting template. The mean completeness score of the pre-intervention group was 9.20 (SD = 1.08) and the post-intervention group was 9.36 (SD = 1.03) with a difference of -0.155, 95% CI [-0.2822, -0.0285, p < 0.0001]. Within the post-intervention group, the mean completeness score of the unstructured reports was 9.25 (SD = 1.07) and the template reports was 9.93 (SD = 0.25) with a difference of -0.677, 95% CI [-0.7871, -0.5671, p < 0.0001]. After the intervention, the use of two descriptors improved significantly: presence of honeycombing from 78.3% to 85.1% (p < 0.0039) and technique from 90% to 96.6% (p < 0.0001).

DISCUSSION

Shifting to disease-specific structured reporting for HRCT exams of suspected ILD is beneficial, as it improves the completeness of radiology reports. Further research on how to improve the voluntary uptake of a disease-specific template is needed to help increase the acceptance of structured reporting among radiologists.

Routine Use of Structured Reporting in Whole-body Trauma CT Facilitates Quality Improvement

PURPOSE

 Structured reporting (SR) is increasingly used. So far, there is minimal experience with SR in whole-body computed tomography (WBCT). The aim of this study was to investigate the value of routine use of SR in WBCT in trauma with a focus on reporting time, reporting errors, and referrer satisfaction.

MATERIALS AND METHODS

 Reporting time and reporting errors of CT reports were prospectively quantified for residents and board-certified radiologists 3 months before and for 6 months after implementation of a structured report in the clinical routine. Referrer satisfaction was prospectively quantified by means of a survey before and after the implementation period of SR using a 5-point Likert scale. Before and after results were compared to determine the effect of structured reporting on WBCT in trauma at our institution.

RESULTS

 The mean reporting time was lower when using SR (65 ± 52 min. vs. 87 ± 124 min., p = .25). After 4 months, the median reporting time was significantly lower with SR (p = .02). Consequently, the rate of reports that were finished within one hour rose from 55.1 % to 68.3 %. Likewise, reporting errors decreased (12.6 % vs. 8.4 %, p = .48). Residents and board-certified radiologists reported fewer errors when using SR with 16.4 % vs. 12.6 % and 8.8 % vs. 2.7 %, respectively. General referrer satisfaction improved (1.7 ± 0.8 vs. 1.5 ± 1.1, p = .58). Referrers graded improvements for standardization of reports (2.2 ± 1.1 vs. 1.3 ± 1.1, p = .03), consistency of report structure (2.1 ± 1.1 vs. 1.4 ± 1.1, p = .09), and retrievability of relevant pathologies (2.1 ± 1.2 vs. 1.6 ± 1.1, p = .32).

CONCLUSION

 SR has the potential to facilitate process improvement for WBCT in trauma in the daily routine with a reduction of reporting time and reporting mistakes while increasing referrer satisfaction.

KEY POINTS

· SR for WBCT in trauma is feasable in clinical routine.. · Reporting time in WBCT in trauma decreases by SR.. · SR for WBCT in trauma has the potential to decrease reporting mistakes.. · SR for WBCT in trauma might increase referrer satisfaction..

CITATION FORMAT

· Blum SF, Hertzschuch D, Langer E et al. Routine Use of Structured Reporting in Whole-body Trauma CT Facilitates Quality Improvement. Fortschr Röntgenstr 2023; DOI: 10.1055/a-2031-2364.

Eye-tracking differences between free text and template radiology reports: a pilot study

Purpose

One possible limitation of structured template radiology reports is that radiologists look back and forth between viewing and dictation monitors, thereby impacting the length of time spent reviewing images and generating a report. We hypothesize that the total time spent viewing case images is diminished and/or the total time spent creating a report is prolonged when the report is generated using a structured template compared with free text format.

Approach

Three neuroradiologists and three senior residents viewed five brain magnetic resonance imaging cases with unique findings while eye position was recorded. Participants generated reports for each case utilizing both structured templates and free text dictation. The time spent viewing images was compared with the time spent looking at the dictation screen.

Results

The two main hypotheses were confirmed: the total time viewing images diminished with templates versus free text dictation and the total time to create a report was prolonged with templates. The mean time (s) spent on the "image" region of interest approached statistical significance as a function of the report type [free: attendings = 236.79 (154.43), residents = 223.55 (77.79); template: attendings = 163.40 (73.42), residents = 182.48 (77.47)] and was overall lower with the template reporting for both attendings and residents ( F = 3.77 , p = 0.0623 ), but it did not differ as a function of seniority ( F = 0.017 , p = 0.8977 ).

Conclusions

Template-based radiology reports have significant potential to alter the way radiologists view images and report on them, spending more time viewing the report monitor rather than diagnostic images compared with free text dictation. Many radiologists prefer templates for reporting as the structured format may aid in conducting a more systematic or thorough search for findings, although prior work on this assumption is mixed. Future eye-tracking studies could further elucidate whether and how templates and free reports impact the detection and classification of radiographic findings.

Improving data adequacy of ultrasonography reports for non-alcoholic fatty liver disease (NAFLD) through a national structured template

BACKGROUND

Non-alcoholic fatty liver disease (NAFLD) is a prevalent disorder that increases due to lifestyle, the rising rate of obesity, and population ages worldwide. Diagnostic ways, including sonography, do not have an explicit reporting structure.

PURPOSE

To create a structure template for NAFLD reporting, investigate its completeness, and assess the specialist opinions of using it in clinical practice.

MATERIAL AND METHODS

A structured reporting template (SRT) was designed and implemented in four stages. At first, important features were extracted from a comprehensive literature review and were evaluated by 10 radiologists and gastroenterologists using the Likert scale. Finally, the usefulness of the SRT in comparison with the conventional reporting template (CRT) was judged by 10 gastroenterologists completing the questionnaire.

RESULTS

Demographic information and sonography of the liver, gallbladder, and spleen organs were the most critical features. The completeness scores of SRT reports were higher than CRT scores for almost all the factors studied. The difference in the scores was significant for most of the parameters. Moreover, the total completeness score increased from 42% in CRT to 92% in SRT. A comparison of the report adequacy of two reports was seen in all items. The SRT obtained more rates from specialists.

CONCLUSION

Introduction of the SRT for NAFLD significantly enhanced the completeness of reporting to reduce variability in the interpretation of the related reports by clinicians. Nevertheless, more studies are needed to generalize the results in real scales for patients with NAFLD.

Structured reporting of computed tomography in the polytrauma patient assessment: a Delphi consensus proposal

OBJECTIVES

To develop a structured reporting (SR) template for whole-body CT examinations of polytrauma patients, based on the consensus of a panel of emergency radiology experts from the Italian Society of Medical and Interventional Radiology.

METHODS

A multi-round Delphi method was used to quantify inter-panelist agreement for all SR sections. Internal consistency for each section and quality analysis in terms of average inter-item correlation were evaluated by means of the Cronbach's alpha (Cα) correlation coefficient.

RESULTS

The final SR form included 118 items (6 in the "Patient Clinical Data" section, 4 in the "Clinical Evaluation" section, 9 in the "Imaging Protocol" section, and 99 in the "Report" section). The experts' overall mean score and sum of scores were 4.77 (range 1-5) and 257.56 (range 206-270) in the first Delphi round, and 4.96 (range 4-5) and 208.44 (range 200-210) in the second round, respectively. In the second Delphi round, the experts' overall mean score was higher than in the first round, and standard deviation was lower (3.11 in the second round vs 19.71 in the first round), reflecting a higher expert agreement in the second round. Moreover, Cα was higher in the second round than in the first round (0.97 vs 0.87).

CONCLUSIONS

Our SR template for whole-body CT examinations of polytrauma patients is based on a strong agreement among panel experts in emergency radiology and could improve communication between radiologists and the trauma team.

Universal Liver Imaging Lexicon: Imaging Atlas for Research and Clinical Practice

The use of standardized terms in assessing and reporting disease processes has well-established benefits, such as clear communication between radiologists and other health care providers, improved diagnostic accuracy and reproducibility, and the enhancement and facilitation of research. Recently, the Liver Imaging Reporting and Data System (LI-RADS) Steering Committee released a universal liver imaging lexicon. The current version of the lexicon includes 81 vetted and precisely defined terms that are relevant to acquisition of images using all major liver imaging modalities and contrast agents, as well as lesion- and organ-level features. Most terms in the lexicon are applicable to all patients undergoing imaging of the liver, and only a minority of the terms are strictly intended to be used for patients with high risk factors for hepatocellular carcinoma. This pictorial atlas familiarizes readers with the liver imaging lexicon and includes discussion of general concepts, providing sample definitions, schematics, and clinical examples for a subset of the terms in the liver imaging lexicon. The authors discuss general, technical, and imaging feature terms used commonly in liver imaging, with the goal of illustrating their use for clinical and research applications. Work of the U.S. Government published under an exclusive license with the RSNA. Online supplemental material is available for this article.

Structured report improves radiology residents' performance in reporting chest high-resolution computed tomography: a study in patients with connective tissue disease

PURPOSE To evaluate the performance of radiology residents (RRs) when using a dedicated structured report (SR) template for chest HRCT in patients with suspected connective tissue disease-interstitial lung disease (CTD-ILD), compared to the traditional narrative report (NR). METHODS We retrospectively evaluated 50 HRCT exams in patients with suspected CTD-ILD. A chest-devoted radiologist reported all the HRCT exams as the reference standard, pointing out pulmonary fibrosis findings (i.e., honeycombing, traction bronchiectasis, reticulation, and volume loss), presence and pattern of ILD, and possible other diagnoses. We divided four RRs into two groups according to their expertise level. In each group, RRs reported all HRCT examinations alternatively with NR or SR, noting each report's reporting time. The Cohen's Kappa, Wilcoxon, and McNemar tests were used for statistical analysis. RESULTS Regarding the pulmonary fibrosis findings, we found higher agreement between RRs and the reference standard reader when using SR than NR, regardless of their expertise level, except for volume loss.RRs' accuracy for "other diagnosis" was higher when using SR than NR, moving from 0.48 to 0.66 in the novel group (p = 0.035) and from 0.44 to 0.80 in the expertise group (p < 0.001). No differences in accuracy were found between ILD presence and ILD pattern. The reporting time was significantly lower (p = 0.001) when using SR than NR. CONCLUSION SR is of value in increasing the reporting of critical chest HRCT findings in the complex CTD-ILD scenario and should be used early and systematically during the residency.

Comparison of the clinical usefulness of structured and free-text reports for interpretation of jaw lesions on cone beam computed tomography images

OBJECTIVE

This study compared the clinical usefulness of structured reports (SRs) and free-text reports (FTRs) of lesions depicted on cone beam computed tomography (CBCT) images from the perspectives of report providers and receivers.

STUDY DESIGN

In total, 36 CBCT images of jaw lesions obtained between February 2020 and August 2020 were evaluated. A working group of 3 oral and maxillofacial radiologists (OMRs) established a reporting system and prepared reports. Evaluation group I (2 OMRs) wrote SRs and FTRs for each case and assessed the reporting process for the criteria of convenience and organization. Evaluation group II (3 general practitioners [GPs] and 3 oral and maxillofacial surgeons [OMSs]) assessed the reports for the criteria of productivity, consistency, and organization. A 5-point Likert scale was used to assess the usefulness of each report. Scores were statistically compared according to report type with the paired Wilcoxon signed-rank test.

RESULTS

The SRs scored significantly higher for all criteria as assessed by evaluation group I and the GPs of group II (P < .001). The FTRs scored significantly higher for productivity and organization as assessed by the OMSs of group II (P = .005 for both criteria).

CONCLUSIONS

The clinical usefulness of reports may differ according to roles of the report recipients in diagnosis and treatment.

Quantifying the Effects of Structured Reporting on Report Turnaround Times and Proofreading Workload in Neuroradiology

RATIONALE AND OBJECTIVES

To assess the effects of a change from free text reporting to structured reporting on resident reports, the proofreading workload and report turnaround times in the neuroradiology daily routine.

MATERIALS AND METHODS

Our neuroradiology section introduced structured reporting templates in July 2019. Reports dictated by residents during dayshifts from January 2019 to March 2020 were retrospectively assessed using quantitative parameters from report comparison. Through automatic analysis of text-string differences between report states (i.e. draft, preliminary and final report), Jaccard similarities and edit distances of reports following read-out sessions as well as after report sign-off were calculated. Furthermore, turnaround times until preliminary and final report availability to clinicians were investigated. Parameters were visualized as trending line graphs and statistically compared between reporting standards.

RESULTS

Three thousand five hundred thirty-eight reports were included into analysis. Mean Jaccard similarity of resident drafts and staff-reviewed final reports increased from 0.53 ± 0.37 to 0.79 ± 0.22 after the introduction of structured reporting (p < .001). Both mean overall edits on draft reports by residents following read-out sessions (0.30 ± 0.45 vs. 0.09 ± 0.29; p < .001) and by staff radiologists during report sign-off (0.17 ± 0.28 vs. 0.12 ± 0.23, p < .001) decreased. With structured reporting, mean turnaround time until preliminary report availability to clinicians decreased by 20.7 minutes (246.9 ± 207.0 vs. 226.2 ± 224.9; p < .001). Similarly, final reports were available 35.0 minutes faster on average (558.05 ± 15.1 vs. 523.0 ± 497.3; p = .002).

CONCLUSION

Structured reporting is beneficial in the neuroradiology daily routine, as resident drafts require fewer edits in the report review process. This reduction in proofreading workload is likely responsible for lower report turnaround times.

Structured Reports and Radiology Residents: Friends or Foes?

Structured reports offer overall improvement in quality and safety, largely centered upon more effective communication. Structured reporting is helpful to trainees as a method to develop organized search patterns and include pertinent positive and negative findings. However, limitations of structured report use include lack of development of individualized search patterns and failure to recognize key elements of the report to be formulated in the impression. Instruction on the value of a structured reporting approach, its impact on patient care and clinical service, and compliance with billing requirements must be balanced with early and consistent feedback on appropriate use and reporting errors. It is incumbent upon radiology educators to integrate and optimize structured reporting in the learning environment. This manuscript addresses the impact of structured reporting on radiology education, reviewing quality and safety considerations, detailing benefits and drawbacks for trainees, and offering strategies for optimizing the use of structured reporting/templates in the training environment.

Structured reporting in radiology: a systematic review to explore its potential

OBJECTIVES

Structured reporting (SR) in radiology reporting is suggested to be a promising tool in clinical practice. In order to implement such an emerging innovation, it is necessary to verify that radiology reporting can benefit from SR. Therefore, the purpose of this systematic review is to explore the level of evidence of structured reporting in radiology. Additionally, this review provides an overview on the current status of SR in radiology.

METHODS

A narrative systematic review was conducted, searching PubMed, Embase, and the Cochrane Library using the syntax 'radiol*' AND 'structur*' AND 'report*'. Structured reporting was divided in SR level 1, structured layout (use of templates and checklists), and SR level 2, structured content (a drop-down menu, point-and-click or clickable decision trees). Two reviewers screened the search results and included all quantitative experimental studies that discussed SR in radiology. A thematic analysis was performed to appraise the evidence level.

RESULTS

The search resulted in 63 relevant full text articles out of a total of 8561 articles. Thematic analysis resulted in 44 SR level 1 and 19 level 2 reports. Only one paper was scored as highest level of evidence, which concerned a double cohort study with randomized trial design.

CONCLUSION

The level of evidence for implementing SR in radiology is still low and outcomes should be interpreted with caution.

KEY POINTS

• Structured reporting is increasingly being used in radiology, especially in abdominal and neuroradiological CT and MRI reports. • SR can be subdivided into structured layout (SR level 1) and structured content (SR level 2), in which the first is defined as being a template in which the reporter has to report; the latter is an IT-based manner in which the content of the radiology report can be inserted and displayed into the report. • Despite the extensive amount of research on the subject of structured reporting, the level of evidence is low.

Structured reporting of computed tomography in the staging of colon cancer: a Delphi consensus proposal

BACKGROUND

Structured reporting (SR) in radiology is becoming increasingly necessary and has been recognized recently by major scientific societies. This study aims to build structured CT-based reports in colon cancer during the staging phase in order to improve communication between the radiologist, members of multidisciplinary teams and patients.

MATERIALS AND METHODS

A panel of expert radiologists, members of the Italian Society of Medical and Interventional Radiology, was established. A modified Delphi process was used to develop the SR and to assess a level of agreement for all report sections. Cronbach's alpha (Cα) correlation coefficient was used to assess internal consistency for each section and to measure quality analysis according to the average inter-item correlation.

RESULTS

The final SR version was built by including n = 18 items in the "Patient Clinical Data" section, n = 7 items in the "Clinical Evaluation" section, n = 9 items in the "Imaging Protocol" section and n = 29 items in the "Report" section. Overall, 63 items were included in the final version of the SR. Both in the first and second round, all sections received a higher than good rating: a mean value of 4.6 and range 3.6-4.9 in the first round; a mean value of 5.0 and range 4.9-5 in the second round. In the first round, Cronbach's alpha (Cα) correlation coefficient was a questionable 0.61. In the first round, the overall mean score of the experts and the sum of scores for the structured report were 4.6 (range 1-5) and 1111 (mean value 74.07, STD 4.85), respectively. In the second round, Cronbach's alpha (Cα) correlation coefficient was an acceptable 0.70. In the second round, the overall mean score of the experts and the sum of score for structured report were 4.9 (range 4-5) and 1108 (mean value 79.14, STD 1.83), respectively. The overall mean score obtained by the experts in the second round was higher than the overall mean score of the first round, with a lower standard deviation value to underline greater agreement among the experts for the structured report reached in this round.

CONCLUSIONS

A wide implementation of SR is of critical importance in order to offer referring physicians and patients optimum quality of service and to provide researchers with the best quality data in the context of big data exploitation of available clinical data. Implementation is a complex procedure, requiring mature technology to successfully address the multiple challenges of user-friendliness, organization and interoperability.

Computed Tomography Structured Reporting in the Staging of Lymphoma: A Delphi Consensus Proposal

Structured reporting (SR) in radiology is becoming increasingly necessary and has been recognized recently by major scientific societies. This study aims to build structured CT-based reports for lymphoma patients during the staging phase to improve communication between radiologists, members of multidisciplinary teams, and patients. A panel of expert radiologists, members of the Italian Society of Medical and Interventional Radiology (SIRM), was established. A modified Delphi process was used to develop the SR and to assess a level of agreement for all report sections. The Cronbach's alpha (Cα) correlation coefficient was used to assess internal consistency for each section and to measure quality analysis according to the average inter-item correlation. The final SR version was divided into four sections: (a) Patient Clinical Data, (b) Clinical Evaluation, (c) Imaging Protocol, and (d) Report, including n = 13 items in the "Patient Clinical Data" section, n = 8 items in the "Clinical Evaluation" section, n = 9 items in the "Imaging Protocol" section, and n = 32 items in the "Report" section. Overall, 62 items were included in the final version of the SR. A dedicated section of significant images was added as part of the report. In the first Delphi round, all sections received more than a good rating (≥3). The overall mean score of the experts and the sum of score for structured report were 4.4 (range 1-5) and 1524 (mean value of 101.6 and standard deviation of 11.8). The Cα correlation coefficient was 0.89 in the first round. In the second Delphi round, all sections received more than an excellent rating (≥4). The overall mean score of the experts and the sum of scores for structured report were 4.9 (range 3-5) and 1694 (mean value of 112.9 and standard deviation of 4.0). The Cα correlation coefficient was 0.87 in this round. The highest overall means value, highest sum of scores of the panelists, and smallest standard deviation values of the evaluations in this round reflect the increase of the internal consistency and agreement among experts in the second round compared to first round. The accurate statement of imaging data given to referring physicians is critical for patient care; the information contained affects both the decision-making process and the subsequent treatment. The radiology report is the most important source of clinical imaging information. It conveys critical information about the patient's health and the radiologist's interpretation of medical findings. It also communicates information to the referring physicians and records this information for future clinical and research use. The present SR was generated based on a multi-round consensus-building Delphi exercise and uses standardized terminology and structures, in order to adhere to diagnostic/therapeutic recommendations and facilitate enrolment in clinical trials, to reduce any ambiguity that may arise from non-conventional language, and to enable better communication between radiologists and clinicians.

Structured Reporting of Whole-Body Trauma CT Scans Using Checklists: Diagnostic Accuracy of Reporting Radiologists Depending on Their Level of Experience

PURPOSE

 Evaluation of the diagnostic accuracy of a checklist-style structured reporting template in the setting of whole-body multislice computed tomography in major trauma patients depending on the level of experience of the reporting radiologist.

MATERIALS AND METHODS

 A total of 140 major trauma scans with the same protocol were included in this retrospective study. In a purely trial-intended reading, the trauma scans were analyzed by three radiologists with different levels of experience (resident, radiologist with 3 years of experience after board certification, and radiologist with 7 years of experience after board certification). The aim was to fill in the checklist 1 template within one minute to immediately diagnose management-altering findings. Checklist 2 was intended for the analysis of important trauma-related findings within 10 minutes. Reading times were documented. The final radiology report and the documented injuries in the patient's medical record were used as gold standard.

RESULTS

 The evaluation of checklist 1 showed a range of false-negative reports between 5.0 % and 11.4 % with the resident showing the highest accuracy. Checklist 2 showed overall high diagnostic inaccuracy (19.3-35.0 %). The resident's diagnostic accuracy was statistically significantly higher compared to the radiologist with 3 years of experience after board certification (p = 0.0197) and with 7 years of experience after board certification (p = 0.0046). Shorter average reporting time resulted in higher diagnostic inaccuracy. Most of the missed diagnoses were fractures of the spine and ribs.

CONCLUSION

 By using a structured reporting template in the setting of major trauma computed tomography, less experienced radiologists reach a higher diagnostic accuracy compared to experienced readers.

KEY POINTS

  · In the setting of a pure trial reading, the diagnostic inaccuracy of template-based reporting of major trauma CT examinations is high.. · Fractures in general and especially of the vertebral bodies and ribs were the most commonly missed diagnoses.. · In a study setting, less experienced radiologists seem to reach a higher diagnostic accuracy when using a structured reporting approach..

CITATION FORMAT

· Dendl LM, Pausch AM, Hoffstetter P et al. Structured Reporting of Whole-Body Trauma CT Scans Using Checklists: Diagnostic Accuracy of Reporting Radiologists Depending on Their Level of Experience. Fortschr Röntgenstr 2021; DOI: 10.1055/a-1541-8265.

Structured MRI reporting increases completeness of radiological reports and requesting physicians' satisfaction in the diagnostic workup for pelvic endometriosis

PURPOSE

MRI plays an important role in the diagnosis and surgical planning of pelvic endometriosis (PE), and imaging reports should contain all relevant information (completeness). As structured reports are being increasingly utilized, we aimed to evaluate whether structured MRI reporting increases the quality of reports regarding completeness and, consequently, their perceived value by gynecologists, in comparison to free-text reports. We also aimed to compare the diagnostic performance of both formats.

METHODS

We retrospectively included 28 consecutive women with histologically proven PE who underwent MRI within one month before surgery. Two abdominal radiologists (Rd1/Rd2, 3y/12y experience), blinded to clinical and surgical data, individually elaborated free-text reports and, four months later, structured reports. Completeness (defined as description of six key anatomical sites deemed essential for surgical planning in a consensus of four-blinded external experts) and diagnostic performance (sensitivity and specificity) by site (histology as reference) were compared between reports using the McNemar test. The satisfaction of gynecologists was compared using the marginal homogeneity test.

RESULTS

Structured reporting increased completeness for both Rd1 (rectosigmoid, retrocervical/uterosacral ligament, vagina, and ureter) and Rd2 (vagina, ureter, and bladder) (p < 0.05), without compromising sensitivity or specificity at any of the evaluated sites. Gynecologists' satisfaction was superior with structured reports in most comparisons.

CONCLUSION

Structured MRI reports perform better in fully documenting essential features of PE and are similar in terms of diagnostic performance, therefore having higher potential for surgical planning. Gynecologists found them easier to assess and were more satisfied with the information provided by structured reports.

Structured reporting of brain MRI following mechanical thrombectomy in acute ischemic stroke patients

Background

To compare the quality of free-text reports (FTR) and structured reports (SR) of brain magnetic resonance imaging (MRI) examinations in patients following mechanical thrombectomy for acute stroke treatment.

Methods

A template for SR of brain MRI examinations based on decision trees was designed and developed in house and applied to twenty patients with acute ischemic stroke in addition to FTR. Two experienced stroke neurologists independently evaluated the quality of FTR and SR regarding clarity, content, presence of key features, information extraction, and overall report quality. The statistical analysis for the differences between FTR and SR was performed using the Mann–Whitney U-test or the Chi-squared test.

Results

Clarity (p < 0.001), comprehensibility (p < 0.001), inclusion of relevant findings (p = 0.016), structure (p = 0.005), and satisfaction with the content of the report for immediate patient management (p < 0.001) were evaluated significantly superior for the SR by both neurologist raters. One rater additionally found the explanation of the patient’s clinical symptoms (p = 0.003), completeness (p < 0.009) and length (p < 0.001) of SR to be significantly superior compared to FTR and stated that there remained no open questions, requiring further consultation of the radiologist (p < 0.001). Both neurologists preferred SR over FTR.

Conclusions

The use of SR for brain magnetic resonance imaging may increase the report quality and satisfaction of the referring physicians in acute ischemic stroke patients following mechanical thrombectomy.

Trial registration Retrospectively registered.

Blind spots on CT imaging of the head: Insights from 5 years of report addenda at a single institution

BACKGROUND

Errors of detection ("misses") are the major source of error in radiology. There is sparse prior literature describing patterns of detection error on CT head imaging.

PURPOSE

The objective of this study was to gain insight to areas on CT head imaging where radiologists are most likely to miss clinically relevant findings.

METHODS

We performed a cross-sectional study of consecutive reports of CT imaging of the head at a single institution spanning 5/1/2013-5/1/2018 (5 years). Detection errors described in addenda were categorized according to anatomic location, type of pathology, and potential impact on management. Blind spots were defined by the most common sites of missed findings.

RESULTS

A total of 165,943 reports for CT head imaging were obtained. Addenda were found in 1658 (~1%) of reports, of which 359 (21.7%) described errors of detection. Within the extracranial soft tissues (n = 73) the most common "misses" were at incidentally imaged parotid glands and the frontal scalp. Within osseous structures (n = 149), blind spots included the nasal and occipital bones. Vascular lesions (n = 47) which passed detection were most common at the distal MCA, carotid terminus and sigmoid sinus/jugular bulb. No predisposition was seen for anatomic subsites within the CSF space (n = 60) and brain parenchyma (n = 65).

CONCLUSIONS

Consistent patterns of blind spots are revealed. Radiologic teaching and search patterns to account for these sites of error may accelerate trainee competence and improve accuracy in the practice of radiology.

Improving Billing Accuracy Through Enterprise-Wide Standardized Structured Reporting With Cross-Divisional Shared Templates

OBJECTIVE

We describe our experience in implementing enterprise-wide standardized structured reporting for chest radiographs (CXRs) via change management strategies and assess the economic impact of structured template adoption.

METHODS

Enterprise-wide standardized structured CXR reporting was implemented in a large urban health care enterprise in two phases from September 2016 to March 2019: initial implementation of division-specific structured templates followed by introduction of auto launching cross-divisional consensus structured templates. Usage was tracked over time, and potential radiologist time savings were estimated. Correct-to-bill (CTB) rates were collected between January 2018 and May 2019 for radiography.

RESULTS

CXR structured template adoption increased from 46% to 92% in phase 1 and to 96.2% in phase 2, resulting in an estimated 8.5 hours per month of radiologist time saved. CTB rates for both radiographs and all radiology reports showed a linearly increasing trend postintervention with radiography CTB rate showing greater absolute values with an average difference of 20% throughout the sampling period. The CTB rate for all modalities increased by 12%, and the rate for radiography increased by 8%.

DISCUSSION

Change management strategies prompted adoption of division-specific structured templates, and exposure via auto launching enforced widespread adoption of consensus templates. Standardized structured reporting resulted in both economic gains and projected radiologist time saved.

Objective comparison of errors and report length between structured and freeform abdominopelvic computed tomography reports

PURPOSE

To objectively compare structured and freeform abdominopelvic CT reports based on the number and types of errors as well as report length.

METHODS

90 structured and 89 freeform reports from abdominopelvic CT scans with IV contrast obtained for the indication of abdominal pain were randomly selected for review. Each report was reviewed for errors, which were counted and categorized based on the type of error. The total number of words in each report was tallied.

RESULTS

105 total errors were found in the structured reports, compared to 157 total errors in freeform reports. There were 1.16 errors per structured report and 1.76 errors per freeform report (p < 0.001). 48% of structured reports contained at least one error, while 71% of freeform reports contained at least one error (p = 0.002). When a difference existed between the styles with regard to error categories, more errors were observed in freeform reports, with the exception of the duplicated period error where structured reports had more errors. No difference on the basis of average words per report existed, with 219.2 words per report for each reporting style.

CONCLUSION

The use of structured reporting for abdominopelvic CT results in less errors in the report when compared to freeform reporting, potentially reducing clinically significant adverse outcomes in patient care. The report length on the basis of number of words per report is not different between the two reporting styles.

Structured Reporting of Computed Tomography in the Staging of Neuroendocrine Neoplasms: A Delphi Consensus Proposal

BACKGROUND

Structured reporting (SR) in radiology is becoming increasingly necessary and has been recognized recently by major scientific societies. This study aims to build structured CT-based reports in Neuroendocrine Neoplasms during the staging phase in order to improve communication between the radiologist and members of multidisciplinary teams.

MATERIALS AND METHODS

A panel of expert radiologists, members of the Italian Society of Medical and Interventional Radiology, was established. A Modified Delphi process was used to develop the SR and to assess a level of agreement for all report sections. Cronbach's alpha (Cα) correlation coefficient was used to assess internal consistency for each section and to measure quality analysis according to the average inter-item correlation.

RESULTS

The final SR version was built by including n=16 items in the "Patient Clinical Data" section, n=13 items in the "Clinical Evaluation" section, n=8 items in the "Imaging Protocol" section, and n=17 items in the "Report" section. Overall, 54 items were included in the final version of the SR. Both in the first and second round, all sections received more than a good rating: a mean value of 4.7 and range of 4.2-5.0 in the first round and a mean value 4.9 and range of 4.9-5 in the second round. In the first round, the Cα correlation coefficient was a poor 0.57: the overall mean score of the experts and the sum of scores for the structured report were 4.7 (range 1-5) and 728 (mean value 52.00 and standard deviation 2.83), respectively. In the second round, the Cα correlation coefficient was a good 0.82: the overall mean score of the experts and the sum of scores for the structured report were 4.9 (range 4-5) and 760 (mean value 54.29 and standard deviation 1.64), respectively.

CONCLUSIONS

The present SR, based on a multi-round consensus-building Delphi exercise following in-depth discussion between expert radiologists in gastro-enteric and oncological imaging, derived from a multidisciplinary agreement between a radiologist, medical oncologist and surgeon in order to obtain the most appropriate communication tool for referring physicians.

Discrepant Reporting Style Preferences Between Clinicians and Radiologists

RATIONALE AND OBJECTIVES

To compare preferences in reporting styles between radiologists and clinicians in structured vs unstructured reporting styles in order to facilitate better communication.

METHODS

An online survey was distributed to 5280 clinicians, radiologists, and physicians in training surveying respondent preference for three different reporting styles: expanded structured, minimized structured, and unstructured.

RESULTS

A 7.5% response rate was achieved. Overall, the expanded structured reporting style was the most preferred (47%, 186/394). This contrasted with radiologists who preferred the unstructured reporting style (41%), whereas nonradiologists preferred the expanded structured reporting style (51%; P < 0.001). There was significance in emergency medicine physicians preferring the minimized structured reporting style (51%, 27/43), whereas all other specialties preferred the expanded structured report (49%, 168/341; P = 0.0038).

DISCUSSION

There is a discrepant reporting style preference between clinicians and radiologists. A structured reporting style with expanded standard statements is preferred by most physicians. Radiologists could consider using a structured reporting style with minimized normal statements in the emergency room setting.

The role of structured reporting and structured operation planning in functional endoscopic sinus surgery

Computed tomography (CT) scans represent the gold standard in the planning of functional endoscopic sinus surgeries (FESS). Yet, radiologists and otolaryngologists have different perspectives on these scans. In general, residents often struggle with aspects involved in both reporting and operation planning. The aim of this study was to compare the completeness of structured reports (SR) of preoperative CT images and structured operation planning (SOP) to conventional reports (CR) and conventional operation planning (COP) to potentially improve future treatment decisions on an individual level. In total, 30 preoperative CT scans obtained for surgical planning of patients scheduled for FESS were evaluated using SR and CR by radiology residents. Subsequently, otolaryngology residents performed a COP using free texts and a SOP using a specific template. All radiology reports and operation plannings were evaluated by two experienced FESS surgeons regarding their completeness for surgical planning. User satisfaction of otolaryngology residents was assessed by using visual analogue scales. Overall radiology report completeness was significantly higher using SRs regarding surgically important structures compared to CRs (84.4 vs. 22.0%, p<0.001). SOPs produced significantly higher completeness ratings (97% vs. 39.4%, p<0.001) regarding pathologies and anatomical variances. Moreover, time efficiency was not significantly impaired by implementation of SR (148 s vs. 160 s, p = 0.61) and user satisfaction was significantly higher for SOP (VAS 8.1 vs. 4.1, p<0.001). Implementation of SR and SOP results in a significantly increased completeness of radiology reports and operation planning for FESS. Consequently, the combination of both facilitates surgical planning and may decrease potential risks during FESS.

"The eye sees only what the mind is prepared to comprehend": Unrecognized incidental findings on intraoperative computed tomography during spine instrumentation surgery

BACKGROUND

Intraoperative computed tomography (CT) is becoming more widely utilized in spine fusion surgeries. The use of CT-based image guidance has been shown to increase the accuracy in instrumentation placement and to reduce the rate of reoperation. However, incidental findings that are obvious in retrospect are still missed in spinal fusion surgeries due to the concept of inattentional blindness and surgeons' preoccupation with the main objective of intraoperative CT (i.e. instrumentation accuracy).

CASE DESCRIPTION

The first case describes a 60-year-old male who underwent posterior spinal laminectomy and interbody fusions from L2-L5. Intraoperative CT confirmed appropriate placement of hardware. However, when he was transferred out to the care unit and extubated, he developed a severe headache for which the source was confirmed to be a pneumocephalus from durotomy and cerebrospinal fluid leakage on repeat CT. A retrospective review of his intraoperative CT demonstrated the intrathecal air at L5-S1 interlaminar space that was missed on evaluation during surgery. The second case describes a 68-year-old female who was treated with a successful T4 to pelvis instrumentation and fusion with vertebral column resection at T10 confirmed with imaging. Postoperatively, she developed rapidly progressive oxygen desaturation and was found to have a pneumothorax which had been present on the intraoperative imaging.

CONCLUSION

This case report of two patients with missed intraoperative findings demonstrates the importance of looking beyond instrumentation placement and evaluating the entire intraoperative CT imaging to find abnormalities that could complicate the patients' postoperative recovery and overall hospital stay.

The use of imaging to identify immunocompromised children requiring biopsy for invasive fungal rhinosinusitis

BACKGROUND AND PURPOSE

Children with severe immunocompromise due to cancer therapy or hematopoietic cell transplant are at risk both for potentially lethal invasive fungal rhinosinusitis (IFRS), and for complications associated with gold-standard biopsy diagnosis. We investigated whether early imaging could reliably identify or exclude IFRS in this population, thereby reducing unnecessary biopsy.

METHODS

We reviewed clinical/laboratory data and cross-sectional imaging from 31 pediatric patients evaluated for suspicion of IFRS, 19 without (age 11.8 ± 5.4 years) and 12 with proven IFRS (age 11.9 ± 4.6 years). Imaging examinations were graded for mucosal thickening (Lund score), for fungal-specific signs (FSS) of bone destruction, extra-sinus inflammation, and nasal mucosal ulceration. Loss of contrast enhancement (LoCE) was assessed separately where possible. Clinical and imaging findings were compared with parametric or nonparametric tests as appropriate. Diagnostic accuracy was assessed by receiver operating characteristic (ROC) analysis. Positive (+LR) and negative likelihood ratios (-LR) and probabilities were calculated.

RESULTS

Ten of 12 patients with IFRS and one of 19 without IFRS had at least one FSS on early imaging (83% sensitive, 95% specific, +LR = 15.83, -LR = 0.18; P < .001). Absolute neutrophil count (ANC) ≤ 200/mm³ was 100% sensitive and 58% specific for IFRS (+LR = 2.38, -LR = 0; P = .001). Facial pain was the only discriminating symptom of IFRS (P < .001). In a symptomatic child with ANC ≤ 200/m³ , the presence of at least one FSS indicated high (79%) probability of IFRS; absence of FSS suggested low (<4%) probability.

CONCLUSION

In symptomatic, severely immunocompromised children, the presence or absence of fungal-specific imaging findings may effectively rule in or rule out early IFRS, potentially sparing some patients the risks associated with biopsy.

Analysis of Different Levels of Structured Reporting in Knee Magnetic Resonance Imaging

RATIONALE AND OBJECTIVES

The aim of this study is to investigate the most appropriate knee MRI report template that not only provides structure and consistency, but also allows enough narrative freedom for the logical organization of findings and improved communication with the orthopedic referral base.

MATERIALS AND METHODS

Three fictitious knee MRI reports were created using templates with different levels of structuring: unstructured free text (FT), structured with headers (SH), and highly structured and itemized (SI). These were then distributed to clinicians in the orthopedics department at all levels of training along with a survey with numerical scoring questions on report readability, usefulness, and quality. Statistical analysis was used to evaluate the data.

RESULTS

Fifty-three surveys were completed with responses from residents, attendings, and physician assistants. The structured format with headers had statistically significant (p value <0.001) higher mean rank score in readability, usefulness, and quality parameters compared to the unstructured FT and highly SI report templates. Most clinicians (83%) found the structured format with headers to be the most coherent report. Conversely, 53% found the unstructured FT and 43% found the highly SI templates to be the most disjointed.

CONCLUSION

Based on responses to surveys of knee MRI report templates, our results show that our orthopedic clinicians prefer some level of structure in the reports but not the rigorous itemization of anatomic tissues. A "middle ground" reporting structure which includes headers for different anatomic compartments and allows for grouping of relevant pathology, is shown to be the preferred format.

Revealing the most common reporting errors through data mining of the report proofreading process

Objectives

To investigate the most common errors in residents’ preliminary reports, if structured reporting impacts error types and frequencies, and to identify possible implications for resident education and patient safety.

Material and methods

Changes in report content were tracked by a report comparison tool on a word level and extracted for 78,625 radiology reports dictated from September 2017 to December 2018 in our department. Following data aggregation according to word stems and stratification by subspecialty (e.g., neuroradiology) and imaging modality, frequencies of additions/deletions were analyzed for findings and impression report section separately and compared between subgroups.

Results

Overall modifications per report averaged 4.1 words, with demonstrably higher amounts of changes for cross-sectional imaging (CT: 6.4; MRI: 6.7) than non-cross-sectional imaging (radiographs: 0.2; ultrasound: 2.8). The four most frequently changed words (right, left, one, and none) remained almost similar among all subgroups (range: 0.072–0.117 per report; once every 9–14 reports). Albeit representing only 0.02% of analyzed words, they accounted for up to 9.7% of all observed changes. Subspecialties solely using structured reporting had substantially lower change ratios in the findings report section (mean: 0.2 per report) compared with prose-style reporting subspecialties (mean: 2.0). Relative frequencies of the most changed words remained unchanged.

Conclusion

Residents’ most common reporting errors in all subspecialties and modalities are laterality discriminator confusions (left/right) and unnoticed descriptor misregistration by speech recognition (one/none). Structured reporting reduces overall error rates, but does not affect occurrence of the most common errors. Increased error awareness and measures improving report correctness and ensuring patient safety are required.

Key Points

• The two most common reporting errors in residents’ preliminary reports are laterality discriminator confusions (left/right) and unnoticed descriptor misregistration by speech recognition (one/none).

• Structured reporting reduces the overall the error frequency in the findings report section by a factor of 10 (structured reporting: mean 0.2 per report; prose-style reporting: 2.0) but does not affect the occurrence of the two major errors.

• Staff radiologist review behavior noticeably differs between radiology subspecialties.

Electronic supplementary material

The online version of this article (10.1007/s00330-020-07306-6) contains supplementary material, which is available to authorized users.

Common Data Elements in Head and Neck Radiology Reporting

Radiologists must convert the complex information in head and neck imaging into text reports that can be understood and used by clinicians, patients, and fellow radiologists for patient care, research, and quality initiatives. Common data elements in reporting, through use of defined questions with constrained answers and terminology, allow radiologists to incorporate best practice standards and improve communication of information regardless of individual reporting style. Use of common data elements for head and neck reporting has the potential to improve outcomes, reduce errors, and transition data consumption not only for humans but future machine learning systems.

Checklist design and implementation: critical considerations to improve patient safety for low-frequency, high-risk patient events

Purpose: This pilot project describes the development and implementation of two specialised aviation-style checklist designs for a low-frequency high-risk patient population in a cardiac intensive care unit. The effect of the checklist design as well as the implementation strategies on patient outcomes and adherence to best practice guidelines were also explored. The long-term objective was to improve adherence to accepted processes of care by establishing the checklists as standard practice thereby improving patient safety and outcomes.

Methods: During this project, 10specialised crisis checklists using two specific aviation-style designs were developed. A quasiexperimental prospective pre-post repeated measure design including surveys along with repetitive simulations were used to evaluate self-confidence and self-efficacy over time as well as the perceived utility, ease of use, fit into workflow and benefits of the checklists use to patients. Performance, patient outcomes and manikin outcomes were also used to evaluate the effectiveness of the crisis checklists on provider behaviours and patient outcomes.

Results: Overall self-confidence and self-confidence related to skills and knowledge while not significant demonstrated clinically relevant improvements that were sustained over time. Perceptions of the checklists were positive with consistent utilisation sustained over time. More importantly, use of the checklists demonstrated a reduction in errors both in the simulated and clinical setting.

Conclusion: Recommendations from this study consist of key considerations for development and implementation of checklists including: utilisation of stakeholders in the development phase; implementation in real and simulated environments; and ongoing reinforcement and training to sustain use.

Implementing Structured Clinical Templates at a Single Tertiary Hospital: Survey Study

Background

Electronic health record (EHR) systems have been widely adopted in hospitals. However, since current EHRs mainly focus on lowering the number of paper documents used, they have suffered from poor search function and reusability capabilities. To overcome these drawbacks, structured clinical templates have been proposed; however, they are not widely used owing to the inconvenience of data entry.

Objective

This study aims to verify the usability of structured templates by comparing data entry times.

Methods

A Korean tertiary hospital has implemented structured clinical templates with the modeling of clinical contents for the last 6 years. As a result, 1238 clinical content models (ie, body measurements, vital signs, and allergies) have been developed and 492 models for 13 clinical templates, including pathology reports, were applied to EHRs for clinical practice. Then, to verify the usability of the structured templates, data entry times from free-texts and four structured pathology report templates were compared using 4391 entries from structured data entry (SDE) log data and 4265 entries from free-text log data. In addition, a paper-based survey and a focus group interview were conducted with 23 participants from three different groups, including EHR developers, pathology transcriptionists, and clinical data extraction team members.

Results

Based on the analysis of time required for data entry, in most cases, beginner users of the structured clinical templates required at most 70.18% more time for data entry. However, as users became accustomed to the templates, they were able to enter data more quickly than via free-text entry: at least 1 minute and 23 seconds (16.8%) up to 5 minutes and 42 seconds (27.6%). Interestingly, well-designed thyroid cancer pathology reports required 14.54% less data entry time from the beginning of the SDE implementation. In the interviews and survey, we confirmed that most of the interviewees agreed on the need for structured templates. However, they were skeptical about structuring all the items included in the templates.

Conclusions

The increase in initial elapsed time led users to hold a negative opinion of SDE, despite its benefits. To overcome these obstacles, it is necessary to structure the clinical templates for optimum use. In addition, user experience in terms of ease of data entry must be considered as an essential aspect in the development of structured clinical templates.

Evaluation of Radiology Reports by the Emergency Department Clinical Providers: A Message to Radiologists

Objectives:

This study is an evaluation of the emergency department (ED) satisfaction with the current radiologic reporting system used at a major Northeastern academic medical center. The radiology reports are the main form of communication and usually the final product of any radiological investigation delivered to clinicians. The aim of this study was to improve current radiology reporting practices and to better tailor reports to match the needs and expectations of ED clinicians.

Methods:

A 9-question online survey was sent to ED residents, fellows, faculty, and nurse practitioners/advanced practice providers at a major Northeastern academic medical center in the United States. For the open-ended section, coding and emergent theme categorization was conducted for quantification of responses. The survey was designed to evaluate the attitudes toward the structure, style, form, and wording used in reports.

Results:

The response rate was 48.6% (68/140). The ED respondents were generally satisfied with radiology reports, their language, vocabulary, and clarity. They preferred the impression section to be before the findings in simple examinations and to stratify the reports according to emergency status for complex examinations. They did not like extended differential, hedge terms, and delayed reporting. Additionally, ED respondents recommended focused, fast reporting with considerable changes toward a more standardized report.

Conclusions:

This evaluation delivered a list of actionable recommendations. The top recommendation is to standardize reporting structure, style, and lexicon, in addition to being focused, timely, and brief.

Evidence of the benefits, advantages and potentialities of the structured radiological report: An integrative review

The structured report is a new trend for the preparation and manipulation of radiological examination reports. The structuring of the radiological report data can bring many benefits and advantages over other existing methodologies. Research and studies about the structured radiological report are highly relevant in clinical and academic subjects, improving medical practice, reducing unobserved problems by radiologists, improving reporting practices and medical diagnoses. Exposing the benefits, advantages and potential of the structured radiological report is important in encouraging the acceptance and implementation of this method by radiology professionals who are still somewhat resistant. The present review highlights the factors that contribute to the consolidation of adopting the structured radiology report methodology, addressing a variety of studies focused on the structuring of the radiological report. This integrative review of the literature is proposed by searching publications and journals databases (CAPES - Coordination of Improvement of Higher-Level Personnel, SciELO - Scientific Electronic Library Online, and PubMed - Publisher Medline) to develop a complete and unified understanding of the subject, so that it becomes a major part of evidence-based initiatives.

The use of structured reporting of head and neck ultrasound ensures time-efficiency and report quality during residency

PURPOSE

Free text reports (FTR) of head and neck ultrasound studies are currently deployed in most departments. Because of a lack of composition and language, these reports vary greatly in terms of quality and reliability. This may impair the learning process during residency. The purpose of the study was to analyze the longitudinal effects of using structured reports (SR) of head and neck ultrasound studies during residency.

METHODS

Attending residents (n = 24) of a tripartite course on head and neck ultrasound, accredited by the German Society for Ultrasound in Medicine (DEGUM), were randomly allocated to pictures of common diseases. Both SRs and FTRs were compiled. All reports were analyzed concerning completeness, acquired time and legibility. Overall user contentment was evaluated by a questionnaire.

RESULTS

SRs achieved significantly higher ratings regarding completeness (95.6% vs. 26.4%, p < 0.001), description of pathologies (72.2% vs. 58.9%, p < 0.001) and legibility (100% vs. 52.4%, p < 0.001) with a very high inter-rater reliability (Fleiss' kappa 0.9). Reports were finalized significantly faster (99.1 s vs. 115.0 s, p < 0.001) and user contentment was significantly better when using SRs (8.3 vs. 6.3, p < 0.001). In particular, only SRs showed a longitudinally increasing time efficiency (- 20.1 s, p = 0.036) while maintaining consistent completeness ratings.

CONCLUSIONS

The use of SRs of head and neck ultrasound studies results in an increased longitudinal time-efficiency while upholding the report quality at the same time. This may indicate an additive learning effect of structured reporting. Superior outcomes in terms of comprehensiveness, legibility and time-efficiency can be observed immediately after implementation.

What do we know about volumetric medical image interpretation?: a review of the basic science and medical image perception literatures

Interpretation of volumetric medical images represents a rapidly growing proportion of the workload in radiology. However, relatively little is known about the strategies that best guide search behavior when looking for abnormalities in volumetric images. Although there is extensive literature on two-dimensional medical image perception, it is an open question whether the conclusions drawn from these images can be generalized to volumetric images. Importantly, volumetric images have distinct characteristics (e.g., scrolling through depth, smooth-pursuit eye-movements, motion onset cues, etc.) that should be considered in future research. In this manuscript, we will review the literature on medical image perception and discuss relevant findings from basic science that can be used to generate predictions about expertise in volumetric image interpretation. By better understanding search through volumetric images, we may be able to identify common sources of error, characterize the optimal strategies for searching through depth, or develop new training and assessment techniques for radiology residents.

The value of structured radiology reports to categorize intracranial metastases following radiation therapy

PURPOSE

Radiology descriptions of intracranial metastases following radiotherapy are often imprecise. This study sought to improve such reports by creating and disseminating a structured template that encourages discrete categorization of intracranial lesions.

METHODS

Following initiation of the structured template, a retrospective review assessed patients with intracranial metastases that underwent radiotherapy, comparing 'pre-template' with 'post-template' reports. A total of 139 patients were included; 94 patients (67.6%) were imaged pre-template, 45 (32.4%) post-template. Reports were assessed for discrete versus non-specific descriptions of lesions: '(presumed) new metastases', 'treated metastases', and 'indeterminate lesions'. Non-specific language was subdivided based on the type of lesion(s) described: e.g. 'stable enhancing foci' was deemed a non-specific description of 'treated metastases'.

RESULTS

Non-specific descriptions of lesions were used in 25/94 reports (26.6%) pre-template, and eight reports (17.8%) post-template. No significant difference was found in the frequency of inappropriate/ambiguous descriptions of intracranial lesions following template initiation (P = 0.52). However, only 27/45 (60.0%) of the reports in the post-template time period used the structured report; the other reports were written as free prose. Of the reports that did use the structured template, the authors used significantly less ambiguous language structured template (P = 0.02).

CONCLUSION

When utilized, a structured report template resulted in decreased non-specific descriptions and improved discrete characterization of intracranial metastases in patients treated with radiation. However, the frequency of non-specific language usage before and after template initiation was unchanged, probably due to poor compliance with template utilization.

Impact of structured reporting on developing head and neck ultrasound skills

BACKGROUND

Reports of head and neck ultrasound examinations are frequently written by hand as free texts. This is a serious obstacle to the learning process of the modality due to a missing report structure and terminology. Therefore, there is a great inter-observer variability in overall report quality. Aim of the present study was to evaluate the impact of structured reporting on the learning process as indicated by the overall report quality of head and neck ultrasound examinations within medical school education.

METHODS

Following an immersion course on head and neck ultrasound, previously documented images of three common pathologies were handed out to 58 medical students who asked to create both standard free text reports (FTR) and structured reports (SR). A template for structured reporting of head and neck ultrasound examinations was created using a web-based approach. FTRs and SRs were evaluated with regard to overall quality, completeness, required time to completion and readability by two independent raters (Paired Wilcoxon test, 95% CI). Ratings were assessed for inter-rater reliability (Fleiss' kappa). Additionally, a questionnaire was utilized to evaluate user satisfaction.

RESULTS

SRs received significantly better ratings in terms of report completeness (97.7% vs. 53.5%, p < 0.001) regarding all items. In addition, pathologies were described in more detail using SRs (70% vs. 51.1%, p < 0.001). Readability was significantly higher in all SRs when compared to FTRs (100% vs. 54.4%, p < 0.001). Mean time to complete was significantly lower (79.6 vs. 205.4 s, p < 0.001) and user satisfaction was significantly higher when using SRs (8.5 vs. 4.1, p < 0.001). Also, inter-rater reliability was very high (Fleiss' kappa 0.93).

CONCLUSIONS

SRs of head and neck ultrasound examinations provide more detailed information with a better readability in a time-saving manner within medical education. Also, medical students may benefit from SRs in their learning process due to the structured approach and standardized terminology.

Structured reporting of head and neck ultrasound examinations

Background

Reports of head and neck ultrasound examinations are frequently written by hand as free texts. Naturally, quality and structure of free text reports is variable, depending on the examiner’s individual level of experience. Aim of the present study was to compare the quality of free text reports (FTR) and structured reports (SR) of head and neck ultrasound examinations.

Methods

Both standard FTRs and SRs of head and neck ultrasound examinations of 43 patients were acquired by nine independent examiners with comparable levels of experience. A template for structured reporting of head and neck ultrasound examinations was created using a web-based approach. FTRs and SRs were evaluated with regard to overall quality, completeness, required time to completion, and readability by four independent raters with different specializations (Paired Wilcoxon test, 95% CI) and inter-rater reliability was assessed (Fleiss’ kappa). A questionnaire was used to compare FTRs vs. SRs with respect to user satisfaction (Mann-Whitney U test, 95% CI).

Results

By comparison, completeness scores of SRs were significantly higher than FTRs’ completeness scores (94.4% vs. 45.6%, p < 0.001), and pathologies were described in more detail (91.1% vs. 54.5%, p < 0.001). Readability was significantly higher in all SRs when compared to FTRs (100% vs. 47.1%, p < 0.001). The mean time to complete a report, however, was significantly higher in SRs (176.5 vs. 107.3 s, p < 0.001). SRs achieved significantly higher user satisfaction ratings (VAS 8.87 vs. 1.41, p < 0.001) and a very high inter-rater reliability (Fleiss’ kappa 0.92).

Conclusions

As compared to FTRs, SRs of head and neck ultrasound examinations are more comprehensive and easier to understand. On the balance, the additional time needed for completing a SR is negligible. Also, SRs yield high inter-rater reliability and may be used for high-quality scientific data analyses.

Structured reports of pelvic magnetic resonance imaging in primary endometrial cancer: Potential benefits for clinical decision-making

BACKGROUND

Although evidence is increasing that the implementation of structured reports (SRs) may increase the standardization of reports and improve communication between radiologists and end-users, it is unclear whether these alternative formats of Chinese radiological narratives are appealing or even acceptable to radiologists and clinicians.

OBJECTIVE

To compare the effect of SRs and non-structured reports (NSRs) of pelvic magnetic resonance imaging (MRI) in patients with primary endometrial cancer on referring gynecologists' satisfaction, further decision-making and efficiency.

METHODS

Forty-one patients with histologically proven endometrial cancer were included in this study. SRs and NSRs for local MRI staging of endometrial cancer were generated for all subjects. NSRs were generated during clinical routine practice. The same 41 uterine studies were reviewed by the same radiologist using structured reporting system after a period of time. Two radiologists compared SRs on the number of key features related to cancer staging and writing efficiency with NSRs together. Five gynecologists filled in questionnaires regarding satisfaction with content, clinical usefulness, report' quality and time consumption. Statistical analysis included Kendall's W test, paired-sample t test and Wilcoxon signed rank test.

RESULTS

There was no significant difference in the number of key features in NSRs comparison to SRs (p = 0.055). A statistically significant difference was observed in the satisfaction with linguistic quality for NSRs versus SRs by three gynaecologists (reader 1: 4.02 vs. 4.63, p = 0.002; reader 3: 3.86 vs. 4.02, p = 0.035; reader 4: 4.05 vs. 4.27, p = 0.024). The radiologist spent less time finishing SRs compared with NSRs (727.22 ± 38.42 sec vs. 616.44 ± 60.00 sec, p = 0.037).

CONCLUSIONS

The application of SRs significantly increased the value of female pelvic MRI reports by increasing radiologists' work efficiency and gynaecologists' satisfaction.

DXA Errors Are Common and Reduced by Use of a Reporting Template

OBJECTIVE

High quality dual energy X-ray absorptiometry (DXA) acquisition, analysis, and reporting demands technical and interpretive excellence. We hypothesized that DXA errors are common and of such magnitude that incorrect clinical decisions might result. In this 2-phase study, we evaluated DXA technical and interpretation error rates in a clinical population and subsequently assessed if implementing an interpretation template reduced errors.

METHODS

In phase 1, DXA scans of 345 osteoporosis clinic referrals were reviewed by International Society for Clinical Densitometry-certified technologists (n = 3) and physicians (n = 3). Technologists applied International Society for Clinical Densitometry performance standards to assess technical quality. Physicians assessed reporting compliance with published guidance, relevance of technical errors and determined overall and major error prevalence. Major errors were defined as "provision of inaccurate information that could potentially lead to incorrect patient care decisions." In phase 2, a DXA reporting template was implemented at 2 clinical DXA sites after which the 3 physicians reviewed 200 images and reports as above. The error prevalence was compared with the 298 patients in phase 1 from these sites.

RESULTS

In phase 1, technical errors were identified in 90% of patients and affected interpretation in 13%. Interpretation errors were present in 80% of patients; 42% were major. The most common major errors were reporting incorrect information on bone mineral density change (70%) and incorrect diagnosis (22%). In phase 2, at these 2 clinical sites, major errors were present in 37% before and 17% after template implementation. Template usage reduced the odds of major error by 66% (odds ratio 0.34, 95% confidence interval 0.21, 0.53, and p < 0.0001).

CONCLUSION

DXA technical and interpretation errors are extremely common and likely adversely affect patient care. Implementing a DXA reporting template reduces major errors and should become common practice. Additional interventions, such as requiring initial and ongoing training and/or certification for technologists and interpreters, are suggested.

Beyond the Spinal Canal

Cross-sectional spinal imaging is common, and extraspinal findings are often incidentally identified during interpretation. Although some of these findings may cause symptoms that mimic a spinal disorder, the majority are entirely asymptomatic and incidental. It is essential that the radiologist not only identify those abnormalities that may have clinical significance but also recognize those that are clinically irrelevant and thereby prevent patients from being subjected to further unnecessary, expensive and potentially harmful interventions. This article focuses on those abnormalities that are commonly encountered and provides practical guidance for follow-up and management based on current recommendations.

Variation in the length and structure of reports written by reporting radiographers: A retrospective study

INTRODUCTION

The literature suggests that there is variation in various features of the written radiology report for a range of body areas and imaging modalities. The retrospective study presented here aims to determine if similar variation is demonstrated in a group of 5 reporting radiographers in a UK NHS Trust.

METHODS

Full reports for 1530 knee radiographic examinations performed from accident and emergency referrals were extracted for a 12-month period from a Radiology Information System (RIS) into Excel. Copied into Word, the word count function was used for each report and the number of words and characters (without spaces) was returned into Excel. Average word count and word length per report, by radiographer, were calculated for the following sections of the report: report title, main body and signature. SPSS was used to perform inferential statistical analysis.

RESULTS

A wide range in the maximum and minimum average report lengths (60.88 v 17.83 words) was demonstrated. Statistically significant differences (p < 0.05) were seen between all but one pair-wise comparison (Rad 2 v Rad 4; p = 0.98) for the overall report length; for the length of the findings section, four pair-wise comparisons did not reach significance. Average word length demonstrated less variation. 4 out of 5 radiographers always included a report title; 3 out of 5 never included a report signature. There was a strong negative correlation between experience and report length.

CONCLUSION

Variation in report structure and length, as well as word length, was seen, comparable to studies of radiologist reports. Further research is required to investigate the drivers of this variation, and determine if there is any clinical significance.

Use of electronic medical record templates improves quality of care for patients with infantile spasms

BACKGROUND

Infantile spasms (IS) is a neurologic disorder of childhood where time to treatment may affect long-term outcomes. Due to the clinical complexity of IS, care can be delayed.

OBJECTIVE

To determine if the use of electronic medical record templates (EMRTs) improved care quality in patients treated for IS.

METHOD

Records of patients newly diagnosed with IS were retrospectively reviewed both before and after creation of an EMRT for the workup and treatment of IS. Quality of care measures reviewed included delays in treatment plan, medication administration, obtaining neurodiagnostic studies and discharge. The need for repeat neurodiagnostic studies was also assessed. Resident physicians were surveyed regarding template ease of use and functionality.

RESULTS

Of 17 patients with IS, 7 received template-based care and 10 did not. Patients in the non-template group had more delays in treatment (p = 0.010), delay in medication administration (p = 0.10), delay in diagnostic studies (p = 0.01) and delay in discharge (p = 0.39). Neurodiagnostic studies needed to be repeated in 5 out of 10 patients in the non-template group and none of the 7 patients in the template group (p = 0.04). Surveyed resident physicians reported improved coordination in care, avoidance of delays in discharge and improved ability to predict side effects of treatment with template use.

CONCLUSION

In a single centre, the use of protocolised EMRTs decreased treatment delays and the need for repeated invasive procedures in patients with newly diagnosed IS and was reported as easy to use by resident physicians.

IMPLICATIONS

The use of protocolised EMRTs may improve the quality of patient care in IS and other rare diseases.