Structured reporting of brain MRI following mechanical thrombectomy in acute ischemic stroke patients

Investigating the impact of structured reporting on the linguistic standardization of radiology reports through natural language processing over a 10-year period

OBJECTIVES

To investigate how a transition from free text to structured reporting affects reporting language with regard to standardization and distinguishability.

METHODS

A total of 747,393 radiology reports dictated between January 2011 and June 2020 were retrospectively analyzed. The body and cardiothoracic imaging divisions introduced a reporting concept using standardized language and structured reporting templates in January 2016. Reports were segmented by a natural language processing algorithm and converted into a 20-dimension document vector. For analysis, dimensionality was reduced to a 2D visualization with t-distributed stochastic neighbor embedding and matched with metadata. Linguistic standardization was assessed by comparing distinct report types' vector spreads (e.g., run-off MR angiography) between reporting standards. Changes in report type distinguishability (e.g., CT abdomen/pelvis vs. MR abdomen) were measured by comparing the distance between their centroids.

RESULTS

Structured reports showed lower document vector spread (thus higher linguistic similarity) compared with free-text reports overall (21.9 [free-text] vs. 15.9 [structured]; - 27.4%; p < 0.001) and for most report types, e.g., run-off MR angiography (15.2 vs. 1.8; - 88.2%; p < 0.001) or double-rule-out CT (26.8 vs. 10.0; - 62.7%; p < 0.001). No changes were observed for reports continued to be written in free text, e.g., CT head reports (33.2 vs. 33.1; - 0.3%; p = 1). Distances between the report types' centroids increased with structured reporting (thus better linguistic distinguishability) overall (27.3 vs. 54.4; + 99.3 ± 98.4%) and for specific report types, e.g., CT abdomen/pelvis vs. MR abdomen (13.7 vs. 37.2; + 171.5%).

CONCLUSION

Structured reporting and the use of factual language yield more homogenous and standardized radiology reports on a linguistic level, tailored to specific reporting scenarios and imaging studies.

CLINICAL RELEVANCE

Information transmission to referring physicians, as well as automated report assessment and content extraction in big data analyses, may benefit from standardized reporting, due to consistent report organization and terminology used for pathologies and normal findings.

KEY POINTS

• Natural language processing and t-distributed stochastic neighbor embedding can transform radiology reports into numeric vectors, allowing the quantification of their linguistic standardization. • Structured reporting substantially increases reports' linguistic standardization (mean: - 27.4% in vector spread) and distinguishability (mean: + 99.3 ± 98.4% increase in vector distance) compared with free-text reports. • Higher standardization and homogeneity outline potential benefits of structured reporting for information transmission and big data analyses.

MRI for collateral assessment pre-thrombectomy and association with outcome: a systematic review and meta-analysis

PURPOSE

Various neuroimaging methods exist to assess the collateral circulation in stroke patients but much of the evidence is based on computed tomography. Our aim was to review the evidence for using magnetic resonance imaging for collateral status evaluation pre-thrombectomy and assess the impact of these methods on functional independence.

METHODS

We systematically reviewed EMBASE and MEDLINE for studies that evaluated baseline collaterals using MRI pre-thrombectomy and conducted a meta-analysis to express the relationship between good collaterals (defined variably as the presence [good] vs absence [poor] or quality [ordinal scores binarized as good-moderate vs poor] of collaterals) and functional independence (modified Rankin score mRS≤2) at 90 days. Outcome data were presented as relative risk (RR, 95% confidence interval, 95%CI). We assessed for study heterogeneity, publication bias, and conducted subgroup analyses of different MRI methods and affected arterial territories.

RESULTS

From 497 studies identified, we included 24 (1957 patients) for the qualitative synthesis, and 6 (479 patients) for the metanalysis. Good pre-thrombectomy collaterals were significantly associated with favorable outcome at 90 days (RR=1.91, 95%CI=1.36-2.68], p= 0.0002) with no difference between MRI methods and affected arterial territory subgroups. There was no evidence of statistical heterogeneity (I²=25%) among studies but there was evidence of publication bias.

CONCLUSION

In stroke patients treated with thrombectomy, good pre-treatment collaterals assessed using MRI are associated with double the rate of functional independence. However, we found evidence that relevant MR methods are heterogenous and under-reported. Greater standardization and clinical validation of MRI for collateral evaluation pre-thrombectomy are required.

Quantifying the Effects of Structured Reporting on Report Turnaround Times and Proofreading Workload in Neuroradiology

RATIONALE AND OBJECTIVES

To assess the effects of a change from free text reporting to structured reporting on resident reports, the proofreading workload and report turnaround times in the neuroradiology daily routine.

MATERIALS AND METHODS

Our neuroradiology section introduced structured reporting templates in July 2019. Reports dictated by residents during dayshifts from January 2019 to March 2020 were retrospectively assessed using quantitative parameters from report comparison. Through automatic analysis of text-string differences between report states (i.e. draft, preliminary and final report), Jaccard similarities and edit distances of reports following read-out sessions as well as after report sign-off were calculated. Furthermore, turnaround times until preliminary and final report availability to clinicians were investigated. Parameters were visualized as trending line graphs and statistically compared between reporting standards.

RESULTS

Three thousand five hundred thirty-eight reports were included into analysis. Mean Jaccard similarity of resident drafts and staff-reviewed final reports increased from 0.53 ± 0.37 to 0.79 ± 0.22 after the introduction of structured reporting (p < .001). Both mean overall edits on draft reports by residents following read-out sessions (0.30 ± 0.45 vs. 0.09 ± 0.29; p < .001) and by staff radiologists during report sign-off (0.17 ± 0.28 vs. 0.12 ± 0.23, p < .001) decreased. With structured reporting, mean turnaround time until preliminary report availability to clinicians decreased by 20.7 minutes (246.9 ± 207.0 vs. 226.2 ± 224.9; p < .001). Similarly, final reports were available 35.0 minutes faster on average (558.05 ± 15.1 vs. 523.0 ± 497.3; p = .002).

CONCLUSION

Structured reporting is beneficial in the neuroradiology daily routine, as resident drafts require fewer edits in the report review process. This reduction in proofreading workload is likely responsible for lower report turnaround times.