Could musculo-skeletal radiograph interpretation by radiographers be a source of support to Australian medical interns: A quantitative evaluation

Utilisation of radiographer comments to reduce errors in the radiology department

INTRODUCTION

Radiographer commenting is a written account of suspected abnormalities identified on medical imaging examinations by the radiographer at the time of image acquisition. Radiographer comments were originally implemented to support emergency clinicians; however, they may also have the potential to support radiologists in reducing missed findings. Therefore, the aim of this study was to investigate if a newly implemented radiographer comment system could reduce the number of errors made in radiology reports for general X-rays. Incidental findings from multisite collaborative research led to the hypothesis that in some cases radiographer comments could accurately detect abnormal X-ray appearances that were not otherwise documented in the radiologist report, thereby enabling results to be revised and errors collaboratively reduced [1].

METHODS

This study was conducted at an 800-bed hospital, where 92% of general radiographers self-selected to participate. Radiographer comments were provided to referring physicians through the electronic medical record and could be made for any emergency or inpatient general X-ray examinations. All comments made over a 12-month period were audited against the corresponding radiologist report. Radiologists were blinded to radiographer comments at the time of reporting. Where discrepancies between the radiographer comment and radiologist report arose, additional radiologist review or subsequent imaging reports were used to determine the accurate interpretation. The number of discrepant radiographer comments that were deemed true positive (TP) and provided new and correct diagnostic information compared to the radiologist report were identified. These were converted to a percentage of total radiographer comments that were therefore able to positively influence radiologist report accuracy. The number of discrepant cases where radiographer comments were deemed false positive (FP) was also measured and converted to a percentage of the total comments. Confidence intervals for both TP and FP binomial proportions were calculated using the Wilson Score Interval.

RESULTS

Over 12 months, 282 radiographer comments were made to alert clinically significant radiographic appearances on general X-ray. Of these, 32 radiographer comments were discrepant with the report. Of these 32 comments, 24 were deemed TP meaning they correctly identified a pathological imaging appearance that was not otherwise documented in the radiology report. Therefore, 8.5% of all radiographer comments added value by correctly identifying a pathology that was not otherwise documented, 95% CI (5.8% - 12.4%). This enabled results to be promptly amended and reporting errors collaboratively reduced. Conversely, eight (2.8%) radiographer comments were discrepant with the report but deemed FP and did not add value to the investigation, 95% CI (1.4% - 5.5%). The remaining 250 non-discrepant comments did not contribute to error reduction but provided real-time abnormality detection that benefitted managing teams.

CONCLUSION

These findings are consistent with previous literature proposing radiographer comments may provide a safety net for radiologists due to factors such as direct patient contact, ability to expand on clinical history, and difference in accumulated expertise. This study demonstrates that radiographer comments may be effectively used as a multidisciplinary error-reduction tool to assist radiologists in their important role and improve clinical outcomes.

The impact of intensive training in preliminary image evaluation (PIE) for radiographers in the emergency department of a regional hospital in New Zealand - A pilot study

INTRODUCTION

New Zealand has seen an increase in the X-ray examinations in the emergency departments (ED), and the radiology report is generally unavailable immediately. This requires practitioners managing the patient to take the responsibility of detecting any abnormalities in the images and using such information for the management of the patient. There is, therefore, a need for consideration of the contribution that radiographers could make in the accurate management of the patients in ED in New Zealand. The aim of this study was to assess if an intensive preliminary image evaluation (PIE) training course improved radiographer accuracy, sensitivity, and specificity on extremity X-ray examinations in a regional ED in New Zealand.

METHOD

A pre-post-intervention design was employed for this study. Seven radiographers working at a regional base hospital in New Zealand undertook image evaluation tests to evaluate their ability to detect and describe abnormalities prior to and following a 2-day intensive PIE training course. The training concentrated on acute extremity abnormalities. Tests were then scored to determine sensitivity, specificity, and accuracy.

RESULTS

Following an intensive PIE training course, the post-intervention test mean demonstrated an improved sensitivity by an average of 3.99% (89.01-93.0), specificity improved by an average of 6.13% (79.77-85.90%), and accuracy improved by an average of 3.33% (77.55-80.87%).

CONCLUSION

This study demonstrated that an intensive training course in PIE improved the participants' sensitivity, specificity, and accuracy when evaluating acute extremity X-ray examinations in ED at the study site, however further research is required to see if these results also represent clinical ability.

IMPLICATION FOR PRACTICE

The NZ healthcare system could benefit by the introduction of a radiographers' PIE system. It is therefore recommended that when introducing PIE into an ED in New Zealand, radiographers should undertake additional training to improve image evaluation sensitivity, specificity, and accuracy prior to participation.

Formalising written preliminary image evaluation by Australian radiographers: a review of practice value

The Medical Radiation Practice Board of Australia (MRPBA) minimum competency framework requires all Australian radiographers to identify significant pathology in radiological images and take appropriate action to alert these urgent findings and ensure patient safety. Despite professional bodies endorsing the provision of preliminary image evaluations (PIE) in written format, radiographer image interpretation often remains inconsistent, informal, or undocumented. The purpose of this narrative review was to assess the literature to determine if PIE in the form of written radiographer comments is of value to the Australian healthcare system. A structured search was completed using four health research databases: CINAHL, Medline, Scopus and Web of Science. Studies have suggested that there is a contextual need for commenting due to increased imaging service pressures, radiologist shortages and subsequent reporting delays. Radiographers appear well placed and willing to provide accurate initial input with evidence that this would be valued and appreciated within the multidisciplinary team. Radiographer commenting has also been shown to reduce diagnostic and communicative errors with the potential to improve patient management. Finally, it was shown that participation in image interpretation practices can enhance recruitment, retention and job satisfaction among radiographers. Therefore, the current literature supports implementation of radiographer commenting within the Australian healthcare system.

Australian radiographer roles in the emergency department; evidence of regulatory compliance to improve patient safety - A narrative review

OBJECTIVES

Using a narrative approach, this paper aims to determine the extent of Australian radiographers' regulatory compliance to improve patient safety when performing appendicular X-ray and non-contrast brain computed tomography (CT) in the Emergency Department (ED).

KEY FINDINGS

A narrative review explored relevant literature and key regulatory policy. Ten documents were identified, three main themes were developed related to the radiographer roles in X-ray request justification, dose optimisation and preliminary image evaluation (PIE). Radiographers were equally aware of justification and optimisation pre and post the introduction of a Medical Code of Practice. The collective PIE accuracy of radiographers remained unaffected by changes in mode of PIE delivery and regulatory factors but varied based on the anatomical region.

CONCLUSION

While current Australian regulations mandate radiographer request justification, dose optimisation and PIE, the degree of compliance by Australian radiographers remains uncertain. Current literature provides evidence that radiographers can improve patient care and safety through justification, optimisation, and PIE delivery. Change in workplace practice, supported by key stakeholders including radiologists, is essential to integrate radiographers' functions into routine ED clinical practice. Further research is required to audit radiographers' regulatory compliance to improve patient safety.

IMPLICATIONS FOR PRACTICE

Patient safety in ED can be improved with timely and accurate diagnosis provided by radiographers. Radiographers have a professional obligation to adhere to the capabilities and standards for safe medical radiation practice defined by Australian regulations. Therefore, radiographers must justify the X-ray request, optimise the radiation dose where appropriate and communicate urgent or unexpected findings to the referrer.

Reducing diagnostic errors in the emergency department at the time of patient treatment

OBJECTIVE

The purpose of the present study was to compare and combine the radiographic interpretation accuracy of emergency clinicians and radiographers in clinical practice.

METHODS

A total of 838 radiographic examinations were included for analysis from 1 August to 24 August 2020. The range of examinations reviewed included the appendicular and axial skeleton, chest and abdomen. Both paediatric and adult examinations were reviewed. The emergency clinician's and radiographer's interpretations for each examination were compared to the radiologist's report. This allowed mean sensitivity, specificity and diagnostic accuracy to be calculated.

RESULTS

The radiographer's interpretation demonstrated a mean sensitivity, specificity and accuracy of 80%, 98% and 92%, respectively. The emergency clinician's interpretation demonstrated a mean sensitivity, specificity and accuracy of 82%, 95% and 89%, respectively. When the radiographer's and emergency clinician's interpretations were combined, it yielded a mean sensitivity, specificity and accuracy of 90%, 93% and 92%, respectively.

CONCLUSIONS

This is the first study to directly compare and combine the accuracy of an emergency clinician's radiographic interpretation with a radiographer's interpretation within clinical practice. The present study demonstrated that with the addition of a radiographer's interpretation, an emergency clinician's interpretation can be more accurate than the emergency clinician's interpretation in isolation. This highlights the value of a radiographer's interpretation that can complement an emergency clinician's interpretation when a radiologist's report is unavailable.

Accuracy of radiographer preliminary clinical evaluation of skeletal trauma radiographs, in clinical practice at a district general hospital

INTRODUCTION

Error in interpretation of trauma radiographs by referrers is a problem which has detrimental effects on the patient and causes unnecessary repeat attendances. Radiographers can reduce errors by offering their opinion at the time of imaging. The Society and College of Radiographers have a longstanding recommendation that Red Dot (RD) schemes should be replaced by Preliminary Clinical Evaluation (PCE). The purpose of the study was to evaluate radiographer interpretation of skeletal trauma radiographs in clinical practice, determine if there was any difference in ability to interpret appendicular and axial studies, and evaluate appropriateness of PCE implementation.

METHODS

A convenience sample of 23 self-selecting radiographers provided RD and PCE on 762 examinations. Each case was compared against the verified report and assigned a true negative/positive or false negative/positive value. Accuracy, sensitivity and specificity were calculated and performance measures between RD versus PCE, and appendicular versus axial were compared using Two-sample Z-Tests. Error analysis was performed and inter-observer consistency determined.

RESULTS

Overall RD and PCE accuracy, sensitivity and specificity for the study were 90%, 72% and 97% (RD), and 92%, 80% and 97% (PCE) respectively. Significant difference was demonstrated for sensitivity with PCE more sensitive than RD (p-value 0.03) and appendicular more sensitive than axial (RD p-value <0.02, PCE p-value <0.0001). Most errors were false negatives. Inter-observer consistency was evaluated by review of 128 cases and no difference between reviewers was established.

CONCLUSION

Radiographers without specific training were able to provide RD and PCE to a high standard. Radiographers interpreted positive findings more accurately using PCE than RD, and positive findings on appendicular cases were interpreted more accurately than those on axial cases.

IMPLICATIONS FOR PRACTICE

This study supports local PCE implementation, contributes to the wider evidence base to justify transition towards PCE and identifies the necessity for local axial image interpretation training.

Can Radiology Technologists be Trained to Measure Leg Length Discrepancies as Accurately as Pediatric Radiologists?

RATIONALE AND OBJECTIVES

Leg length discrepancy studies are labor intensive. They are procedurally simple and represent inefficient use of the radiologists' time and expertise. We hypothesized that radiology technologists could be trained to measure leg length discrepancies, and that their performance would be statistically equivalent to that of board-certified, fellowship-trained pediatric radiologists.

MATERIAL AND METHODS

Four radiology technologists were selected to participate in a supervised practice session. They independently measured and calculated leg length discrepancies on 10 randomly selected cases. Their performance was compared to measurements obtained by an experienced pediatric radiologist (reference standard). After 1 week, the technologists repeated their measurements on the same cases, which were resorted to simulate new cases. Intraclass correlation coefficients (ICC) determined interobserver agreement between the technologists and radiologist and intra-observer reliability among the technologists.

RESULTS

Among the four technologists, similarity in measurements between session 1 and the reference standard was very high, with ICC values ranging from 0.93 to 0.98 (p < 0.001). The ICC between session 2 and the reference standard was also high, ranging from 0.93 to 0.98 (p < 0.001). Finally, among the four technologists, ICC values between session 1 and session 2 were ≥ 0.96 (p < 0.001).

CONCLUSION

Radiology technologists can be rapidly trained to calculate leg length discrepancies as accurately as a board-certified pediatric radiologist. Delegation of this time-consuming task to technologists or radiology assistants will permit radiologists to spend time on more demanding studies, such as studies that require subspecialty training.

Communicating traumatic pathology to ensure shared understanding: is there a recipe for the perfect preliminary image evaluation?

Medical imaging and emergency departments work collaboratively to interpret trauma radiographs. In addition to accurate radiographic interpretation, clear communication is crucial to ensure appropriate and timely management of musculoskeletal injuries. This two-step 'how to guide' provides the reviewer with a recipe for effectively evaluating trauma radiographs for traumatic pathology and succinctly documenting the findings. Step 1 is a systematic search of the radiograph: soft tissues, bones, alignment of joints and satisfaction of search (SBASS). Utilising SBASS increases reviewer confidence in identifying traumatic pathology of the appendicular and axial skeleton. Step 2 is a streamlined communication model for the documentation of pathological findings. The WWW acronym (What is it? Where is it? What is it doing?) can be adapted to describe simple or complex traumatic pathology.

Experiences of radiographers working alone in remote locations: A Far North Queensland non-participant observational study

INTRODUCTION

Radiographers employed in remote locations such as Far North Queensland (FNQ) can face unique sets of challenges as they often perform radiographic and sonographic diagnostic imaging without onsite radiologists' services. Additionally, the majority of patients presenting to these sites are Indigenous for whom English may be their third language. This non-participant observational study observed two FNQ radiographers' interactions with patients and interprofessional staff, and the radiographers' ability to fit into the Indigenous community during routine radiographic and sonographic examinations which to date have received little attention.

METHODS

Non-participant observations and semi-structured interviews with radiographers were held at two FNQ hospitals. Consecutive radiographer-patient interactions were observed and recorded on checklists. Interviews were audio recorded and transcribed for thematic analysis.

RESULTS

Across both remote sites, 24 patients were observed as they underwent diagnostic imaging examinations, with the majority being Aboriginal or Torres Strait Islanders (n = 17/24 (70.8%). In total, eleven general radiography and sixteen ultrasound examinations were observed. Semi-structured interviews highlighted complex issues such as the need for radiographer communication in local dialect, ongoing interprofessional collaborations, overcoming the lack of radiologists' onsite support by providing radiographic reports directly to referring doctors and midwives, and isolation with regard to professional development opportunities.

CONCLUSIONS

Radiographers working in remote hospitals need to be culturally competent, navigate local indigenous languages and possess excellent interprofessional skills as well as thorough knowledge of imaging pathology to convey findings to referring doctors and allied health professionals. These findings have implications for the entry to practice curriculum.

IMPLICATIONS FOR PRACTICE

This study provides evidence that culturally competent radiographers are capable of undertaking reporting roles to facilitate patient management in the absence of timely radiologists' reports at remote sites.

Radiographic image interpretation by Australian radiographers: a systematic review

INTRODUCTION

Radiographer image evaluation methods such as the preliminary image evaluation (PIE), a formal comment describing radiographers' findings in radiological images, are embedded in the contemporary radiographer role within Australia. However, perceptions surrounding both the capacity for Australian radiographers to adopt PIE and the barriers to its implementation are highly variable and seldom evidence-based. This paper systematically reviews the literature to examine radiographic image interpretation by Australian radiographers and the barriers to implementation.

METHODS

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses were used to systematically review articles via Scopus, Ovid MEDLINE, PubMed, ScienceDirect and Informit. Articles were deemed eligible for inclusion if they were English language, peer-reviewed and explored radiographic image interpretation by radiographers in the context of the Australian healthcare system. Letters to the editor, opinion pieces, reviews and reports were excluded.

RESULTS

A total of 926 studies were screened for relevance, 19 articles met the inclusion criteria. The 19 articles consisted of 11 cohort studies, seven cross-sectional surveys and one randomised control trial. Studies exploring radiographers' image interpretation performance utilised a variety of methodological designs with accuracy, sensitivity and specificity values ranging from 57 to 98%, 45 to 98% and 68 to 98%, respectively. Primary barriers to radiographic image evaluation by radiographers included lack of accessible educational resources and support from both radiologists and radiographers.

CONCLUSION

Australian radiographers can undertake PIE; however, educational and clinical support barriers limit implementation. Access to targeted education and a clear definition of radiographers' image evaluation role may drive a wider acceptance of radiographer image evaluation in Australia.

Reducing risk in the emergency department: a 12-month prospective longitudinal study of radiographer preliminary image evaluations

INTRODUCTION

Innovations are necessary to accommodate the increasing demands on emergency departments whilst maintaining a high level of patient care and safety. Radiographer Preliminary Image Evaluation (PIE) is one such innovation. The purpose of this study was to determine the accuracy of radiographer PIE in clinical practice within an emergency department over 12 months.

METHODS

A total of 6290 radiographic examinations were reviewed from 15 January 2016 to 15 January 2017. The range of adult and paediatric examinations incorporated in the review included the appendicular and axial skeleton including the chest and abdomen. Each examination was compared to the radiologist's report this allowed calculated mean sensitivity and specificity values to indicate if the radiographer's PIE was of a true negative/positive or false negative/positive value. Cases of no PIE participation or series' marked as unsure for pathology by the radiographer were also recorded. This allowed mean sensitivity, specificity and diagnostic accuracy to be calculated.

RESULTS

The study reported a mean ± 95% confidence level (standard deviation) for sensitivity, specificity, accuracy, no participation and unsure of 71.1% ± 2.4% (6.1), 98.4% ± 0.04% (0.9), 92.0% ± 0.68% (1.9), 5.1% (1.6) and 3.6% (0.14) respectively.

CONCLUSIONS

This study has demonstrated that the participating radiographers provided a consistent PIE service while maintaining a reasonably high diagnostic accuracy. This form of image interpretation can complement an emergency referrer's diagnosis when a radiologist's report is unavailable at the time of patient treatment. PIE promotes a reliable enhancement of the radiographer's role with the multi-disciplinary team.

Evaluating the effectiveness of intensive versus non-intensive image interpretation education for radiographers: a randomised controlled trial

INTRODUCTION

The purpose of this randomised controlled trial was to compare the effectiveness of intensive and non-intensive formats of delivery of image interpretation education for radiographers.

METHODS

A multi-centre, stratified (by years of experience) two group parallel arm, single blind, randomised controlled trial was conducted. Participants (n = 48) were allocated to one of two groups to receive image interpretation education: (1) intensive format (13.5 h over two consecutive days) (2) non-intensive (sequential 90-min tutorials delivered 1 week apart). Participants undertook x-ray interpretation tests before education, at 1-week post-education completion and at 12-week post-education completion.

RESULTS

Image interpretation performance was not significantly different between groups at baseline. A generalised linear model indicated that participants who received intensive education format improved image interpretation performance by a greater margin than the group that received non-intensive education at 1-week (P = 0.002) and 12-week (P < 0.001) follow-up assessments.

CONCLUSIONS

Although both formats of education delivery may be beneficial, the findings of this study have indicated that the intensive format of delivery was more effective at improving radiographers' ability to interpret trauma radiographs in the weeks after completion of the image interpretation program.

Improvement of radiographer commenting accuracy of the appendicular skeleton following a short course in plain radiography image interpretation: A pilot study

INTRODUCTION

Radiographers are at times required to provide preliminary information on plain radiography when significant findings are identified. The aim of the study was to evaluate the effectiveness of two short training modules to improve the accuracy of image interpretation of the appendicular skeleton amongst a group of radiographers.

METHODS

Eight radiographers volunteered to participate in the study. All undertook a pre-test and, following delivery of course materials, an immediate post-test for two consecutive modules. A retention test was undertaken 6 months later. Sensitivity (Sn), specificity (Sp) and accuracy (Acc) scores were evaluated against the "Gold Standard" radiologists' reports. Paired-samples t-tests were carried out to compare image interpretation scores between the start of module one to the end of module two, and between the end of module 2 and 6 months later. Summary receiver operating characteristics (SROC) scores on each of the participants' module two post-test study results were undertaken.

RESULTS

Significant improvements in scores were achieved between the mean (SD) scores of module 1 pre-test (77.5 (±3.9)) and the module 2 post-test (83.6 (±3.2) (P =0.022)). Sn, Sp and Acc scores increased from the start of module 1 pre-test to the end of module 2 post-test (Sn: 82.28-86.25%; Sp: 75.29-84.66%; Acc: 81.68-85.97%). The retention test revealed a non-significant reduction in mean scores (80.0 (±5.1)) when compared to post-test module 2 (83.6 (±3.2) (P =0.184)). SROC revealed an area under the curve of 0.90.

CONCLUSION

Participants achieved significant improvements in commenting accuracy on plain radiography of the appendicular skeleton after completion of the two modules. However, continuous application and ongoing professional development is essential in order to maintain and develop the skills acquired.

Improving the delivery of health care to patients: radiographers and frontline image interpretation

Australia led the world in raising the level of entry‐level education to practice as a radiographer. It now lags behind in formalising radiographer input into the process of image interpretation. The time has come to rectify this situation.