Evaluating the effectiveness of intensive versus non-intensive image interpretation education for radiographers: a randomised controlled trial

Preliminary clinical evaluation: Where are we? An international scoping review

BACKGROUND

The College of Radiographers' vision was that diagnostic radiographers in the UK would be writing preliminary clinical evaluations (PCE) on images. Their 2013 policy supporting the use of PCE has not been updated in a decade and it might be suggested PCE practices in the UK have not really moved on, though elsewhere it appears to have gained traction. The aim of this scoping review was to establish the current global status of the use of PCE.

METHOD

The Arksey and O'Malley scoping review framework and PRISMA-ScR guidelines were used to develop a protocol to identify studies between January 2013 to January 2024 using six databases. Collated literature was analysed using content analysis to identify themes.

RESULTS

52 relevant studies were identified for inclusion. Studies focused predominantly on evaluating accuracy, education, perceptions, and new initiatives. Themes identified a developing role in the use of PCE internationally, perhaps more than in the UK, and in a range of modalities and clinical settings though projectional radiography remains the mainstay. Barriers and drivers to the use of PCE were identified in addition to some quality mechanisms used to support PCE implementation, though impact of implementation was not well explored.

CONCLUSION

Considering PCE has been an aspiration for more than a decade, it remains relatively infrequently researched. There is growing scope internationally, particularly in Australia, yet there is no real evaluation of the impact and role that PCE may have.

IMPLICATIONS FOR PRACTICE

Until further research into the potential impact of PCE and barriers to its implementation, it is likely practices may not evolve with the risk AI technologies may supersede necessity for the practice.

Preliminary image evaluation performance of radiographers in one New Zealand District: a 6-month prospective study

INTRODUCTION

Preliminary image evaluation (PIE) is a system where radiographers alert emergency department referrers to the presence or absence of abnormalities on acute extremity X-ray examinations. PIE and similar systems have been utilised in the United Kingdom (UK) and Australia due to a shortage of radiologists to provide a timely report. As New Zealand (NZ) faces a similar shortage, PIE should be considered to address the negative impact this has on patients. The aim of this study was to determine the effect of regular feedback and education on radiographers' performance when detecting and describing acute abnormalities on extremity X-ray examinations in ED.

METHODS

A prospective longitudinal study design was utilised for this study. The sensitivity, specificity, accuracy, and accuracy of PIEs performed by seven radiographers at a public provincial district in NZ were assessed over a 6-month period, with the participants provided monthly results along with regular e-mailed feedback on common errors.

RESULTS

The mean for sensitivity, specificity, and accuracy calculated with a 95% confidence interval over the 6-month period were 92.8% (89.9, 95.8), 94.9 (93.1, 96.8), and 94.2 (91.9, 96.5), respectively. When the month-to-month results were analysed, the results demonstrated an improvement in participants' sensitivity, specificity, and accuracy over the 6-month period.

CONCLUSION

The results of this study demonstrated that radiographers who participated in the study can perform PIE to a high standard that is comparable with the findings from international studies and demonstrated an improvement over 6 months. Therefore, PIE may be useful in NZ to aid ED clinicians in their clinical decisions when a radiology report is unavailable.

Workload as a predictor of radiographer preliminary image evaluation accuracy

INTRODUCTION

Despite a demonstrated high accuracy and reported successful implementations, radiographer preliminary image evaluation (PIE) has been slow and infrequent in its rollout across Australia. A key barrier reported to hamper radiographer PIE service implementation is lack of adequate time to review radiographs and provide an accurate interpretation. This study sought to conduct a correlational analysis between radiographer imaging workload and PIE service accuracy.

METHODS

A total of 45,373 exams and 1152 PIE comments evenly distributed each month from January 1, 2022, to December 31, 2022, were reviewed. PIE comments were assessed for consistency with the radiologist's report. The imaging workload (average exams completed per hour) was separated into three, eight-hour 'shifts' based on time of imaging. Correlational analysis was performed using linear regression models and assessed for normality using the Shapiro-Wilks test.

RESULTS

The study reported no significant linear association between increasing average workload and reduced service accuracy (P = 0.136). It was however noted that when the average workload increased beyond 7 exams/hour, average service accuracy for PIE was always below 85%.

CONCLUSION

This study has demonstrated that, although perceived, there is no statistically significant correlation between x-ray imaging workload and radiographer PIE service accuracy. Consideration of this correlation to be a significant barrier to participation in such a service was not reported at this site.

Analysing false-positive errors when Australian radiographers use preliminary image evaluation

INTRODUCTION

Diagnostic errors in the emergency departments can have major implications on patient outcomes. Preliminary Image Evaluation (PIE) is a brief comment written by a radiographer describing an acute or traumatic pathology on a radiograph and can be used to complement referrer's image interpretation in the absence of the radiologist report. Currently, no studies exist that focus their analysis on false-positive (FP) errors in PIE. The purpose of this study was to investigate the regions of the body that cause the most FP errors and recognise other areas in image interpretation that may need additional attention.

METHODS

A longitudinal retrospective clinical audit was conducted to determine the accuracy of radiographer PIE's over 5 years from January 2016 to December 2020. PIE's were compared to the radiologist report to assess for diagnostic accuracy. FP and unsure errors were further categorised by anatomical region and age.

RESULTS

Over this period, a sample size of 11,090 PIE audits were included in the study demonstrating an overall PIE accuracy of 87.7%. Foot, ankle and chest regions caused the most FP errors, while ankle, shoulder and elbow caused the most unsure cases. 76% of the unsure cases were negative for any pathology when compared to the radiologist report. The paediatric population accounted for 21.3% of FP cases and 33.6% of unsure cases.

CONCLUSION

Findings in this study should be used to tailor education specific to radiographer image interpretation. Improving radiography image interpretation skills can assist in improving referrer diagnostic accuracy, thus improving patient outcomes.

The impact of intensive training in preliminary image evaluation (PIE) for radiographers in the emergency department of a regional hospital in New Zealand - A pilot study

INTRODUCTION

New Zealand has seen an increase in the X-ray examinations in the emergency departments (ED), and the radiology report is generally unavailable immediately. This requires practitioners managing the patient to take the responsibility of detecting any abnormalities in the images and using such information for the management of the patient. There is, therefore, a need for consideration of the contribution that radiographers could make in the accurate management of the patients in ED in New Zealand. The aim of this study was to assess if an intensive preliminary image evaluation (PIE) training course improved radiographer accuracy, sensitivity, and specificity on extremity X-ray examinations in a regional ED in New Zealand.

METHOD

A pre-post-intervention design was employed for this study. Seven radiographers working at a regional base hospital in New Zealand undertook image evaluation tests to evaluate their ability to detect and describe abnormalities prior to and following a 2-day intensive PIE training course. The training concentrated on acute extremity abnormalities. Tests were then scored to determine sensitivity, specificity, and accuracy.

RESULTS

Following an intensive PIE training course, the post-intervention test mean demonstrated an improved sensitivity by an average of 3.99% (89.01-93.0), specificity improved by an average of 6.13% (79.77-85.90%), and accuracy improved by an average of 3.33% (77.55-80.87%).

CONCLUSION

This study demonstrated that an intensive training course in PIE improved the participants' sensitivity, specificity, and accuracy when evaluating acute extremity X-ray examinations in ED at the study site, however further research is required to see if these results also represent clinical ability.

IMPLICATION FOR PRACTICE

The NZ healthcare system could benefit by the introduction of a radiographers' PIE system. It is therefore recommended that when introducing PIE into an ED in New Zealand, radiographers should undertake additional training to improve image evaluation sensitivity, specificity, and accuracy prior to participation.

Formalising written preliminary image evaluation by Australian radiographers: a review of practice value

The Medical Radiation Practice Board of Australia (MRPBA) minimum competency framework requires all Australian radiographers to identify significant pathology in radiological images and take appropriate action to alert these urgent findings and ensure patient safety. Despite professional bodies endorsing the provision of preliminary image evaluations (PIE) in written format, radiographer image interpretation often remains inconsistent, informal, or undocumented. The purpose of this narrative review was to assess the literature to determine if PIE in the form of written radiographer comments is of value to the Australian healthcare system. A structured search was completed using four health research databases: CINAHL, Medline, Scopus and Web of Science. Studies have suggested that there is a contextual need for commenting due to increased imaging service pressures, radiologist shortages and subsequent reporting delays. Radiographers appear well placed and willing to provide accurate initial input with evidence that this would be valued and appreciated within the multidisciplinary team. Radiographer commenting has also been shown to reduce diagnostic and communicative errors with the potential to improve patient management. Finally, it was shown that participation in image interpretation practices can enhance recruitment, retention and job satisfaction among radiographers. Therefore, the current literature supports implementation of radiographer commenting within the Australian healthcare system.

Radiographers' experiences of image interpretation training in a low-resource setting

INTRODUCTION

Radiographers extend their roles through formal and on-the-job training to keep up with clinical practice changes. One area of role extension that is now incorporated into undergraduate programmes is image interpretation, although the training provided may vary between institutions. This study explored the experiences of graduates from one higher education institution in a low-resource context with regard to their image interpretation training.

METHODS

A qualitative phenomenological research design was employed to investigate the experiences of ten radiography graduates who were purposively selected from one higher education institution. Individual semi-structured interviews were conducted with each participant after obtaining their informed consent. The interview recordings were transcribed and analysed using Atlas.ti Windows (Version 9.0) software, following Colaizzi's seven-steps of data analysis.

RESULTS

From the ten interviews conducted, teaching approach, clinical education, and assessment strategy emerged as areas of experience within the teaching and learning theme, while practitioner role modelling, skill utilisation, and industry impact were sub-themes under the paradoxical reality theme. The participants' experiences indicated a theory-practice gap in image interpretation among radiographers.

CONCLUSION

The participants' experiences reflected a misalignment in the educational process due to inadequacies in the teaching approach, clinical education, and assessment strategies. Participants encountered significant differences between their expectations and clinical realities during and after training. Image interpretation by radiographers was recognised as a relevant area for role extension in this low-resource setting.

IMPLICATIONS FOR PRACTICE

While these findings are specific to the experiences of the participants, conducting similar research in comparable contexts and implementing competency-based image interpretation assessments could help identify gaps and guide interventions to address shortcomings.

An analysis of radiographer preliminary image evaluation - A focus on common false negatives

INTRODUCTION

Preliminary image evaluation (PIE) is a mechanism whereby radiographers provide a preliminary evaluation of whether pathology is present in their radiographs, typically acquired within the emergency department (ED). PIE provides referrers with a timely communication of pathology prior to the availability of a radiology report. The purpose of this study was to determine the most common radiographer PIE false-negative interpretations.

METHODS

Each month over a two-year period, 100 PIEs of adult and paediatric patients were randomly reviewed in a metropolitan hospital ED. The radiographer's PIE was compared with the radiologist's report and categorised into basic quality indicators; true positive, true negative, false positive and false negative. The anatomical regions which most commonly indicated a false-negative interpretation were further analysed.

RESULTS

2402 cases were reviewed which resulted in an overall PIE accuracy of 88.7%. Wrists, hands, phalanges (upper), ankles, feet and phalanges (lower) reporting the highest false-negative or false-negative/true-positive interpretations (60/116). Of the 60 false-negative PIEs, 68 pathologies were identified. 41.1% (28/68) of the pathology not identified were in the phalanges. Within these regions, examinations with multiple injuries commonly reported false negatives (17/60).

CONCLUSIONS

This study demonstrated the most common false-negative radiographer PIEs were within the upper and lower distal extremities. Specifically, the phalanges and examinations demonstrating multiple injuries reported high levels of misinterpretation. The misinterpretation in multi-injury examinations could be attributed to 'Subsequent Search Miss (SSM)' error. These results provide valuable insights into areas of emphasis when providing image interpretation education.

The effect of a digital training tool to aid chest image interpretation: Hybridising eye tracking technology and a decision support tool

INTRODUCTION

Eye tracking technology, checklists and search strategies have been demonstrated as useful aids in image interpretation. A training tool was developed, by the research team, which included these features. This study aimed to evaluate the effect of the training tool on participant image interpretation performance.

METHODS

The study was carried out with reporting radiographers who had either commenced training in chest image interpretation (n = 12) or were trained in musculoskeletal image interpretation (n = 23) (total n = 35). Participants were allocated to a control or intervention group. Participants completed an initial assessment at recruitment and re-attended nine months later for a follow-up assessment. The intervention group were given unlimited access to a digital training tool. During assessments participants interpreted 20 chest images whilst using eye tracking technology (total of 1400 images were interpreted). A confidence level was obtained from participants on their diagnosis and a questionnaire, to obtain demographic data, was completed following the assessment.

RESULTS

Improvements were seen in the confidence of intervention group participants (p < 0.05). False Positive (FP) scores decreased for both the control and intervention group (p < 0.05), this decrease was from 4.20 to 3.20 for the control group and from 5.87 to 3.27 for the intervention group. True Negative (TN) scores increased, from 5.13 to 6.73 for the intervention group (p < 0.05). Mean decision time decreased for both the control and intervention group.

CONCLUSION

The tool led to positive effects on participant performance and could be a useful aid in chest image interpretation learning.

IMPLICATIONS FOR PRACTICE

Improvements in performance were observed with a digital tool. The tool could improve image interpretation methods and training.

Radiographic image interpretation by Australian radiographers: a systematic review

INTRODUCTION

Radiographer image evaluation methods such as the preliminary image evaluation (PIE), a formal comment describing radiographers' findings in radiological images, are embedded in the contemporary radiographer role within Australia. However, perceptions surrounding both the capacity for Australian radiographers to adopt PIE and the barriers to its implementation are highly variable and seldom evidence-based. This paper systematically reviews the literature to examine radiographic image interpretation by Australian radiographers and the barriers to implementation.

METHODS

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses were used to systematically review articles via Scopus, Ovid MEDLINE, PubMed, ScienceDirect and Informit. Articles were deemed eligible for inclusion if they were English language, peer-reviewed and explored radiographic image interpretation by radiographers in the context of the Australian healthcare system. Letters to the editor, opinion pieces, reviews and reports were excluded.

RESULTS

A total of 926 studies were screened for relevance, 19 articles met the inclusion criteria. The 19 articles consisted of 11 cohort studies, seven cross-sectional surveys and one randomised control trial. Studies exploring radiographers' image interpretation performance utilised a variety of methodological designs with accuracy, sensitivity and specificity values ranging from 57 to 98%, 45 to 98% and 68 to 98%, respectively. Primary barriers to radiographic image evaluation by radiographers included lack of accessible educational resources and support from both radiologists and radiographers.

CONCLUSION

Australian radiographers can undertake PIE; however, educational and clinical support barriers limit implementation. Access to targeted education and a clear definition of radiographers' image evaluation role may drive a wider acceptance of radiographer image evaluation in Australia.