On the Assessment of Paramedic Competence: A Narrative Review with Practice Implications

Perceptions of paramedic educators on assessments used in the first year of a paramedic programme: a qualitative exploration

BACKGROUND

In Ireland, there are currently three educational institutions (recognised institutions- RIs) providing paramedic programmes, accredited by the regulator, the Pre-Hospital Emergency Care Council (PHECC). Each RI assesses their students in-house, and in order to acquire a licence to practice, students must also pass summative assessments provided by PHECC. These assessments comprise multiple choice questions, short answer questions and skills assessments. The objective of this study was to explore the perceptions and experiences of paramedic educators of assessments used within their institution and by the regulator to provide insights that could inform the future design of paramedic assessments.

METHODS

A qualitative study with an interpretivist approach and purposive sampling strategy was performed. Semi-structured interviews were conducted with educators from one RI, across their three sites. Data were analysed using an inductive approach to thematic analysis.

RESULTS

Four major themes were identified in the data: improving assessments by enhancing authenticity, modifying the current process of assessment, aligning the PHECC and RI examinations and opportunities to use assessment as learning.

CONCLUSIONS

This study identifies perceived deficits and opportunities in the assessments currently used for paramedic students and ways in which these assessments could be improved. While participants were relatively content with their own RI assessments, they identified ways to improve both the RI and PHECC assessments. Modifying some of the current methods could be a useful first step. In particular, assessments used by PHECC could be improved by reflecting 'real-world' practice. The inclusion of additional assessment methods by PHECC, a continuous assessment process or devolvement of the entire assessment suite, to the RI/University has the potential to enhance assessments, particularly summative assessments, for paramedic students.

Advanced-level paramedics' support needs for developing and utilising competence

INTRODUCTION

Paramedic competence plays a vital role in emergency medical services (EMS), as the pre-hospital setting demands a wide variety of competencies from paramedics. The aim of the study was to examinethesupportthatadvanced-level paramedics need from their supervisors to develop and utilise their competence.

METHODS

Qualitative essay material was collected from a group of experienced advanced-level paramedics (n = 41). The material was analysed with inductive content analysis.

RESULTS

Twenty-eight sub-categories emerged, forming 6 categories further leading to the grouping of two main categories: 1) the enablement of human resource (HR) management and leadership; and 2) guidelines on how to operate EMS adequately.

CONCLUSIONS

Supervisors can and should support advanced-level paramedics in their competence utilisation and development. This can be achieved by enabling professional growth by recognising competencies and generating supportive leadership in EMS. Paramedics would also benefit from clear operative guidelines. Overall, supporting paramedics' competence utilisation and development is strongly connected with leadership standards in daily practices.

Experiences of out-of-hours task-shifting from GPs: a systematic review of qualitative studies

Background

The current GP workforce is insufficient to manage rising demand in patient care within out-of-hours (OOH) primary care services. To meet this challenge, non-medical practitioners (NMPs) are employed to fulfil tasks traditionally carried out by GPs. It is important to learn from experiences of task-shifting in this setting to inform optimal delivery of care.

Aim

To synthesise qualitative evidence of experiences of task-shifting in the OOH primary care setting.

Design & setting

Systematic review of qualitative studies and thematic synthesis.

Method

Electronic searches were conducted across CINAHL (Cumulative Index of Nursing and Allied Health Literature), PsychINFO, Cochrane, MEDLINE, Embase, and OpenGrey for qualitative studies of urgent or OOH primary care services, utilising task-shifting or role delegation. Included articles were quality appraised and key findings collated through thematic synthesis.

Results

A total of 2497 studies were screened, of which six met the inclusion criteria. These included interviews with 15 advanced nurse practitioners (ANPs), three physician assistants (PAs), two paramedics, and a focus group of 22 GPs, and focus groups with 33 nurses. Key findings highlight the importance of clearly defining and communicating the scope of practice of NMPs, and of building their confidence by appropriate training, support, and mentoring.

Conclusion

While NMPs may have the potential to make a substantial contribution to OOH primary care services, there has been very little research on experiences of task-shifting. Evidence to date highlights the need for further training specific to OOH services. Mentorship and support to manage the sometimes challenging cases presenting to OOH could enable more effective OOH services and better patient care.

Paramedic student encounters with patients during clinical placements: A multi-institutional cohort study

OBJECTIVE

Paramedic students in the US are required to complete clinical placements to gain supervised experience with real patient encounters. Given wide variation in clinical placement practices, an evidence-based approach is needed to guide programs in setting realistic and attainable goals for students. This study's goal was to describe patient encounters and hours logged by paramedic students during clinical placements.

METHODS

A retrospective review of prospectively collected quality assurance data entered by US paramedic students between 2010 and 2014 was conducted. De-identified electronic records entered in the Field Internship Student Data Acquisition Project (FISDAP) Skill Tracker database were included from consenting paramedic students whose records were audited and approved by instructors. Descriptive statistics were calculated.

RESULTS

A total of 10,645 students encountered 2,239,027 patients; most encounters occurred in hospital settings (n = 1,311,967, 59%). The median total number of patient encounters per paramedic student was 206 (142-269) and the median total clinical placement hours per student was 626 (504-752). The median number of team leads per student was 56 (30-84). Students encountered a median of 22 (12-31) pediatric patients, ages 0-12 years, and 181 (126-238) adolescent or adult patients. For pediatric patient encounters, the most common clinical impressions were respiratory distress, other medical complaints, and extremity trauma. Among adult patient encounters, the most common clinical impressions included other medical, trauma, and cardiac conditions.

CONCLUSIONS

US paramedic students experienced a variable range of patient encounter types and volumes. The findings of this study offer an evidence base from which programs can set realistic and attainable clinical placement requirements.

Development and Validation of Content Domains for Paramedic Prehospital Performance Assessment: A Focus Group and Delphi Method Approach

BACKGROUND

The chaotic and complex nature of delivering patient care in the prehospital setting complicates the provision of real-time formative feedback to paramedic students. Although the use of simulations is widespread in emergency medical services (EMS) education, a high degree of variability precludes consistent performance assessment in EMS. Objectives: The objective of this study was to define and validate key domains required to evaluate paramedic prehospital performance. Methods: We conducted a two-phase study that combined focus group and Delphi methodology. Participants were purposefully selected to attain diverse panels regarding sex, race, ethnicity, professional roles, levels of education, geographical area, and experience as a paramedic and educator. In Phase I, a panel of 11 subject matter experts (SMEs) were tasked with identifying the essential domains to be evaluated in a paramedic performance assessment. In Phase II, another panel of 11 SMEs and a four-round modified Delphi method with 28 paramedic program directors were used to validate the domains identified in Phase I. Results: The first focus group identified and achieved consensus on five domains: (1) effective communication, (2) scene management, (3) patient assessment, (4) patient management, and (5) professional behavior. These domains were validated by the second focus group. The first round of the Delphi process generated 64 content domains, which were reduced to nine unique content domains via thematic analysis. These nine content domains fit well within the broader domains identified by the focus groups with one specific area, critical thinking and reasoning, being listed in two key areas based on the definitions of the focus group domains of patient assessment and patient management. Conclusion: The content domains identified in this study provide EMS educators a theoretical framework for designing the performance assessment of newly trained professionals in the prehospital setting.

Evolution of emergency medical services in Saudi Arabia

Aim: The purpose of this study was to provide an overview of the evolution of emergency medical services (EMS) in Saudi Arabia to describe its history, organisational service providers, governance, EMS statistics and the educational development of the field with the disparity of educational approaches. Background: The EMS is an important part of the healthcare system as it is often the first point of contact for medical emergencies. The EMS in Saudi Arabia has seen a number of positive changes over the past decade, some of which include the development of several university and college programs dedicated to teaching EMS, the evaluation of the profession from a post-employment first aid model into a pre-employment bachelor's degree model, the generous governmental scholarship grants overseas and the official accreditation of EMS as a profession. It has been approximately nine years since the first EMS bachelor's degree programs were developed in Saudi Arabia, some of which were directly adopted from universities in developed countries such as Australia. Despite these positive changes, the current EMS system in Saudi is faced with many challenges, both organisational and educational, including the lack of research, community involvement, the educational status of practitioners and the inconsistencies of statistics relating to response time and rate of transfer. This paper describes the history of EMS in Saudi Arabia with a specific focus on identifying the disparity in the educational outcomes and approaches adopted by colleges and universities in the Kingdom. Methods: The data utilised for the research of the EMS profession in Saudi Arabia were obtained from the literature using search tools such as MEDLINE, Google Scholar, Saudi health journals, Saudi university websites, government reports and statistics. Conclusion: The EMS profession in Saudi Arabia has advanced greatly in the past 12 years. Yet there is still scope for considerable improvement, especially with regards to developing empirically identified core competencies for EMS bachelor's degree graduates. There is also the need for providing more outreach to the public to improve awareness of current services and available training, building more collaboration between the industry employers and academic institutions and investing further in EMS research through the development of Saudi-based postgraduate master's and PhD EMS degrees. This paper is the first to provide an overview of the EMS service in Saudi Arabia, for institutions and researchers to gain a better understanding of the history and current standing of the service from an educational and operational perspective.

On the Assessment of Paramedic Competence: A Narrative Review with Practice Implications

Introduction

Paramedicine is experiencing significant growth in scope of practice, autonomy, and role in the health care system. Despite clinical governance models, the degree to which paramedicine ultimately can be safe and effective will be dependent on the individuals the profession deems suited to practice. This creates an imperative for those responsible for these decisions to ensure that assessments of paramedic competence are indeed accurate, trustworthy, and defensible.

Purpose

The purpose of this study was to explore and synthesize relevant theoretical foundations and literature informing best practices in performance-based assessment (PBA) of competence, as it might be applied to paramedicine, for design or evaluation of assessment programs.

Methods

A narrative review methodology was applied to focus intentionally, but broadly, on purpose relevant, theoretically derived research that could inform assessment protocols in paramedicine. Primary and secondary studies from a number of health professions that contributed to and informed best practices related to the assessment of paramedic clinical competence were included and synthesized.

Results

Multiple conceptual frameworks, psychometric requirements, and emerging lines of research are forwarded. Seventeen practice implications are derived to promote understanding as well as best practices and evaluation criteria for educators, employers, and/or licensing/certifying bodies when considering the assessment of paramedic competence.

Conclusions

The assessment of paramedic competence is a complex process requiring an understanding, appreciation for, and integration of conceptual and psychometric principles. The field of PBA is advancing rapidly with numerous opportunities for research.

TavaresW,BoetS.On the assessment of paramedic competence: a narrative review with practice implications.Prehosp Disaster Med.2016;31(1):64–73.