Assessment of competence: developing trends and ethical considerations

Re-examining single-moment-in-time high-stakes examinations in specialist training: A critical narrative review

In this critical narrative review, we challenge the belief that single-moment-in-time high-stakes examinations (SMITHSEx) are an essential component of contemporary specialist training. We explore the arguments both for and against SMITHSEx, examine potential alternatives, and discuss the barriers to change.SMITHSEx are viewed as the "gold standard" assessment of competence but focus excessively on knowledge assessment rather than capturing essential competencies required for safe and competent workplace performance. Contrary to popular belief, regulatory bodies do not mandate SMITHSEx in specialist training. Though acting as significant drivers of learning and professional identity formation, these attributes are not exclusive to SMITHSEx.Skills such as crisis management, procedural skills, professionalism, communication, collaboration, lifelong learning, reflection on practice, and judgement are often overlooked by SMITHSEx. Their inherent design raises questions about the validity and objectivity of SMITHSEx as a measure of workplace competence. They have a detrimental impact on trainee well-being, contributing to burnout and differential attainment.Alternatives to SMITHSEx include continuous low-stakes assessments throughout training, ongoing evaluation of competence in the workplace, and competency-based medical education (CBME) concepts. These aim to provide a more comprehensive and context-specific assessment of trainees' competence while also improving trainee welfare.Specialist training colleges should evolve from exam providers to holistic education sources. Assessments should emphasise essential practical knowledge over trivia, align with clinical practice, aid learning, and be part of a diverse toolkit. Eliminating SMITHSEx from specialist training will foster a competency-based approach, benefiting future medical professionals' well-being and success.

Development and Validation of a Questionnaire investigating the Knowledge, Attitudes and Practices of Healthcare Workers in the Field of Anesthesiology concerning the Italian Law on Advance Healthcare Directives: a Pilot Study

Advance healthcare directives are legal documents, in which the patient, foreseeing a potential loss of capacity and autonomy, makes in advance decisions regarding future care and, in particular, end-of-life arrangements. In Italy, advance healthcare directives  are regulated by the Law 219 of 22 December 2017. Objectives of the study were: i) to develop and validate a questionnaire dedicated to evaluate the knowledge of the Law in a sample of 98 anesthesiologists, and ii) to shed light on the process of health-related decision-making and its determinants (age, gender, doctor/training resident, religious beliefs). A second part of the survey  not analyzed  in the present study, aimed to assess, through two simulated clinical scenarios, how patient' directives, relatives and the medical staff could influence physicians' clinical decision. Overall Cronbach's alpha coefficient of the questionnaire resulted 0.83. Three factors explaining up to 38.4% of total variance (communication and relationship with the patient; critical life-threatening situations and binding nature of the advance directive for the physician; and involvement of patients). Most of the doctors (58.7%) did not fully know the recent legislative provision. The lack of knowledge is critical in view of the specificity of the clinical area investigated (anesthesiology and intensive care), which has to cope with ethical issues. An adequate revision and implementation of the traditional curricula could help medical students and trainees develop the aptitudes and skills needed in their future profession.

Hand motion analysis for assessment of nursing competence in ultrasound-guided peripheral intravenous catheter placement

Introduction:

Objective measures such as hand motion analysis are needed to assess competency in technical skills, including ultrasound-guided procedures. Ultrasound-guided peripheral intravenous catheter placement has many potential benefits and is a viable skill for nurses to learn. The objective of this study was to demonstrate the feasibility and validity of hand motion analysis for assessment of nursing competence in ultrasound-guided peripheral intravenous placement.

Methods:

We conducted a prospective cohort study at a tertiary children’s hospital. Participants included a convenience sample of nurses with no ultrasound-guided peripheral intravenous experience and experts in ultrasound-guided peripheral intravenous placement. Nurses completed hand motion analysis before and after participating in a simulation-based ultrasound-guided peripheral intravenous placement training program. Experts also completed hand motion analysis to provide benchmark measurements. After training, nurses performed ultrasound-guided peripheral intravenous placement in clinical practice and self-reported details of attempts.

Results:

A total of 21 nurses and 6 experts participated. Prior to the hands-on training session, experts performed significantly better in all hand motion analysis metrics and procedure time. After completion of the hands-on training session, the nurses showed significant improvement in all hand motion analysis metrics and procedure time. Few nurses achieved hand motion analysis metrics within the expert benchmark after completing the hands-on training session with the exception of angiocatheter motion smoothness. In total, 12 nurses self-reported 38 ultrasound-guided peripheral intravenous placement attempts in clinical practice with a success rate of 60.5%.

Discussion:

We demonstrated the feasibility and construct validity of hand motion analysis as an objective assessment of nurse competence in ultrasound-guided peripheral intravenous placement. Nurses demonstrated rapid skill acquisition but did not achieve expert-level proficiency.