Written reflection in assessment and appraisal: GP and GP trainee views

Leadership development as part of quality improvement in district general hospitals

OBJECTIVE

Effective clinical leadership is crucial for the delivery of high-quality medical care. However, the extent to which current leadership development effectively enhances leadership competencies for junior doctors remains uncertain.

METHODS

This study aimed to investigate the utilisation of quality improvement projects (QIPs) to enhance leadership skills among junior doctors in a District General Hospital. Additionally, the feasibility of implementing a leadership programme in a smaller District General Hospital alongside didactic learning, reflection and stakeholder engagement was assessed. The Medical Leadership Competency Framework Self-Evaluation Tool was used to assess current leadership qualities and develop personal action plans.

RESULTS

While the majority of junior doctors completed QIPs, only a few engaged in reflective practice. Moreover, limited participation in formal leadership programmes was observed.

CONCLUSION

The study suggests that effective interpersonal development combined with long-term leadership training can be a resource-intensive yet valuable approach to adequately prepare future leaders even within District General Hospitals. The findings highlight the need for a structured leadership curricula utilising longitudinal project-based learning.

The digital Balint: using AI in reflective practice

Reflective practice is fundamental to postgraduate general practitioner (GP) training and ongoing professional development. However, real-world challenges like time constraints and professional isolation often limit meaningful engagement with this critical skill. This article proposes that large language models (LLMs), sophisticated artificial intelligence systems, may have potential for enhancing reflective practice. We present three case studies, in which we explore the ability of LLMs to generate thought-provoking questions, which could prompt GPs to consider new angles, address underlying factors, and bridge the gap between theory and practice. Our findings suggest that LLMs could help reframe experiences and foster deeper self reflection, particularly for isolated practitioners. While ethical concerns regarding privacy, over reliance, and potential biases exist, we consider the possibility of responsibly integrating LLMs into reflective practice. For trainees, AI-generated questions might complement personal reflection under guidance. For GPs working in isolation, LLMs present an opportunity to enhance reflective practice, challenging us to consider a place for this technological innovation without diminishing the human aspects essential to medical practice.

'The dental nurse played a vital role in helping to manage the patient': a thematic analysis of undergraduate dental students' reflective journals from outreach placements

Introduction Community-based dental education, or 'outreach', forms a key part of dental courses in some high-income countries. Its educational benefits are well-established and once graduated, participants feel better prepared for their early career. Yet, it is less clear what students actually learn while on placements.Materials and method Qualitative document and thematic analysis of a convenience sample of anonymised dental student reflective journals (n = 51).Results The reflective journals described varied and broadly positive learning experiences. Analysis identified a number of themes of learning. Most related to the process and outcomes of care, but two key themes - dental anxiety and teamworking - were interrelated with both. Within teamworking, dental nurses appeared important in students' learning. Three process interrelated themes of learning were identified in the data. These were: tailoring your approach; communication and time; and evidence-based dentistry and minimising risk. Two broad interrelated themes relating to outcomes for patients and students were also identified: trust and confidence; and professionalism and personal development.Conclusion This research identified important and potentially transformative learning from outreach placements. This included how dental anxiety impacts patients and the dental team, the importance of teamworking, and the role of dental nurses in students' experiential learning.

A systematic scoping review of reflective writing in medical education

BACKGROUND

Reflective writing (RW) allows physicians to step back, review their thoughts, goals and actions and recognise how their perspectives, motives and emotions impact their conduct. RW also helps physicians consolidate their learning and boosts their professional and personal development. In the absence of a consistent approach and amidst growing threats to RW's place in medical training, a review of theories of RW in medical education and a review to map regnant practices, programs and assessment methods are proposed.

METHODS

A Systematic Evidence-Based Approach guided Systematic Scoping Review (SSR in SEBA) was adopted to guide and structure the two concurrent reviews. Independent searches were carried out on publications featured between 1st January 2000 and 30th June 2022 in PubMed, Embase, PsychINFO, CINAHL, ERIC, ASSIA, Scopus, Google Scholar, OpenGrey, GreyLit and ProQuest. The Split Approach saw the included articles analysed separately using thematic and content analysis. Like pieces of a jigsaw puzzle, the Jigsaw Perspective combined the themes and categories identified from both reviews. The Funnelling Process saw the themes/categories created compared with the tabulated summaries. The final domains which emerged structured the discussion that followed.

RESULTS

A total of 33,076 abstracts were reviewed, 1826 full-text articles were appraised and 199 articles were included and analysed. The domains identified were theories and models, current methods, benefits and shortcomings, and recommendations.

CONCLUSIONS

This SSR in SEBA suggests that a structured approach to RW shapes the physician's belief system, guides their practice and nurtures their professional identity formation. In advancing a theoretical concept of RW, this SSR in SEBA proffers new insight into the process of RW, and the need for longitudinal, personalised feedback and support.

Education in the Pediatric Intensive Care Unit

This article addresses the latest data and ideas related to education in the pediatric intensive care unit, including traditional education methods with newer and technology-based methods. A review of adult learning theory is included with discussions regarding medical decision making and error prevention, bedside teaching, medical simulation, and electronic methods of education.

Doctors' attitudes to maintenance of professional competence: A scoping review

CONTEXT

Recent decades have seen the international implementation of programmes aimed at assuring the continuing competence of doctors. Maintenance of Professional Competence (MPC) programmes aim to encourage doctors' lifelong learning and ensure high-quality, safe patient care; however, programme requirements can be perceived as bureaucratic and irrelevant to practice, leading to disengagement. Doctors' attitudes and beliefs about MPC are critical to translating regulatory requirements into committed and effective lifelong learning. We aimed to summarise knowledge about doctors' attitudes to MPC to inform the development of MPC programmes and identify under-researched areas.

METHODS

We undertook a scoping review following Arksey and O'Malley, including sources of evidence about doctors' attitudes to MPC in the United States, the United Kingdom, Canada, Australia, New Zealand and Ireland, and using the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) as a guide.

RESULTS

One hundred and twenty-five sources of evidence were included in the review. One hundred and two were peer-reviewed publications, and 23 were reports. Most were from the United Kingdom or the United States and used quantitative or mixed methods. There was agreement across jurisdictions that MPC is a good idea in theory but doubt that it achieves its objectives in practice. Attitudes to the processes of MPC, and their impact on learning and practice were mixed. The lack of connection between MPC and practice was a recurrent theme. Barriers to participation were lack of time and resources, complexity of the requirements and a lack of flexibility in addressing doctors' personal and professional circumstances.

CONCLUSIONS

Overall, the picture that emerged is that doctors are supportive of the concept of MPC but have mixed views on its processes. We highlight implications for research and practice arising from these findings.

Implementing a Novel Software Program to Support Pharmacy Students' Reflective Practice in Scientific Research

Objective. To explore pharmacy students' perceptions of a novel web application tool (AcaWriter) implemented in a Master of Pharmacy curriculum to support reflective thinking in scientific research.Methods. A qualitative research design involving a 50-minute focus group (n=12) was used. The focus group session was audio-taped, transcribed verbatim, and analyzed thematically using the Braun and Clarke framework.Results. Analysis generated four themes related to AcaWriter's utility in enhancing students' research thinking and capacity. The themes identified included: ease of use to prompt reflection, tangible tool with non-judgmental capacity; benefits for enhancing self and peer reflection on research techniques and group dynamics; benefits of the reflective writing process to enhance research capacity compared with engaging in reflective dialogue; and benefits beyond the writing process: cultivating self-improvement and self-confidence.Conclusion. The findings of this study show that a novel web application implemented within a pharmacy curriculum can assist students' self and peer reflection on a research task. Further research is needed to explore the impact of using this tool and its relationship with academic performance and outcomes.

Can learning from workplace feedback be enhanced by reflective writing? A realist evaluation in UK undergraduate medical education

Introduction: Doctors and medical students in the UK are currently required to provide evidence of learning by reflective writing on (among other things) feedback from colleagues. Although the theoretical value of reflecting-on-action is clear, research is still needed to know how to realise the potential of written reflection in medical education. This study arose out of efforts to improve medical student engagement with a reflective writing exercise. We used realist methodology to explain the disinclination of the majority to do written reflection on workplace feedback, and the benefits to the minority.Method: Realist evaluation is a suitable approach to researching complex interventions which have worked for some and not for others. Focus groups were held over a three-year period with year 3 and 4 students. Focus group transcripts were coded for context-mechanism-outcome configurations (the realist approach to analysing data) explaining students' choice not to write a reflection, to write a 'tick-box' reflection or to write for learning. A sub-set of eight students' reflections were also analysed to ascertain evidence of learning through reflection.Results and discussion: 27 students participated in 4 focus groups. Three summary theories emerged showing the importance of context. Firstly, written reflection is effortful and benefits those who invest in it for intrinsic reasons in situations when they need to think more deeply about a learning event. Secondly, following a reflective feedback discussion writing a reflection may add little because the learning has already taken place. Thirdly, external motivation tends to result in writing a 'tick-box' reflection.

GP appraisal: an evaluation of generational differences on the utility of GP appraisal

BACKGROUND

A number of studies have previously been published on the benefits of GP appraisal. Ours is the first study that compares the views of doctors registered before and after the introduction of appraisals on various core elements of the appraisal process.

AIM

This study aimed to explore potential differences, between GPs qualifying before and those after the introduction of NHS appraisals, on the utility of the appraisal process. Additionally, to discover the perceived impact of appraisals on interaction with colleagues and patients.

DESIGN AND SETTING

Suffolk appraisers were recruited to distribute a paper questionnaire, in two sections, for each appraisal undertaken over a 12-month period. The first part of the questionnaire related to that specific appraisal. The second part, seven questions using Likert scales and free-text comments, asked about the appraisal process in general. The feedback from the second part forms the data for this study.

RESULTS

Overall, doctors tended to agree that appraisals had a beneficial impact in the core areas investigated. However, there was a significant difference between generations: those registered before 1998 were less likely to find NHS appraisals beneficial. Both groups reported that preparation took up too much time. Opinions regarding the impact of appraisals on interaction were evenly divided amongst appraisees, with the older cohort more likely to report negatively.

CONCLUSIONS

There is a generational difference amongst GP in the perceived utility of NHS appraisal. Current plans to redesign the process to make appraisals less onerous will be welcomed by both groups.

Using text mining to analyze reflective essays from Japanese medical students after rural community placement

BACKGROUND

Following community clinical placements, medical students use reflective writing to discover the story of their journey to becoming medical professionals. However, because of assessor bias analyzing these writings qualitatively to generalize learner experiences may be problematic. This study uses a process-oriented text mining approach to better understand meanings of learner experiences by connecting key concepts in extended student reflective essays.

METHODS

Text mining quantitative analysis is used on self-evaluative essays (n = 47, unique word count range 43-575) by fifth-year students at a regional quota-system university in Japan that specializes in training general practitioners for underserved communities. First, six highly-occurring key words were identified: patient, systemic treatment, locale, hospital, care, and training. Then, standardized keyword frequency analysis robust to overall essay length and keyword volume used individual keywords as "nodes" to calculate per-keyword values for each essay. Finally, Principle Components Analysis and regression were used to analyze key word relationships.

RESULTS

Component loadings were strongest for the keyword area, indicating most shared variance. Multiply regressing three of the remaining keywords hospital, systemic treatment, and training yielded R² = 0.45, considered high for this exploratory study. In contrast, direct patient experience for students was difficult to generalize.

CONCLUSIONS

Impressions of the practicing area environment were strongest in students, and these impressions were influenced by hospital workplace, treatment provision, and training. Text mining can extract information from larger samples of student essays in an efficient and objective manner, as well as identify patterns between learning situations to create models of the learning experience. Possible implications for community-based clinical learning may be greater understanding of student experiences for on-site precepts benefitting their roles as mentors.

Experiences of recent graduates: reframing reflection as purposeful, social activity

BACKGROUND

During the Royal College of Veterinary Surgeons' (RCVS) Professional Development Phase, graduates are required to reflect on their progress. Reflection is often conceptualised as a solitary activity, which may contrast with day-to-day reflective activities in the workplace. This study drew on cultural-historical activity theory to understand how recently graduated veterinary surgeons engage in reflective activity.

METHODS

Data comprised RCVS documentation and semistructured interviews with 15 recent graduates from one veterinary school. Thematic analysis was used to describe a collective system of reflective activity and to identify contradictions in the system with the potential to limit outcomes of reflective activity.

RESULTS

Two overarching themes of contradictions were identified: 'social reflection' and 'formalising the informal'. Graduates need opportunities for talking and/or writing to progress worries into purposeful reflection, underpinned by a shared understanding of reflective activity with colleagues, and by working practices which prioritise and normalise reflective interaction.

CONCLUSION

These findings identify potential avenues to better support veterinary graduates as they negotiate the transition to working life, and suggest that reconsideration of the formal expectations of new veterinary graduates and their employers is timely.

Reflective Practice for Patient Benefit: An Analysis of Doctors' Appraisal Portfolios in Scotland

INTRODUCTION

Reflective practice has become the cornerstone of continuing professional development for doctors, with the expectation that it helps to develop and sustain the workforce for patient benefit. Annual appraisal is mandatory for all practicing doctors in the United Kingdom as part of medical revalidation. Doctors submit a portfolio of supporting information forming the basis of their appraisal discussion where reflection on the information is mandated and evaluated by a colleague, acting as an appraiser.

METHODS

Using an in-depth case study approach, 18 online portfolios in Scotland were examined with a template developed to record the types of supporting information submitted and how far these showed reflection and/or changes to practice. Data from semistructured interviews with the doctors (n = 17) and their appraisers (n = 9) were used to contextualize and broaden our understanding of the portfolios.

RESULTS

Portfolios generally showed little written reflection, and most doctors were unenthusiastic about documenting reflective practice. Appraisals provided a forum for verbal reflection, which was often detailed in the appraisal summary. Portfolio examples showed that reflecting on continued professional development, audits, significant events, and colleague multisource feedback were sometimes considered to be useful. Reflecting on patient feedback was seen as less valuable because feedback tended to be uncritical.

DISCUSSION

The written reflection element of educational portfolios needs to be carefully considered because it is clear that many doctors do not find it a helpful exercise. Instead, using the portfolio to record topics covered by a reflective discussion with a facilitator would not only prove more amenable to many doctors but would also allay fears of documentary evidence being used in litigation.

Appraisal; the next steps?

Appraisal offers an opportunity for both the clinician and the employer to demonstrate commitment to their professional responsibilities in a tangible manner that can benefit patients, the individual clinician and the service. One unintentional consequence of revalidation may have been to foster a belief that it has undermined the educational and developmental aspects of appraisal. The objective of promoting transparency and accountability through revalidation may have led some clinicians to feel they work in a culture of greater scrutiny and assessment, leading to an erosion of their engagement with the process. Some appraisers previously comfortable with the educational and supportive ethos of appraisal may be less likely to continue in that role if they are viewed or see themselves as GMC assessors. Priorities include a need for research to evaluate the impact and outcomes of appraisal and revalidation, to evaluate how appraisal can meaningfully feed into improving patient care and the contribution that medical education can make to the process.

What are the sources of stress and distress for general practitioners working in England? A qualitative study

OBJECTIVES

This paper reports the sources of stress and distress experienced by general practitioners (GP) as part of a wider study exploring the barriers and facilitators to help-seeking for mental illness and burnout among this medical population.

DESIGN

Qualitative study using in-depth interviews with 47 GP participants. The interviews were audio-recorded, transcribed, anonymised and imported into NVivo V.11 to facilitate data management. Data were analysed using a thematic analysis employing the constant comparative method.

SETTING

England.

PARTICIPANTS

A purposive sample of GP participants who self-identified as: (1) currently living with mental distress, (2) returning to work following treatment, (3) off sick or retired early as a result of mental distress or (4) without experience of mental distress. Interviews were conducted face-to-face or over the telephone.

RESULTS

The key sources of stress/distress related to: (1) emotion work-the work invested and required in managing and responding to the psychosocial component of GPs' work, and dealing with abusive or confrontational patients; (2) practice culture-practice dynamics and collegial conflict, bullying, isolation and lack of support; (3) work role and demands-fear of making mistakes, complaints and inquests, revalidation, appraisal, inspections and financial worries.

CONCLUSION

In addition to addressing escalating workloads through the provision of increased resources, addressing unhealthy practice cultures is paramount. Collegial support, a willingness to talk about vulnerability and illness, and having open channels of communication enable GPs to feel less isolated and better able to cope with the emotional and clinical demands of their work. Doctors, including GPs, are not invulnerable to the clinical and emotional demands of their work nor the effects of divisive work cultures-culture change and access to informal and formal support is therefore crucial in enabling GPs to do their job effectively and to stay well.