Validating the knowledge represented by a self-organizing map with an expert-derived knowledge structure

BACKGROUND

Professionals are reluctant to make use of machine learning results for tasks like curriculum development if they do not understand how the results were generated and what they mean. Visualizations of peer reviewed medical literature can summarize enormous amounts of information but are difficult to interpret. This article reports the validation of the meaning of a self-organizing map derived from the Medline/PubMed index of peer reviewed medical literature by its capacity to coherently summarize the references of a core psychiatric textbook.

METHODS

Reference lists from ten editions of Kaplan and Sadock's Comprehensive Textbook of Psychiatry were projected onto a self-organizing map trained on Medical Subject Headings annotating the complete set of peer reviewed medical research articles indexed in the Medline/PubMed database (MedSOM). K-means clustering was applied to references from every edition to examine the ability of the self-organizing map to coherently summarize the knowledge contained within the textbook.

RESULTS

MedSOM coherently clustered references into six psychiatric knowledge domains across ten editions (1967-2017). Clustering occurred at the abstract level of broad psychiatric practice including General/adult psychiatry, Child psychiatry, and Administrative psychiatry.

CONCLUSIONS

The uptake of visualizations of published medical literature by medical experts for purposes like curriculum development depends upon validation of the meaning of the visualizations. The current research demonstrates that a self-organizing map (MedSOM) can validate the stability and coherence of the references used to support the knowledge claims of a standard psychiatric textbook, linking the products of machine learning to a widely accepted standard of knowledge.

Using competition for plasma donor recruitment and retention: An Australian university case study

BACKGROUND AND OBJECTIVES

Using evidence from one Australian university's participation in the Vampire Cup (an 8-week national inter-university blood donation competition), this study aimed to (1) understand important motivators and successful promotional strategies driving engagement in the competition, and (2) determine the impact of competition on the recruitment and retention of young adult plasma donors.

MATERIALS AND METHODS

We used a sequential explanatory mixed-methods design involving a self-administered survey (Study 1, n = 64) and four focus groups (Study 2, n = 20) with plasma donors aged 18-29 years who participated in the 2021 Vampire Cup. Also, we used a 12-month prospective comparative cohort analysis (Study 3) of those who did (n = 224 'competition donors') and did not (n = 448 control group) present to donate for the Vampire Cup.

RESULTS

Competition was a strong motivator, with 76% of survey participants donating to help their university win the Vampire Cup. The survey and focus groups suggested that successful engagement in the competition was due to peer-led recruitment, leveraging existing rivalries at both the inter- and intra-university level, and using prize draws to create an active online social community promoting blood donation. Competition donors donated plasma significantly more often during the competition but donated at similar rates after the competition, compared to the control group.

CONCLUSION

Rivalry-based competition strategies, combined with enthusiastic team leaders and an active social media community, can help to recruit, and retain, young adult plasma donors, and motivate an intermittent boost to donation frequency over a short period each year.

Defining the Boundaries of Psychiatric and Medical Knowledge: Applying Cartographic Principles to Self-Organising Maps

Biases in selection, training, and continuing professional development of medical specialists arise in part from reliance upon expert judgement for the design, implementation, and management of medical education. Reducing bias in curriculum development has primarily relied upon consensus processes modelled on the Delphi technique. The application of machine learning algorithms to databases indexing peer-reviewed medical literature can extract objective evidence about the novelty, relevance, and relative importance of different areas of medical knowledge. This study reports the construction of a map of medical knowledge based on the entire corpus of the MEDLINE database indexing more than 30 million articles published in medical journals since the 19th century. Techniques used in cartography to maximise the visually intelligible differentiation between regions are applied to knowledge clusters identified by a self-organising map to show the structure of published psychiatric evidence and its relationship to non-psychiatric medical domains.

Strategies for facilitating social work placements in general practice

BACKGROUND

Hosting social work placements within general practice can provide opportunities to extend interdisciplinary skills, increase the ability to meet patient needs and improve understanding of social work as a discipline.

OBJECTIVE

This paper is based on an Australian pilot project involving social work students being placed in general practice for their 500-hour placements. Collaboratively written by academics and practitioners from social work and general practice, it provides key strategies guiding practices to optimise implementing social work student placements. It identifies strategies to design the placement, select students and to prepare practices, supervisors and students to benefit student learning and the general practice.

DISCUSSION

Preparing key stakeholders, providing targeted supervision, longer appointments for social work students and involving all stakeholders are key strategies to successfully facilitate social work placements in general practice. Hosting social work students effectively can further develop multidisciplinary practice, connecting general practices even more with best practice, research and community.

Do educational interventions improve prescribing skills of medical students compared to no additional learning? A systematic review

Research suggests that medical students are not confident and may be ill-prepared to prescribe competently. Therefore, changes to standard education may be required to fortify medical student prescribing skills, confidence, and competence. However, specific education to write a safe and legal prescription is generally lacking. Furthermore, the term prescribe and the skill thereof is not clearly defined. This review compares additional education for medical students to no identified additional education or another educational modality on the skill of prescription writing. Secondary aims include review of education modalities, prescribing skill assessments, educator professional background, and timing of education within the medical curriculum. This systematic review was conducted and reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses. Databases searched included: CINAHL, Cochrane Library, EMBASE, Emcare (Ovid), MEDLINE (Ovid), PubMed and Scopus. Search terms included: medical education, medical undergraduate, medical student, medical school, and prescriptions. The search was conducted in February 2023, and quantitative outcomes were reported. Of the 5197 citations identified, 12 met the inclusion criteria. Eleven studies reported significant improvements in prescribing skills of medical students after additional educational intervention(s). Various educational modalities were implemented, including case-based teaching (n=3), patient-based teaching (n=1), tutorial-based teaching (n=2), didactic teaching (n=1), and mixed methods (n=6). There were no commonalities in the professional background of the educator; however, five studies used faculty members. There was no consensus on the best assessment type and time to implement prescription writing education during medical training. There are a range of interventions to educate and assess prescribing competencies of medical students. Despite heterogenous study designs, there is evidence of the superiority of additional prescription writing education versus no identified additional education to develop prescription writing skills. The introduction of formal teaching and standardised assessment of prescribing skills for medical students is recommended.

What works for and what hinders deimplementation of low-value care in emergency medicine practice? A scoping review

OBJECTIVES

Low-value care can harm patients and healthcare systems. Despite a decade of global endeavours, low value care has persisted. Identification of barriers and enablers is essential for effective deimplementation of low-value care. This scoping review is an evidence summary of barriers, enablers and features of effective interventions for deimplementation of low-value care in emergency medicine practice worldwide.

DESIGN

A mixed-methods scoping review was conducted using the Arksey and O'Malley framework.

DATA SOURCES

Medline, CINAHL, Embase, EMCare, Scopus and grey literature were searched from inception to 5 December 2022.

ELIGIBILITY CRITERIA

Primary studies which employed qualitative, quantitative or mixed-methods approaches to explore deimplementation of low-value care in an EM setting and reported barriers, enablers or interventions were included. Reviews, protocols, perspectives, comments, opinions, editorials, letters to editors, news articles, books, chapters, policies, guidelines and animal studies were excluded. No language limits were applied.

DATA EXTRACTION AND SYNTHESIS

Study selection, data collection and quality assessment were performed by two independent reviewers. Barriers, enablers and interventions were mapped to the domains of the Theoretical Domains Framework. The Mixed Methods Appraisal Tool was used for quality assessment.

RESULTS

The search yielded 167 studies. A majority were quantitative studies (90%, 150/167) that evaluated interventions (86%, 143/167). Limited provider abilities, diagnostic uncertainty, lack of provider insight, time constraints, fear of litigation, and patient expectations were the key barriers. Enablers included leadership commitment, provider engagement, provider training, performance feedback to providers and shared decision-making with patients. Interventions included one or more of the following facets: education, stakeholder engagement, audit and feedback, clinical decision support, nudge, clinical champions and training. Multifaceted interventions were more likely to be effective than single-faceted interventions. Effectiveness of multifaceted interventions was influenced by fidelity of the intervention facets. Use of behavioural change theories such as the Theoretical Domains Framework in the published studies appeared to enhance the effectiveness of interventions to deimplement low-value care.

CONCLUSION

High-fidelity, multifaceted interventions that incorporated education, stakeholder engagement, audit/feedback and clinical decision support, were administered daily and lasted longer than 1 year were most effective in achieving deimplementation of low-value care in emergency departments. This review contributes the best available evidence to date, but further rigorous, theory-informed, qualitative and mixed-methods studies are needed to supplement the growing body of evidence to effectively deimplement low-value care in emergency medicine practice.

Cultural safety in telehealth consultations with Indigenous people: A scoping review of global literature

INTRODUCTION

Telehealth has become increasingly routine within healthcare and has potential to reduce barriers to care, including for Indigenous populations. However, it is crucial for practitioners to first ensure that their telehealth practice is culturally safe. This review aims to describe the attributes of culturally safe telehealth consultations for Indigenous people as well as strategies that could promote cultural safety.

METHODS

A scoping review was conducted on key features of cultural safety in telehealth for Indigenous people using the Johanna Briggs Institute (JBI) guidelines and PRISMA-ScR checklist. Five electronic databases were searched, and additional literature was identified through handsearching.

RESULTS

A total of 649 articles were screened resulting in 17 articles included in the review. The central themes related to the provision of culturally safe telehealth refer to attributes of the practitioner: cultural and community knowledge, communication skills and the building and maintenance of patient-provider relationships. These practitioner attributes are modified and shaped by external environmental factors: technology, the availability of support staff and the telehealth setting.

DISCUSSION

This review identified practitioner-led features which enhance cultural safety but also recognised the structural factors that can contribute, both positively and negatively, to the cultural safety of a telehealth interaction. For some individuals, telehealth is not a comfortable or acceptable form of care. However, if strategies are undertaken to make telehealth more culturally safe, it has the potential to increase opportunities for access to care and thus contribute towards reducing health inequalities faced by Indigenous peoples.

Assessing cultural safety in general practice consultations for Indigenous patients: protocol for a mixed methods sequential embedded design study

BACKGROUND

Assessment of cultural safety in general practice consultations for Indigenous patients is a complex notion. Design and development of any assessment tool needs to be cognizant that cultural safety is determined by Indigenous peoples and incorporates defined components of cultural safety and current educational theory. Consideration of how social, historical, and political determinants of health and well-being impact upon the cultural safety of a consultation is also important. Given this complexity, we assume that no single method of assessment will be adequate to determine if general practice (GP) registrars are demonstrating or delivering culturally safe care. As such, we propose that development and assessment of cultural safety can be conceptualised using a model that considers these variables. From this, we aim to develop a tool to assess whether GP registrars are conducting a culturally safe consultation, where cultural safety is determined by Aboriginal and Torres Strait Islander peoples.

METHODS

This protocol will be situated in a pragmatic philosophical position to explore cultural safety primarily from the Australian Aboriginal and Torres Strait Islander patients' perspective with triangulation and validation of findings with the GP and GP registrar perspective, the Aboriginal and Torres Strait Islander community, and the medical education community. The study will integrate both quantitative and qualitative data through three sequential phases. Data collection will be through survey, semi-structured interviews, an adapted nominal group technique, and a Delphi questionnaire. We aim to recruit approximately 40 patient and 20 GP participants for interviews, conduct one to five nominal groups (seven to 35 participants) and recruit fifteen participants for the Delphi process. Data will be analysed through a content analysis approach to identify components of an assessment of cultural safety for GP registrars.

DISCUSSION

This study will be one of the first to explore how cultural safety, as determined by Indigenous peoples, can be assessed in general practice consultations. This protocol is shared to stimulate awareness and discussion around this significant issue and prompt other studies in this area.

A return-on-investment analysis of impacts on James Cook University medical students and rural workforce resulting from participation in extended rural placements

INTRODUCTION

Although all James Cook University (JCU) medical students complete multiple rural placements, some undertake extended 5-10 month rural placements in their final year. This study uses return-on-investment (ROI) methodology to quantify student and rural medical workforce benefits of these 'extended placements' from 2012 to 2018.

METHODS

Forty-six medical graduates were sent a survey exploring the benefits to students and to the rural workforce from participation in extended placements, as well as estimated costs to students, deadweight (how much change would have occurred without participating), and attribution (how much change was due to other experiences). The key student and rural workforce benefits were each assigned a 'financial proxy' to allow calculation of ROI as a dollar value that could be compared with the costs to students and to the medical school.

RESULTS

Of the graduates, 25/46 responded (54%), reporting the major benefit was 'greater depth and breadth of clinical skills'. The overall cost of undertaking extended placements for students was $60,264 (AUD), while the medical school costs were $32,560 (total costs: $92,824). Given the total value of benefits ($705,827) calculated for the key student benefit of increased clinical skills and confidence in the internship year ($32,197) and for the key rural workforce benefit of willingness to work rurally ($673,630), the ROI from the extended rural programs is $7.60 for every dollar spent.

DISCUSSION

This study confirms significant positive impacts of extended placements on final-year medical students with longer-term benefits for rural workforce. This positive ROI is important evidence for shifting the conversation around supporting extended placements from one of cost to one of value.

Mid-career graduate practice outcomes of the James Cook University medical school: key insights from the first 20 years

INTRODUCTION

Previous studies demonstrate early-career James Cook University (JCU) medical graduates are more likely to practise in regional, rural and remote areas than other Australian doctors. This study investigates whether these practice patterns continue into mid-career, identifying key demographic, selection, curriculum and postgraduate training factors associated with rural practice.

METHODS

The medical school's graduate tracking database identified 2019 Australian practice location data for 931 graduates across postgraduate years (PGY) 5-14, which were categorised into Modified Monash Model (MMM) rurality classifications. Multinominal logistic regression was undertaken to identify specific demographic, selection process, undergraduate training and postgraduate career variables associated with practice in a regional city (MMM2), large to small rural town (MMM3-5) or remote community (MMM6-7).

RESULTS

One-third of mid-career (PGY5-14) graduates were working in regional cities, mostly in North Queensland, with 14% in rural towns and 3% in remote communities. These first 10 cohorts were undertaking careers in general practice (n=300, 33%), as subspecialists (n=217, 24%), rural generalists (n=96, 11%), generalist specialists (n=87, 10%) or hospital non-specialists (n=200, 22%).

DISCUSSION

The findings show positive outcomes from the first 10 JCU cohorts for regional Queensland cities, with a significantly higher proportion of mid-career graduates practising regionally compared with the overall Queensland population. The proportion of JCU graduates practising in smaller rural or remote towns is similar to the overall Queensland population. The establishment of the postgraduate JCUGP Training program and the Northern Queensland Regional Training Hubs for building local specialist training pathways should further strengthen medical recruitment and retention across northern Australia.

Identifying emerging topics in the peer-reviewed literature to facilitate curriculum renewal and development

This article reports a bibliometric analysis of emerging topics in the psychiatric literature indexed in the MEDLINE database as a technique for renewal of clinical training curricula. Summary data of English-language articles indexed in the MEDLINE database between 1971-2018 were downloaded. Emerging topics in nine demi-decades between 1972-1976 and 2012-2016 were identified by the incremental incidence of individual Medical Subject Headings (MeSH) compared with previous years. Co-word analysis was used to investigate and visualise the relationships between emerging topics in each demi-decade. Summaries of 18 million articles annotated with psychiatric/psychological MeSH were retrieved and used to identify emerging topics. Peaks in the number of articles annotated by the top 20 emerging topics in 9 demi-decades coincided with release of the third and fourth editions of the Diagnostic and Statistical Manual which codifies psychiatric diagnoses. Themes emerging from network visualisations of the most common emerging MeSH in each demi-decade were consistent with movements in psychiatric/psychological theory and practice since the 1970s, including the recent focus on psychological and social factors implicated in suicide and suicide prevention. The identification of emerging topics within the published medical literature is a viable technique for use in curriculum renewal projects as a counterweight to biases driven by expert judgement. While indices like MEDLINE make the published literature an appealing initial step in building an empirical basis for curriculum development, it also demonstrates the potential value of less public and less structured data, such as health service electronic medical records.

Identification of barriers, enablers and interventions to inform deimplementation of low-value care in emergency medicine practice: A protocol for a mixed methods scoping review informed by the Theoretical Domains Framework

INTRODUCTION

Low-value care can lead to patient harm, misdirected clinician time and wastage of finite healthcare resources. Despite worldwide endeavours, deimplementing low-value care has proved challenging. Multifaceted, context and barrier-specific interventions are essential for successful deimplementation. The aim of this literature review is to summarise the evidence about barriers to, enablers of and interventions for deimplementation of low-value care in emergency medicine practice.

METHODS AND ANALYSIS

A mixed methods scoping review using the Arksey and O'Malley framework will be conducted. MEDLINE, CINAHL, EMBASE, EMCare, Scopus and grey literature will be searched from inception. Primary studies will be included. Barriers, enablers and interventions will be mapped to the domains of the Theoretical Domains Framework. Study selection, data collection and quality assessment will be performed by two independent reviewers. NVivo software will be used for qualitative data analysis. Mixed Methods Appraisal Tool will be used for quality assessment. Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews framework will be used to present results.

ETHICS AND DISSEMINATION

Ethics approval is not required for this scoping review. This review will generate an evidence summary regarding barriers to, enablers of and interventions for deimplementation of low-value care in emergency medicine practice. This review will facilitate discussions about deimplementation with relevant stakeholders including healthcare providers, consumers and managers. These discussions are expected to inform the design and conduct of planned future projects to identify context-specific barriers and enablers then codesign, implement and evaluate barrier-specific interventions.

Understanding medical students' transformative experiences of early preclinical international rural placement over a 20-year period

INTRODUCTION

Rural placements are an important component of rural medical education programs seeking to develop rural practice pathways for medical students. These placements are usually domestic, but James Cook University in Australia developed an international rural placement program in the first half of the medical course that was funded through bursaries. This study explores how the international rural placement helped to shape the lives (personal development and learning) of the participants, using Transformational Learning Theory as a framework for identifying and describing the transformational elements, process and impact of the program.

METHODS

Sixty-five students received a bursary for an international rural placement between 2001-2019. All were contacted by email and invited to participate in a short survey and a follow-up interview. Fifteen participants agreed and twelve were able to participate in individual semi-structured interviews which were recorded, transcribed and analysed using inductive thematic analysis.

RESULTS

Participants reported that the bursary provided a "once in a lifetime opportunity" to "experience eye-opening and culturally rich difference". Nonetheless, some elements of the placement experience presented disorientating dilemmas that triggered deep reflections and shifts in perceptions. The bursary recipients realised that "being open-minded" allowed them "enjoy good company". They were also able to assume "outsider view which allowed reassessment of their own country" and the "isolation experiences gingered desire to right health wrongs". The triggers and mental shifts had significant impact on the bursary recipients and fostered the development of "inspirational new horizons" based on an appreciation of the "value of rural practice" and "role-modelling for life-long learning." These findings are consistent with Transformational Learning Theory.

CONCLUSION

Participants in this study reported meaningful and strongly positive impacts from the experiences gained during an international rural clinical placement early in their course. They described transformative experiences which appear to contribute strongly to personal development. This finding supports maintaining opportunities for international experiences during rurally-oriented medical programs as these may impact longer term career choice.

Assessment of cultural safety in a post-Objective Structured Clinical Examination (OSCE) era

BACKGROUND

As The Royal Australian College of General Practitioners (RACGP) introduces alternatives to the Objective Structured Clinical Examination, it is imperative that standards are continually set for a culturally safe general practice workforce. Assessments have many functions and should be continually reviewed to ensure that they require general practitioners (GPs) to demonstrate genuine cultural safety.

OBJECTIVE

The aim of this article is to highlight the complexities in assessing the cultural safety of GPs when consulting with Aboriginal and Torres Strait Islander peoples.

DISCUSSION

Presently there is a lack of validated approaches for assessing cultural safety of GPs. This creates challenges for the RACGP in redesigning fellowship examinations. Yet in this challenge is an opportunity to consider assessment design that is not competency based, amplifies Aboriginal and Torres Strait Islander peoples' voices and reflects the complexity of cultural safety.

Medicine and dentistry: Understanding the language of dentistry

BACKGROUND

Dental problems are common in general practice and are responsible for many avoidable hospitalisations. Medicine and dentistry are often practised in isolation, with little shared language or understanding.

OBJECTIVE

The aim of this article is to help general practitioners (GPs) maximise effective dental referral strategies by briefly outlining basic dental nomenclature and describing the roles of different types of oral healthcare providers.

DISCUSSION

The oral cavity contains hard and soft tissues that are all prone to oral disease, which can lead to systemic disease. It is important for GPs to have some basic familiarity with dental nomenclature, anatomy and tooth eruption times. In Australia, there are seven different oral healthcare providers and 13 dental specialities. This article will summarise their distinct roles and explain some common dental procedures used to definitively treat oral health problems. This knowledge should encourage more efficient interprofessional communication and enable general practitioners to optimise referral pathways for patients with oral health problems.

Mid-career graduate practice outcomes of the James Cook University medical school: key insights from the first 20 years

INTRODUCTION

Previous studies have demonstrated early-career James Cook University (JCU) medical graduates are more likely to practise in regional, rural and remote areas than other Australian medical practitioners. This study investigates whether these non-metropolitan practice location outcomes continue into mid-career, and identifies the key underlying demographic, selection process, curriculum and postgraduate training factors associated with JCU graduates choosing to currently practise in regional, rural and remote areas of Australia.

METHODS

This study used the JCU medical school's graduate tracking database to identify 2019 Australian practice location data for 931 JCU medical graduates across postgraduate years (PGY) 5-14. This data was sourced primarily from the Australian Health Practitioner Regulation Agency, and then categorised into Modified Monash Model (MMM) rurality classifications using the Department of Health's DoctorConnect website. For these mid-career (PGY5-14) cohorts, multinominal logistic regression was undertaken to identify specific demographic, selection process, undergraduate training and postgraduate career variables found to be associated with a 2019 practice location in a regional city (MMM2), large to small rural town (MMM3-5) or remote community (MMM6-7). Additional multinominal logistic regression analysis was then used to determine the key independent predictors of mid-career JCU medical graduates working in regional cities (MMM2), rural towns (MMM3-5) and remote communities (MMM6-7) in 2019.

RESULTS

Around one-third of mid-career (PGY5-14) JCU medical graduates were working in regional cities during 2019, mostly in North Queensland, with a further 14% in rural towns and 3% in remote communities. These first 10 cohorts were undertaking careers in general practice (n=300, 33%), as subspecialists (n=217, 24%), rural generalists (n=96, 11%), generalist specialists (n=87, 10%) or hospital non-specialists (n=200, 22%). Key statistically significant, independent predictors of JCU MBBS graduates practising in MMM3-5 and MMM6-7 locations in 2019 were, respectively, being awarded a rurally bonded Australian Government undergraduate Medical Rural Bonded Scholarship (MRBS) (p=0.004, prevalence odds ratio (POR)=3.5; p=0.017, POR=7.3); graduation from the JCU postgraduate general practice training program, JCU General Practice Training (p=0.001, POR=3.9; p<0.001, POR=20.1) and internship training in a hospital located in a regional city (p=0.003, POR=2.4; p=0.049, POR=4.3) or in a rural or remote town (p=0.033, POR=5.0; p=0.002, POR=54.6). JCU MBBS graduates practising in MMM3-5 locations was also predicted by a rural hometown at application to the medical school (p=0.021, POR=2.5) and choosing a career in general practice (p<0.010, POR=4.4) or in rural generalism (p<0.001, POR=26.4), while JCU MBBS graduates practising in MMM6-7 locations was also predicted by undertaking an extended 20- or 35-week undergraduate rural placement during year 6 (p=0.014, POR=8.9).

CONCLUSION

The findings show positive outcomes from the first 10 cohorts of JCU medical graduates for regional Queensland cities, with a significantly higher proportion of mid-career graduates practising in regional areas of Queensland than the percentage of the overall Queensland population. The proportion of JCU medical graduates practising in smaller regional and remote towns is similar to the overall Queensland population. The recent establishment of the postgraduate JCU General Practice Training program for vocational generalist medicine training and the Northern Queensland Regional Training Hubs for building local specialist training pathways should further strengthen the retention and recruitment of JCU and other medical graduates across the northern Australia region.

A return-on-investment analysis of impacts on James Cook University medical students and rural workforce resulting from participation in extended rural placements

INTRODUCTION

Although all medical students at James Cook University (JCU), Queensland, Australia, undertake rural placements throughout their course, a proportion (currently about 20 per year out of 170-190 final-year students) undertake extended rural placements in rural and remote towns - 5-month Integrated Rural Placement (IRP) or 10-month Longitudinal Integrated Clerkship (LIC) programs. This study uses a return-on-investment (ROI) approach to quantify student and rural medical workforce benefits arising from these 'extended placements' between 2012 and 2018.

METHODS

Seventy-two JCU MBBS graduates participated in extended rural placements between 2012 and 2018. In 2019, 46 of these graduates who had reached at least postgraduate year 2 and provided consent to be contacted for health workforce research were emailed a link to an online survey. Questions explored the key benefits to students' development of competencies and to rural medical workforce as a direct result of student participation in the IRP/LIC activities, as well as estimations of costs to students, deadweight (how much change would have occurred without participating in an extended placement), and attribution (how much change was due to other programs or experiences). The key student and rural medical workforce benefits were each assigned a 'financial proxy' to allow calculation of ROI from 2013 to 2019 as a dollar value, compared with the costs to students and to the JCU medical school from implementing the IRP/LIC programs between 2012 and 2018.

RESULTS

Twenty-five of the 46 JCU medical graduates who undertook an extended placement responded (response rate 54%), reporting that the most common (96%) and most important benefit (56%) from their extended placement was 'greater depth and breadth of clinical skills'. Seventy-five percent (18/24; one missing response for this question) of the respondents also reported intending to have a full-time career in rural and remote practice. The overall cost of undertaking an IRP or LIC program for students between 2012 and 2018 was calculated to be $60,264, while the cost to the JCU medical school for sending 72 students out on extended rural placements was calculated as $32,560, giving total costs of $92,824. Given the total value of benefits ($705,827) calculated for the key student benefit of increased clinical skills and confidence in the internship year from participating in an extended placement ($32,197) and for the key rural medical workforce benefit of willingness to work in a rural or remote town ($673,630), the ROI from the extended rural programs between 2013 and 2019 (after students graduated and entered the workforce) is calculated at $7.60 for every dollar spent.

CONCLUSION

This study confirms that undertaking an extended placement has significant positive impacts on final-year medical students' clinical confidence, clinical skills and communication skills into their internship year. In addition, the extended placements have longer-term impacts on the non-metropolitan health workforce by inspiring more JCU medical graduates to take up rural generalist, rural general practitioner or generalist specialist positions in rural and remote towns. This positive ROI from extended rural placements is important evidence for shifting the conversation around supporting these programs from one of cost to one of value.

Systematic review of specialist selection methods with implications for diversity in the medical workforce

PURPOSE

There is growing concern that inequities in methods of selection into medical specialties reduce specialist cohort diversity, particularly where measures designed for another purpose are adapted for specialist selection, prioritising reliability over validity. This review examined how empirical measures affect the diversity of specialist selection. The goals were to summarise the groups for which evidence is available, evaluate evidence that measures prioritising reliability over validity contribute to under-representation, and identify novel measures or processes that address under-representation, in order to make recommendations on selection into medical specialties and research required to support diversity.

METHOD

In 2020-1, the authors implemented a comprehensive search strategy across 4 electronic databases (Medline, PsychINFO, Scopus, ERIC) covering years 2000-2020, supplemented with hand-search of key journals and reference lists from identified studies. Articles were screened using explicit inclusion and exclusion criteria designed to focus on empirical measures used in medical specialty selection decisions.

RESULTS

Thirty-five articles were included from 1344 retrieved from databases and hand-searches. In order of prevalence these papers addressed the under-representation of women (21/35), international medical graduates (10/35), and race/ethnicity (9/35). Apart from well-powered studies of selection into general practice training in the UK, the literature was exploratory, retrospective, and relied upon convenience samples with limited follow-up. There was preliminary evidence that bias in the measures used for selection into training might contribute to under-representation of some groups.

CONCLUSIONS

The review did not find convincing evidence that measures prioritising reliability drive under-representation of some groups in medical specialties, although this may be due to limited power analyses. In addition, the review did not identify novel specialist selection methods likely to improve diversity. Nevertheless, significant and divergent efforts are being made to promote the evolution of selection processes that draw on all the diverse qualities required for specialist practice serving diverse populations. More rigorous prospective research across different national frameworks will be needed to clarify whether eliminating or reducing the weighting of reliable pre-selection academic results in selection decisions will increase or decrease diversity, and whether drawing on a broader range of assessments can achieve both reliable and socially desirable outcomes.

'Stability' of Assessment: Extending the Utility Equation

This article was migrated. The article was marked as recommended. The COVID-19 pandemic has brought many challenges to medical education, necessitating a rapid transition to digital delivery. The widespread move to online exams has introduced novel risks, including the risk of catastrophic IT failure. These are not 'black swan' events - something so unexpected and devastating that we could not anticipate them and prepare accordingly. The phrase 'black elephants', a cross between a black swan and 'the elephant in the room' has been coined to describe these events. Moving to high-stakes online examinations introduces another element that needs to be considered and managed: the 'stability' of the assessment format used. This dimension incorporates notions of 'platform reliability' and 'internal risk management' and can be caused by both unplanned events eg IT failures, and planned events like security breaches Developing approaches to mitigate this new risk suggests another dimension to the well-known assessment 'utility equation': stability of the platform used. This paper explores the concept of stability from the perspectives of educational institutions and candidates and offers some approaches to achieving stability. The delivery of assessment in the digital age, requires the 'utility equation' to be recalibrated and establishment of a new "sweet spot" for each assessment program.

Twelve things we have learned from medical students during the Pandemic

This article was migrated. The article was marked as recommended. While the COVID-19 pandemic has disrupted every aspect of modern life, including medical education, the response has been remarkable. Ingenuity and innovation have flourished in the face of adversity. An international community of practice has blossomed in response to the challenges posed by COVID-19. Communication and sharing of information have been a hallmark of this community. In Australasia, the Medical Education Collaborative Committee hosted a series of meetings and webinars which enabled educators from all Australian and New Zealand medical schools to share experiences, solutions and resources. This group is auspiced by the Medical Deans Australia and New Zealand, which is the peak body representing professional entry-level medical education, training and research. One of these webinars focused on the student experience, featuring a panel of Australasian medical students drawn from a range of medical schools. The discussion during this session was wide reaching, including topics such as communication, co-designing curriculum changes, the importance of compassion, innovative practice, and meaningful student participation in placements. The ideas drawn from the panel discussion augmented by rich audience participation form the basis of the twelve tips presented in this paper. While derived from the experience in Australia and New Zealand, the authors believe these lessons are likely to be relevant in other jurisdictions.

Examiners' decision-making processes in observation-based clinical examinations

BACKGROUND

Objective structured clinical examinations (OSCEs) are commonly used to assess the clinical skills of health professional students. Examiner judgement is one acknowledged source of variation in candidate marks. This paper reports an exploration of examiner decision making to better characterise the cognitive processes and workload associated with making judgements of clinical performance in exit-level OSCEs.

METHODS

Fifty-five examiners for exit-level OSCEs at five Australian medical schools completed a NASA Task Load Index (TLX) measure of cognitive load and participated in focus group interviews immediately after the OSCE session. Discussions focused on how decisions were made for borderline and clear pass candidates. Interviews were transcribed, coded and thematically analysed. NASA TLX results were quantitatively analysed.

RESULTS

Examiners self-reported higher cognitive workload levels when assessing a borderline candidate in comparison with a clear pass candidate. Further analysis revealed five major themes considered by examiners when marking candidate performance in an OSCE: (a) use of marking criteria as a source of reassurance; (b) difficulty adhering to the marking sheet under certain conditions; (c) demeanour of candidates; (d) patient safety, and (e) calibration using a mental construct of the 'mythical [prototypical] intern'. Examiners demonstrated particularly higher mental demand when assessing borderline compared to clear pass candidates.

CONCLUSIONS

Examiners demonstrate that judging candidate performance is a complex, cognitively difficult task, particularly when performance is of borderline or lower standard. At programme exit level, examiners intuitively want to rate candidates against a construct of a prototypical graduate when marking criteria appear not to describe both what and how a passing candidate should demonstrate when completing clinical tasks. This construct should be shared, agreed upon and aligned with marking criteria to best guide examiner training and calibration. Achieving this integration may improve the accuracy and consistency of examiner judgements and reduce cognitive workload.

Leadership curricula and assessment in Australian and New Zealand medical schools

BACKGROUND

The Australian Medical Council, which accredits Australian medical schools, recommends medical leadership graduate outcomes be taught, assessed and accredited. In Australia and New Zealand (Australasia) there is a significant research gap and no national consensus on how to educate, assess, and evaluate leadership skills in medical professional entry degree/programs. This study aims to investigate the current curricula, assessment and evaluation of medical leadership in Australasian medical degrees, with particular focus on the roles and responsibilities of medical leadership teachers, frameworks used and competencies taught, methods of delivery, and barriers to teaching leadership.

METHODS

A self-administered cross-sectional survey was distributed to senior academics and/or heads or Deans of Australasian medical schools. Data for closed questions and ordinal data of each Likert scale response were described via frequency analysis. Content analysis was undertaken on free text responses and coded manually.

RESULTS

Sixteen of the 22 eligible (73%) medical degrees completed the full survey and 100% of those indicate that leadership is taught in their degree. In most degrees (11, 69%) leadership is taught as a common theme integrated throughout the curricula across several subjects. There is a variety of leadership competencies taught, with strengths being communication (100%), evidence based practice (100%), critical reflective practice (94%), self-management (81%), ethical decision making (81%), critical thinking and decision making (81%). Major gaps in teaching were financial management (20%), strategic planning (31%) and workforce planning (31%). The teaching methods used to deliver medical leadership within the curricula are diverse, with many degrees providing opportunities for leadership teaching for students outside the curricula. Most degrees (10, 59%) assess the leadership education, with one-third (6, 35%) evaluating it.

CONCLUSIONS

Medical leadership competencies are taught in most degrees, but key leadership competencies are not being taught and there appears to be no continuous quality improvement process for leadership education. There is much more we can do as medical educators, academics and leaders to shape professional development of academics to teach medical leadership, and to agree on required leadership skills set for our students so they can proactively shape the future of the health care system.

Factors impacting the solo remote placement experiences of undergraduate James Cook University medical students: A mixed-methods pilot study

OBJECTIVE

To determine the factors impacting the experiences of James Cook University medical students on solo placements in remote towns.

DESIGN

This 2018 pilot study used an exploratory sequential mixed-methods approach to explore the recent solo remote placement experiences of James Cook University medical students. Qualitative interviews were performed initially to elicit context sensitive themes for the self administered survey. The survey went on to use Likert-scale questions in addition to pre-validated survey instruments.

SETTING

Focus groups and interviews took place at James Cook University Medical School in Townsville in late 2018 after students returned from their rural rotation. Two telephone interviews were conducted for Year 6 students unable to attend the focus groups.

PARTICIPANTS

James Cook University medical students in years 2, 4 and 6 students who experienced a solo placement in a remote (MMM 6 or 7) town during 2017 or 2018 were invited to be part of the study. Only Townsville-based students were involved. A total of 14 students participated in the focus groups (n = 14) and a further 31 students completed the survey (n = 31).

MAIN OUTCOME MEASURE(S)

Interviews identified themes negatively or positively impacting solo remote placement experience, while bivariate analysis identified factors associated with having an 'excellent' overall experience.

RESULTS

Student interviews identified five main themes impacting student experience in remote communities: culture of the medical facility; quality and quantity of clinical experiences; quality of accommodation; placement length; and community infrastructure and services. Negative impacts could result in students experiencing social isolation. Students reporting an 'excellent' solo remote placement experience in the survey were more likely to have: felt very welcome in the community; felt the health staff supported them; heavily involved themselves in clinical activities; enjoyed the experiences remote communities can offer; positive rural career intentions; reported they 'bounce back during and after life's most stressful events'; and come from a rural or remote hometown.

CONCLUSIONS

Solo remote placements provide medical students with opportunities to further knowledge, clinical capabilities, social experiences and careers, but can have negative aspects. However, negative aspects are often modifiable management issues or can potentially be avoided if prospective students are better informed of the challenges associated with remote communities.

"We learnt it, then we lived it": Influencing medical students' intentions toward rural practice and generalist careers via a socially-accountable curriculum

OBJECTIVE

The James Cook University (JCU) medical school has a mission to produce graduates committed to practising with underserved populations. This study explores the views of final-year students regarding the influence of the JCU medical curriculum on their self-reported commitment to socially-accountable practice, intentions for rural practice, and desired postgraduate training pathway.

METHODS

Cross-sectional survey of final year JCU medical students (n = 113; response rate = 65%) to determine whether their future career directions (intentions for future practice rurality and postgraduate specialty training pathway) are driven more by altruism (commitment to socially accountable practice/community service) or by financial reward and/or prestige.

RESULTS

Overall, 96% of responding students reported their JCU medical course experiences had cultivated a greater commitment towards 'socially-accountable' practice. A commitment to socially-accountable practice over financial reward and/or prestige was also significantly associated with preferring to practise Medicine in non-metropolitan areas (p = 0.036) and intending to choose a 'generalist' medical discipline (p = 0.003).

CONCLUSIONS

The findings suggest the JCU medical curriculum has positively influenced the commitment of its graduating students towards more socially accountable practice. This influence is a likely result of pre-clinical teachings around health inequalities and socially-accountable medical practice in combination with real-world, immersive experiences on rural and international placements.

How does GP training impact rural and remote underserved communities? Exploring community and professional perceptions

Background

Substantial government funding has been invested to support the training of General Practitioners (GPs) in Australia to serve rural communities. However, there is little data on the impact of this expanded training on smaller communities, particularly for smaller rural and more remote communities. Improved understanding of the impact of training on underserved communities will assist in addressing this gap and inform ongoing investment by governments and communities.

Method

A purposive sample of GP supervisors, GP registrars, practice managers and health services staff, and community members (n = 40) from previously identified areas of workforce need in rural and remote North-West Queensland were recruited for this qualitative study. Participants had lived in their communities for periods ranging from a few months to 63 years (Median = 12 years). Semi-structured interviews and a focus group were conducted to explore how establishing GP training placements impacts underserved communities from a health workforce, health outcomes, economic and social perspective. The data were then analysed using thematic analysis.

Results

Participants reported they perceived GP training to improve communities’ health services and health status (accessibility, continuity of care, GP workforce, health status, quality of health care and sustainable health care), some social factors (community connectedness and relationships), cultural factors (values and identity), financial factors (economy and employment) and education (rural pathway). Further, benefits to the registrars (breadth of training, community-specific knowledge, quality of training, and relationships with the community) were reported that also contributed to community development.

Conclusion

GP training and supervision is possible in smaller and more remote underserved communities and is perceived positively. Training GP registrars in smaller, more remote communities, matches their training more closely with the comprehensive primary care services needed by these communities.

Twelve tips for OSCE-style Tele-assessment

This article was migrated. The article was marked as recommended. The Australian College of Rural and Remote Medicine (ACRRM) has developed a flexible 'tele-assessment' approach to the delivery of its assessment modalities. Candidates can sit their examination remotely, close to their place of practice, which reduces the need for rural doctors - both candidates and examiners - to leave their communities for the purpose of assessment. A major component of the assessment process is the Structured Assessment using Multiple Patient Scenarios (StAMPS) examination, which blends the formats of an Objective Structured Clinical Examination (OSCE) and a traditional viva vocè examination. It is a high-stakes assessment, that was designed to be academically rigorous, flexible, valid, reliable, and fair. Since 2008 ACRRM has provided a videoconferencing option to candidates for their StAMPS examination allowing them to remain in or near their home location, while the examiners meet a central location. Travel restrictions due to the SARS-CoV-2 pandemic meant for the first time both candidates AND examiners participated in StAMPS via videoconference. ACRRM conducted an online StAMPS assessment using videoconferencing technology for 65 candidates in mid-May 2020, with all candidates, examiners and support staff remaining in or near their home communities. These Twelve Tips outline some of the experience gained in providing tele-assessment over the past twelve years.

Development of the Rural Generalist Program Japan: meeting the needs of Japanese rural communities

CONTEXT

There is a worldwide shortage of physicians, which is worse in rural areas, with a large underserved rural and remote population. Most jurisdictions in countries of all income levels report shortages of rural doctors, often exacerbated where primary care is not strong. Japan is not an exception: Japanese specialist-driven approaches in medical education and public health have resulted in disproportionate distribution of medical services in the country.

ISSUE

Rural generalism, or rural generalist medicine, is emerging in many jurisdictions as one approach to training and provision of care for rural communities. While there is considerable variation in titles, the format of the training and models of care, the emphasis is on training a generalist doctor capable of meeting community needs. This usually includes development of appropriate skills in primary care, inpatient care, emergency medicine, public health and one or more extended skills. These models are well established in Australia, particularly in Queensland, which has offered a rural generalist program for over a decade. The Rural Generalist Program Japan (RGPJ) has been developed to meet the needs of Japanese rural communities.

LESSONS LEARNED

This article outlines development of the RGPJ using the World Federation for Medical Education standards. While early evaluations are positive, there is much more to do to develop a mature program capable of meeting the needs of Japan's rural and remote communities.

To stay or go? Unpacking the decision-making process and coping strategies of International Medical Graduates practising in rural, remote, and regional Queensland, Australia

Australia is one of many countries to rely on International Medical Graduates (IMGs) to fill general practitioner (GP) positions throughout its regional, rural, and remote (RRR) communities. Current government initiatives requiring IMGs to work for specified periods in RRR areas offer only short-term solutions. The need to improve the long-term retention of IMGs practising in RRR areas has motivated this research to improve our understanding of how IMGs make decisions about where to practise. Specifically, this study sought to: (a) identify the factors that influence an IMG's decision to remain working in RRR areas, and (b) develop a theory, grounded in the data, to explain how these factors are prioritised, evaluated and used to inform a decision to remain working in RRR areas. This study adopted a qualitative approach and employed grounded theory methods. Data collection and analysis occurred concurrently, using constant, comparative analysis, guided by theoretical sampling and data saturation. Data sources were transcripts from semi-structured interviews with IMG registrars (n = 20) and supervisors (n = 5), interviewers' notes and analytic memos. Interviewees were all currently working in RRR areas of Queensland, Australia. The analysis involved a three-phase coding process, progressing from specific, inductive coding to abstract, abductive coding. The analysis revealed that the IMG decision-making process involves a complex, dynamic, and iterative process of balancing life goals based on life stage. Many factors are considered when assessing the balance of three main life goals: satisfaction with work, family, and lifestyle. The prioritisation and balance of these life goals can vary as the IMG moves through varying work-, family-, and age-related life stages. It is hoped that having this understanding of the complexity of the IMG decision-making process, will better equip medical educators, policy makers and support service providers to tailor services to encourage IMGs to continue practising in these regions.

Fellowship of the Australian College of Rural & Remote Medicine (FACRRM) Assessment: a review of the first 12 years

This article was migrated. The article was marked as recommended. This paper provides an overview of the first 12 years of the formal assessment program of the Australian College of Rural and Remote Medicine (ACRRM). The ACRRM Fellowship represents the world's first and only Fellowship exam in Rural Medicine. The ACRRM assessment program is mapped to its Rural Generalist curriculum, based on the principles of programmatic assessment. ACRRM offers candidates the opportunity to participate in assessment in or close to their home location. The ACRRM Rural Generalist Curriculum defines the scope and standards for independent general practice anywhere in Australia, with a focus on rural and remote settings. The program was initially developed in 2006 and has evolved during delivery from 2008 onwards, utilising the following modalities: •Multi Source Feedback (MSF)•Multiple Choice Questions (MCQ)•Mini Clinical Evaluation Exercise (Mini-CEX)•Case Based Discussion (CBD)•Procedural Skills Logbook•Structured Assessment using Multiple Patient Scenarios (StAMPS) StAMPS is a unique examination, blending the formats of an Objective Structured Clinical Examination and a traditional viva vocè. The program has an emphasis on formative assessment. Over the past 12 years there has been considerable work in developing resources for candidates, governance structures and quality assurance processes. ACRRM's Fellowship requirements represent a customised bespoke assessment tailored to ACRRM's curriculum and the Australian rural and remote context. ACRRM's assessment program has grown substantially with 649 Fellowships being awarded from 2008 - 2019, with considerable experience gained in rural and remote assessment. It now represents a mature firmly-established process as a vocational endpoint in Rural and Remote Medicine. ACRRM has continued to offer its 'tele-assessment' program throughout the COVID-19 pandemic, with candidates and examiners participating in assessment by use of distance technology while remaining in or near their home community. This model may provide some insights for other medical Colleges and educational institutions facing challenges in the current environment.

The impact of localised general practice training on Queensland's rural and remote general practice workforce

BACKGROUND

The diverse rural medical education initiatives that have been developed in Australia to address the medical workforce maldistribution have been less successful in many smaller and remote communities. This study explored the factors that attract and retain GP registrars and supervisors and the impact that localised training (i.e., rural and remote workplace-based training and support) has on both GP registrars and supervisors, and the GP workforce in rural and remote underserved areas.

METHODS

A purposive sample of 79 GP registrars, supervisors, practice managers, health services staff and community representatives living and working in areas of low GP workforce in rural and remote Australia were invited to participate in semi-structured interviews and one focus group divided over two phases. Thematic analysis was used to explore themes within the data.

FINDINGS

Attractors and barriers to rural and remote practice were identified as the main themes. Attractors include family and community lifestyle factors, individual intrinsic motivators, and remote medicine experiences. In contrast, barriers include work related, location, or family factors. Further, localised GP training was reported to specifically influence GP registrars and supervisors through education, social and financial factors.

CONCLUSION

The current study has provided a contemporary overview of the issues encountered in expanding GP training capacity in rural and remote communities to improve the alignment of training opportunities with community and workforce needs. Strategies including matching scope of practice to registrar interests have been implemented to promote the attractors and lessen the barriers associated with rural and remote practice.

Developing a general practice workforce for the future

BACKGROUND

Australia continues to develop as a multicultural nation, with a population that is ageing and developing complex health needs. The world around us is changing, and the pace of change is increasing. These contextual changes pose challenges for general practice training.

OBJECTIVE

This paper explores the potential impact of these changes on the general practice workforce.

DISCUSSION

General practitioners (GPs) will continue to have a central role in coordinating continuous, comprehensive care but are more likely to act as managers of multi-source, continuous monitoring data that facilitate personalised medical care. GPs will need to adapt rapidly to change, seizing opportunities offered by disruptive technology in a globalised world affected by climate change. The nature and impact of change is difficult to predict, and more research is needed to explore how change will affect healthcare and healthcare professionals. Ideally, training for general practice should include preparation for managing continuous change.

Perceived clinical relevance and retention of basic sciences across the medical education continuum

Medical programs are under pressure to maintain currency with scientific and technical advances, as well as prepare graduates for clinical work and a wide range of postgraduate careers. The value of the basic sciences in primary medical education was assessed by exploring the perceived clinical relevance and test performance trends among medical students, interns, residents, and experienced clinicians. A pilot study conducted in 2014 involved administration of a voluntary 60-item multiple-choice question test to 225 medical students and 4 interns. These participants and 26 teaching clinicians rated the items for clinical relevance. In 2016, a similarly constructed test (main study) was made a mandatory formative assessment, attempted by 563 students in years 2, 4, and 6 and by 120 commencing general practice residents. Test scores, performance trends, clinical relevance ratings, and correlations were assessed using relevant parametric and nonparametric tests. Rank order and pass-fail decisions were also reviewed. The mean test scores were 57% (SD 7.1) and 52% (SD 6.1) for the pilot and main studies, respectively. Highest scores were observed in pathology and social sciences. Overall performance increased with increasing year of study. Test scores were positively correlated with perceived relevance. There were moderate correlations (r = 0.50-0.63; P < 0.001) between participants' scores in the basic science and summative exams. Assessments may be key to fostering relevance and integration of the basic sciences. Benchmarking knowledge retention and result comparisons across topics are useful in program evaluation.

Design and Evaluation of a Professional Identity Development Program for Pharmacy Students

Objective. To design and evaluate a professional identity program (PIP) based on self-determination theory (SDT) for entering Bachelor of Pharmacy (BPharm) students. Methods. The PIP, which featured autonomy-supportive teaching approaches, was delivered as 10 workshops that were integrated into existing pharmacy courses over the first four semesters (2 years) of the BPharm program. The program was evaluated using a student satisfaction survey and two previously validated tools for measuring professional identity (MCPIS-9) and motivation to study pharmacy (Pharm-S). Nonparametric statistical techniques were used to compare students' scores before and after introducing the PIP. Results. Students responded positively to the introduction of the PIP in the pharmacy program. Based on survey responses, the students valued opportunities to engage in activities and discussions related to professional development and identity formation. Student scores on the motivation-based tool (Pharm-S) increased by the end of the first year of participation in the PIP, indicating an increase in student autonomy levels. There was no change in students' scores on the professional identity measure (MCPIS-9) after the first year. Conclusion. The use of SDT-based instruction in professional identity education resulted in increased levels of autonomy in pharmacy students, indicating a transition to more intrinsic levels of motivation. This has the potential to positively impact student professional identity and future professional practice.

Rural competencies in emerging medical practitioners: Beyond clinical skills

PROBLEM

Recruitment and retention of rural doctors remains a challenge in Australia. The Queensland Rural Generalist Program was developed to address this challenge and provides a range of tailored professional development opportunities to support rural medical training, recruitment and retention. The Rural Generalist Vocational Preparation Workshop was developed to maintain connection with trainees during a known attrition risk period and address a gap in training that focused on competencies required for rural practice.

DESIGN

The Rural Generalist Vocational Preparation Workshop, designed using adult learning principles, includes an optimal balance between theory, scenario-based learning and facilitated group discussions. A cross-sectional survey design was employed to evaluate the workshops delivered between 2015 and 2017.

SETTING

The workshops were attended by Queensland Rural Generalist Program trainees in the year prior to undertaking a vocational training position in a rural hospital or general practice. Participants were from 10 Hospital and Health Services in the Queensland public health sector at the time of attendance.

KEY MEASURES FOR IMPROVEMENT

An evaluation survey captured participant feedback about the workshop, its value, impact and their intention to implement changes in practice.

STRATEGIES FOR CHANGE

Fifty-one trainees attended the workshops across four locations.

EFFECTS OF CHANGE

Eight-eight per cent of participants reported intentions to implement changes to practice in: pursuit of career options and enhanced team work, leadership skills and networking.

LESSONS LEARNT

Evaluation results indicated that Rural Generalist Vocational Preparation Workshop was a highly valued opportunity. It provided future rural medical practitioners with professional support and networking opportunities, promoted identity formation and stimulated rural career planning.

Career choices of the first seven cohorts of JCU MBBS graduates: producing generalists for regional, rural and remote northern Australia

INTRODUCTION

Generalism in the health workforce has been established as an important strategy to address health workforce maldistribution. Thus, to best serve the medical needs of northern Australia, the James Cook University (JCU) College of Medicine and Dentistry has a mission to produce graduates who both practise in the region and have a generalist orientation. This study investigated the postgraduate qualifications and key factors that shaped the current career choice of JCU medical graduates, and whether JCU graduates are more likely to choose generalist careers than other Australian medical practitioners of a similar level of experience.

METHODS

JCU medical graduate data were obtained via cross-sectional survey of 298 early career JCU medical graduates from postgraduate year (PGY) 4 to PGY 10 (the first seven cohorts) who had consented to be contacted for further studies and were still contactable (n=180, response rate=60%). Australian medical graduate data were obtained via the National Health Workforce Dataset released by the Department of Health.

RESULTS

Compared to a group of Australian medical graduates with similar years of experience, JCU medical graduates are significantly more likely to choose careers as 'generalists' (general practitioners/rural generalists (p=0.044)) or 'generalist specialists' in general surgery (p=0.008), general paediatrics (p=0.008), obstetrics and gynaecology (p=0.038) and emergency medicine (borderline significance p=0.058). However, they are less likely to be 'specialist specialists' such as pathologists/radiologists (p=0.003) or a physician subspecialty (p=0.004). Key factors identified as influencing current career choice included 'interest developed or strengthened during undergraduate training', 'interest developed from early postgraduate career experiences', 'specialty has a good work-life balance', 'specialty involves continuity of care with patients', 'interest in rural practice', 'enjoy a wide scope of practice/being a generalist' and 'mentors'.

CONCLUSIONS

The JCU medical school produces significantly more graduates with a generalist rather than specialist career focus compared to a similarly experienced group of Australian medical practitioners. Contributing factors may include the JCU selection process, and the curricular focus on providing students with a wide range of generalist experiences and exposure to rural, remote, Indigenous and tropical health. Developing approaches that facilitate local vocational training and subsequent specialist practice is also an important part of the regional, rural and remote training pathway. Lastly, the findings suggest JCU medical graduates choose a career that is not only compatible with regional, rural or remote practice, but also involves continuity of care with patients, a wide scope of practice and a good work-life balance, and that this choice has been influenced by a combination of undergraduate and early career experiences. These findings are in line with international evidence and have implications for other jurisdictions planning an educational and workforce strategy to meet the needs of their own regional, rural and remote locations.

Why we need to teach leadership skills to medical students: a call to action

Health system reform models since the early 1990s have recommended leadership training for medical students, graduates and health workers. Clinicians often have leadership roles thrust on them early in their postgraduate career. Those who are not well trained in leadership and the knowledge that comes with leadership skills may struggle with the role, which can impact patient safety and create unhealthy working environments. While there is some literature published in this area, there appears to be little formal evaluation of the teaching of leadership, with scarcely any discussion about the need to do so in the future. There are clear gaps in the research evidence of how to teach and assess medical leadership teaching. In this paper, three leadership frameworks from Australia, Canada and the UK are compared in terms of leadership capabilities for a global view of medical leadership training opportunities. A literature review of the teaching, assessment and evaluation of leadership education in medical schools in Australia, the UK and America is also discussed and gaps are identified. This paper calls for an education shift to consider practical health system challenges, citing the mounting evidence that health system reform will require the teaching and rigorous evaluation of leadership methods. Opportunities for teaching leadership in the curricula are identified, as well as how to transform leadership education to include knowledge and practice so that students have leadership skills they can use from the time they graduate.

International approaches to rural generalist medicine: a scoping review

BACKGROUND

Contemporary approaches to rural generalist medicine training and models of care are developing internationally as part of an integrated response to common challenges faced by rural and remote health services and policymakers (addressing health inequities, workforce shortages, service sustainability concerns). The aim of this study was to review the literature relevant to rural generalist medicine.

METHODS

A scoping review was undertaken to answer the broad question 'What is documented on rural generalist medicine?' Literature from January 1988 to April 2017 was searched and, after final eligibility filtering (according to established inclusion and exclusion criteria), 102 articles in English language were included for final analysis.

RESULTS

Included papers were analysed and categorised by geographic region, study design and subject themes. The majority of articles (80%) came from Australia/New Zealand and North America, reflecting the relative maturity of programmes supporting rural generalist medicine in those countries. The most common publication type was descriptive opinion pieces (37%), highlighting both a need and an opportunity to undertake and publish more systematic research in this area. Important themes emerging from the review were: Definition Existing pathways and programmes Scope of practice and service models Enablers and barriers to recruitment and retention Reform recommendations There were some variations to, or criticisms of, the definition of rural generalist medicine as applied to this review, although this was only true of a small number of included articles. Across remaining themes, there were many similarities and consistent approaches to rural generalist medicine between countries, with some variations reflecting environmental context and programme maturity. This review identified recent literature from countries with emerging interest in rural generalist medicine in response to problematic rural health service delivery.

CONCLUSIONS

Supported, coordinated rural generalist medicine programmes are being established or developed in a number of countries as part of an integrated response to rural health and workforce concerns. Findings of this review highlight an opportunity to better share the development and evaluation of best practice models in rural generalist medicine.

Assessment for learning: a needs analysis study using formative assessment to evaluate the need for curriculum reform in basic sciences

A needs analysis study for curriculum reform in basic sciences was conducted at Melaka Manipal Medical College, India, by means of a formative assessment method, namely Basic Science Retention Examination (BSRE). Students participated in a BSRE, which comprised recall and clinical multiple-choice questions in six discipline areas. They also rated the clinical relevance of each question and provided responses to three open-text questions about the exam. Pass rates were determined; clinical relevance ratings and performance scores were compared between recall type and clinical questions to test students' level of clinical application of basic science knowledge. Text comments were thematically analyzed to identify recurring themes. Only one-third of students passed the BSRE (32.2%). Students performed better in recall questions compared with clinical questions in anatomy (51.0 vs. 40.2%), pathology (45.1 vs. 38.1%), pharmacology (41.8 vs. 31.7%), and biochemistry (43.5 vs. 26.9%). In physiology, students performed better in clinical questions compared with the recall type (56.2 vs. 45.8%). Students' response to BSRE was positive. The findings imply that transfer of basic science knowledge was poor, and that assessment methods should emphasize clinical application of basic science knowledge.

Producing a general practice workforce: Let's count what counts

BACKGROUND

Medical workforce problems still dominate headlines despite considerable investment in education, training and other initiatives. There is little consensus about what Australia's general practice workforce should look like or what training outcomes should be reported.

OBJECTIVE

The aim of this paper was to explore a number of issues relevant to outcomes of workforce programs and offer suggestions for identifying and overcoming these issues.

DISCUSSION

Social accountability literature highlights the importance of outcomes focusing on community needs. We suggest that evaluations should 'count what counts' and be careful what is counted. Numbers are only part of the story; not everything that counts is counted, and synergies and cooperation are key. Australia has many general practice workforce programs that are generally heading in the right direction. We believe that closer attention to appropriate outcome measures is important if we are to maximise return on investment and get the best outcomes for the community.

Work settings of the first seven cohorts of James Cook University Bachelor of Medicine, Bachelor of Surgery graduates: Meeting a social accountability mandate through contribution to the public sector and Indigenous health services

OBJECTIVE

The James Cook University medical school's mission is to produce a workforce appropriate for the health needs of northern Australia.

DESIGN, SETTING AND PARTICIPANTS

James Cook University medical graduate data were obtained via cross-sectional survey of 180 early-career James Cook University medical graduates from 2005-2011 (response rate of 180/298 contactable graduates = 60%). Australian medical practitioner data for 2005-2009 graduates were obtained via the 2015 'Medicine in Australia: Balancing Employment and Life' wave 8 dataset.

MAIN OUTCOME MEASURE

Comparison of the range of work settings and hours worked by James Cook University medical graduates to Australian medical graduates.

RESULTS

Compared to a similar group of Australian medical graduates, James Cook University Bachelor of Medicine, Bachelor of Surgery graduates are significantly more likely to work in government-funded 'public' organisations (hospitals, community health centres, Aboriginal Community Controlled Health Services, government departments, agencies or defence forces). In particular, James Cook University medical graduates were more likely to work in Aboriginal Community Controlled Health Services and community health centres and other state-run primary health care organisations than other Australian medical graduates.

CONCLUSION

James Cook University medical graduates appear to work in a higher proportion of public settings; in particular, primary care settings, than Australian medical graduates. This is an appropriate mix for the predominantly rural and remote geography of Queensland and its associated medical workforce priorities. Reporting medical graduate outcomes by their nature of practice could be an important adjunct to other measures, such as geographic location and choice of specialty.

Growth of the James Cook University Medical Program: Maintaining quality, continuing the vision, developing postgraduate pathways

BACKGROUND

James Cook University (JCU) enrolled its first cohort of 64 in 2000 into a 6-year undergraduate medical program aimed at producing graduates capable of meeting the needs of North Queensland, Australia, with a focus on rural, remote, Indigenous and tropical health. The school's 1465 graduates over 13 cohorts who have a pattern of practice likely to meet the region's health needs. The JCU course was the first new Australian medical program for 25 years. The number of Australian medical schools has since doubled, while enrollments have almost tripled.

METHODS

JCU's course features innovations such as dispersed, community-based education, rurally-focused selection, extended rural placements, and an emphasis on community needs - which are all now mainstream. This paper traces developments at JCU over the past decade, illustrating parallels with the broader Australian scene.

RESULTS

Maintaining quality and educational integrity while numbers grow is challenging. The course has undergone modest curriculum redesign, but the fundamental elements are intact. The focus on meeting the region's needs remains, with some evolution of its mission to include social accountability and the needs of underserved populations.

CONCLUSIONS

Postgraduate pathways are an important priority. Regional training hubs are being developed to support local pipelines into specialty practice. Queensland's Rural Generalist Pathway provides an incentivised pathway to rural practice while Generalist Medical Training provides a local training pipeline into general practice and rural medicine. As these initiatives mature, communities should benefit as JCU and other Australian programs continue to address local workforce needs.

Validation of a motivation survey tool for pharmacy students: Exploring a link to professional identity development

INTRODUCTION

Self-determination theory (SDT), which describes a continuum of motivation regulators, is proposed as an appropriate framework to study pharmacy student motivation. The aim was to develop a Pharmacy Motivation Scale (Pharm-S) to determine motivation regulators in undergraduate students and explore a possible link to professional identity development.

METHODS

The Pharm-S was adapted from the SDT-based, Sports Motivation Scale (SMS-II), and administered to undergraduate students in an Australian pharmacy course. Convergent validity was assessed by conducting a correlation analysis between the Pharm-S and MacLeod Clark Professional Identity Scale (MCPIS-9).

RESULTS

Face, content and construct validity were established for the Pharm-S through the analysis of 327 survey responses. Factor analysis extracted four of the six theoretical subscales as proposed by SDT (variance explained: 65.7%). Support for the SDT structure was confirmed by high factor loadings in each of the subscales and acceptable reliability coefficients. Subscale correlations revealed a simplex pattern, supporting the presence of a motivation continuum, as described by SDT. A moderate positive correlation (0.64) between Pharm-S responses and the validated professional identity instrument, MCPIS-9, indicated a possible link between levels of motivation and professional identity.

DISCUSSION

and conclusions: Content and structural validity and internal consistency of the Pharm-S confirmed the reliability of the Pharm-S as a valid tool to assess motivational regulators. Pharm-S and the MCPIS-9 were positively correlated, lending support to a link between motivation and professional identity. This suggests a potential role for the Pharm-S as a valid tool to measure pharmacy student professional identity development.