1253 Unlocking Growth Options in Surgical Education and Training During the Pandemic

Introduction

The COVID-19 pandemic brought widespread disruption to structured surgical education and training. The knee-jerk reaction is often pessimism about surgical training’s future, particularly in the Improved Surgical Training (IST) pilot’s context. However, Einstein famously once said, “In the midst of every crises lies great opportunity”. Unlocking growth during periods of high uncertainty is a premise of real options theory; one utilised by supply chain managers and decision scientists, but novel to medical education. This study explores the growth options that have resulted from new operational models during the pandemic.

Method

Using a qualitative case study approach, data were obtained from interviews with core surgical trainees across Scotland. Data coding and inductive thematic analysis were undertaken.

Results

Forty-six trainees participated. Analysis from trainees’ perspective revealed: unexpected fulfilment from redeployment to non-surgical specialties, benefits to personal development from the unintended broad-based training across surgical specialties, improved collaborative teamworking between specialties and allied healthcare professionals, and enhanced supervised learning opportunities. Institutional growth options reported by trainees included: rapid uptake of telemedicine and digital technology, implementation of single hospital episode encounters for minor conditions, streamlined processes in theatre and acute admissions, and changes in working culture towards rationalising and teamworking.

Conclusions

Growth options have been deliberately and unintentionally unlocked due to individual and institutional adaptions and innovations in response to the exogenous disruption. While some changes may be temporary, hopefully structured reflection on these changes and responders to them will drive surgical education and training into a new sustainable and resilient post-pandemic era.

51 The Impact of Disability on Performance in the Intercollegiate Membership of the Royal College of Surgeons examination (MRCS)

Aim

The number of clinicians with disabilities is increasing, however there is no data on the performance of doctors with registered disabilities in the postgraduate environment. If we are to ensure diversity and equality within the workforce, we must first identify whether attainment differences exist in markers of performance. To address this, we assessed the impact of disabilities on performance in the MRCS.

Method

All UK medical graduates who had attempted MRCS Part A (n = 9,597) and Part B (n = 4,562) between 2007-2017 with linked disability data in the UK Medical Education Database (https://www.ukmed.ac.uk) were included. Univariate analysis identified associations with MRCS performance and logistic regression models identified independent predictors of success.

Results

Candidates with registered disabilities (n = 635) had lower MRCS Part A pass rates (46.3% vs 59.8% (p < 0.001)) but similar Part B pass rates (68.2% vs 70.9% (p = 0.339)). They were nearly twice as likely to fail Part A (odds ratio 0.55 [95% Confidence Interval 0.46-0.64]). When prior academic attainment (A-Levels and medical school performance) was accounted for, there was no statistically significant difference in the likelihood of MRCS success (p>0.05). Pass rates were similar for candidates with specific learning difficulties and those with other registered disabilities (p>0.05).

Conclusions

This is the first study to assess the impact of disability status and type on performance at a postgraduate medical examination. It appears that candidates with registered disabilities performed less well in formal, written examinations generally. Although our data indicate that current MRCS testing accommodations are fair, enabling performance unrestricted by disability.

Anomalous diffusion driven by the redistribution of internal stresses

This article explores the mathematical description of anomalous diffusion, driven not by thermal fluctuations but by internal stresses. A continuous time random walk framework is outlined in which the waiting times between displacements (jumps), generated by the dynamics of internal stresses, are described by the generalized Γ distribution. The associated generalized diffusion equation is then identified. The solution to this equation is obtained as an integral over an infinite series of Fox H functions. The probability density function is identified as initially non-Gaussian, while at longer timescales Gaussianity is recovered. Likewise, the second moment displays a transient nature, shifting between subdiffusive and diffusive character. The potential application of this mathematical description to the quaking observed in several soft-matter systems is discussed briefly.

The impact of disability on performance in a high-stakes postgraduate surgical examination: a retrospective cohort study

OBJECTIVE

Despite rising numbers of doctors in the workforce with disabilities, little is known about the impact of disabilities on postgraduate performance. To ensure all groups are treated fairly in surgical training, it is essential to know whether any attainment differences exist in markers of surgical performance. To address this gap, we assessed the impact of disabilities on performance on the Intercollegiate Membership of the Royal College of Surgeons examination (MRCS).

DESIGN

Retrospective cohort study.

SETTING

Secondary care.

PARTICIPANTS

All UK MRCS candidates attempting Part A (n = 9600) and Part B (n = 4560) between 2007 and 2017 with linked disability data in the UK Medical Education Database (https://www.ukmed.ac.uk) were included.

MAIN OUTCOME MEASURES

Chi-square tests and correlation coefficients established univariate associations with MRCS performance, while multiple logistic regressions identified independent predictors of success.

RESULTS

Though MRCS Part B pass rates were similar (p = 0.339), candidates with registered disabilities had significantly lower first-attempt Part A pass rates (46.3% vs. 59.8%, p < 0.001). Candidates with disabilities also performed less well in examinations taken throughout school and medical school, and after adjusting for prior academic performance and sociodemographic predictors of success, logistic regression found that candidates with disabilities were no less likely to pass MRCS than their peers (odds ratio 1.04, 95% confidence interval 0.66 to 1.62). No significant variation was found in MRCS performance between type of disability or degree of limitations caused by disability (p > 0.05).

CONCLUSION

Although candidates with registered disabilities performed less well in formal, written examinations, our data indicate that they are as likely to pass MRCS at first attempt as their peers who achieved similar grades at high school and medical school. In order to enable equity in career progression, further work is needed to investigate the causes of attainment differences in early career assessments.

The Dorsal Differentiation of Velar From Alveolar Stops in Typically Developing Children and Children With Persistent Velar Fronting

Purpose This study has two key aims: first, to provide developmental articulatory norms for the alveolar-velar distinction in 30 English-speaking typically developing (TD) children; second, to illustrate the utility of the reported measures for classifying and quantifying the speech of children with a history of persistent velar fronting as they develop the contrast longitudinally. Method This study involved secondary data analysis of the UltraSuite corpus comprising ultrasound tongue imaging recordings of speech materials from 30 typical children and longitudinal data from five children with persistent velar fronting undergoing ultrasound visual biofeedback intervention. We present two new measures of coronal dorsal differentiation: KTMax and KT crescent area. These measures distinguish /k/ and /t/ by quantifying the magnitude of this distinction in absolute spatial terms (mm of linear dorsal difference). For the typical children, we report these measures in corner vowel contexts. We then compare these to dorsal productions by the children with speech disorders, before, during, and after intervention. Results Both measures reliably distinguished /k/ and /t/ in TD children. There was an effect of vowel, with larger KTmax and KT crescent area in /a/ and /o/ vowel contexts than in an /i/ context. The children with persistent velar fronting showed KTmax values near zero before intervention, showing a complete merger between /k/ and /t/. During intervention, they showed variable KTmax values. Post intervention, they showed values within the range of typical children. Conclusions This study provides articulatory norms derived from ultrasound tongue imaging for the dorsal differentiation in alveolar and velar stops in TD children. By applying these norms to children with persistent velar fronting as they acquire this contrast, we see that /k/ is acquired in an articulatorily gradient manner.

A cross-sectional study examining the association between MRCS performance and surgeons receiving sanctions against their medical registration

BACKGROUND

Fitness to practice (FtP) investigations by the General Medical Council (GMC) safeguard patients and maintain the integrity of the medical profession. The likelihood of FtP sanctions is influenced by specialty and socio-demographic factors and can be predicted by performance at postgraduate examinations. This is the first study to characterise the prevalence of FtP sanctions in early-career surgeons and to examine the association with performance at the Membership of the Royal College of Surgeons (MRCS) examination.

METHODS

All UK graduates who attempted MRCS between September 2007-January 2020 were matched to the GMC list of registered medical practitioners. Clinicians who had active FtP sanctions between 28th August 2018 and 28th August 2020 were identified. Data were anonymised by RCS England prior to analysis.

RESULTS

Of 11,660 candidates who attempted MRCS within the study period, only 31 (0.3%) had FtP sanctions between 2018 and 2020. Of these, 12 had active conditions on registration, seven had undertakings and 14 had warnings. There was no statistically significant difference in MRCS performance in either Parts A or B of the examination for those with and those free from FtP sanctions (P > 0.05).

CONCLUSIONS

In this, the largest study of MRCS candidates to date, the prevalence of active FtP sanctions in early-career surgeons was 0.3%, significantly lower than the prevalence of sanctions across more experienced UK surgeons (0.9%). These data highlight early-career surgeons as a low-risk group for disciplinary action and should reassure patients and medical professionals of the rarity of FtP sanctions.

Lee, D. Scrimgeour. 221 UK Medical School Selection Criteria Predicts Success in Part A of The Intercollegiate Membership of The Royal College of Surgeons (MRCS) Examination

Background

Selection into UK medical school typically involves a combination of three measures: prior academic attainment, selection tests (e.g., the University Clinical Aptitude Test (UCAT), Biomedical Admissions Test (BMAT), Graduate Medical School Admissions Test (GAMSAT)), and an interview. We investigated whether prior attainment and selection test scores can predict MRCS success.

Method

We used the UKMED database to analyse selection data for all UK graduates who attempted MRCS Part A (n = 9729) and Part B (n = 4644) between 2007-2017. Univariate analysis and Pearson correlation coefficients were used to examine the relationship between selection scores and first attempt MRCS success.

Results

Successful MRCS Part A candidates had better A-Levels and higher scores in UCAT, BMAT and GAMSAT examinations (p &lt; 0.001) than their unsuccessful peers. No statistically significant difference was observed for MRCS Part B. A moderate positive correlation was found between Part A, BMAT (r = 0.315, p &lt; 0.001) and GAMSAT scores (r = 0.346, p &lt; 0.001). A weak positive correlation was found between Part A, A-Level (r = 0.144, p &lt; 0.001) and UCAT scores (r = 0.246, p &lt; 0.001).

Conclusions

A-level results and medical school selection tests predict success in the knowledge-based (Part A) MRCS examination.

191 Performance at Medical School and Foundation Programme Selection Can Predict Success in The MRCS Examination

Background

Identifying factors that predict success in the Membership of the Royal College of Surgeons (MRCS) examination can aid trainees’ exam preparation and help deaneries identify candidates likely to require additional support. We assessed whether performance at Medical School and UK Foundation Programme selection (Educational Performance Measurement (EPM) and Situational Judgement Test (SJT)) predicted MRCS success.

Method

We analysed data from the UKMED Database for UK graduates who had attempted MRCS Part A (n = 1,975) and Part B (n = 630) between 2013-2017. Univariate analysis examined the relationship between performance and the likelihood of passing MRCS at first attempt. Logistic regression identified independent predictors of MRCS success.

Results

Each additional EPM decile increased the chances of passing MRCS by 52% for Part A (odds ratio 1.52 [95% confidence interval 1.46-1.60]) and 27% for Part B (1.27 [1.18-1.38]). Each EPM point awarded for degrees increased the likelihood of passing Part A by 29% (1.29 [1.12-1.48]). SJT score was not a statistically significant independent predictor of MRCS success (P&gt;0.05).

Conclusions

This is the first study to investigate the relationship between UK medical school performance and postgraduate surgical exam success. Higher ranked students are more likely to succeed in the MRCS compared to their lower ranked peers.

220 Choice of UK Medical School Predicts Success in The Intercollegiate Membership of The Royal College of Surgeons (MRCS) Examination

Background

UK medical schools vary in terms of factors such as mission, specific curricula and pedagogy. As relatively little is understood about the impact of these differences at a post-graduate level, we examined the relationship between medical school and MRCS success.

Method

Using the UKMED database we analysed data on UK medical graduates who attempted MRCS Part A (n = 9729) and MRCS Part B (n = 4644) between 2007-2017. Univariate analysis characterised the relationship between medical school and first attempt MRCS success. Logistic regression modelling identified independent predictors of MRCS success.

Results

MRCS pass rates differed significantly between medical schools (P &lt; 0.001). Trainees from standard-entry 5-year programmes were more likely to pass MRCS at first attempt compared to those from extended (Gateway) courses ((Part A (Odds Ratio (OR) 3.72 [95% Confidence Interval (CI) 2.69-5.15]); Part B (OR 1.67 [1.02-2.76])). Non-graduates were more likely to pass Part A (OR 1.40 [1.19-1.64]) and Part B (OR 1.66 [1.24-2.24]). Russell Group graduates were more likely to pass MRCS Part A (OR 1.79 [1.56-2.05]) and Part B (OR 1.24 [1.03-1.49])).

Conclusions

Medical programme and medical school are associated with MRCS success. Further research is needed to tease out the relationship between individual factors, medical school and MRCS performance.

Temporal trends in heart failure medication prescription in a population-based cohort study

OBJECTIVE

We examined temporal heart failure (HF) prescription patterns in a large representative sample of real-world patients in the UK, using electronic health records (EHR).

METHODS

From primary and secondary care EHR, we identified 85 732 patients with a HF diagnosis between 2002 and 2015. Almost 50% of patients with HF were women and the median age was 79.1 (IQR 70.2-85.7) years, with age at diagnosis increasing over time.

RESULTS

We found several trends in pharmacological HF management, including increased beta blocker prescriptions over time (29% in 2002-2005 and 54% in 2013-2015), which was not observed for mineralocorticoid receptor-antagonists (MR-antagonists) (18% in 2002-2005 and 18% in 2013-2015); higher prescription rates of loop diuretics in women and elderly patients together with lower prescription rates of angiotensin-converting enzyme inhibitors and/or angiotensin II receptor blockers, beta blockers or MR-antagonists in these patients; little change in medication prescription rates occurred after 6 months of HF diagnosis and, finally, patients hospitalised for HF who had no recorded follow-up in primary care had considerably lower prescription rates compared with patients with a HF diagnosis in primary care with or without HF hospitalisation.

CONCLUSION

In the general population, the use of MR-antagonists for HF remained low and did not change throughout 13 years of follow-up. For most patients, few changes were seen in pharmacological management of HF in the 6 months following diagnosis.

Protocol for an implementation study of an evidence-based home cardiac rehabilitation programme for people with heart failure and their caregivers in Scotland (SCOT:REACH-HF)

INTRODUCTION

Despite evidence that cardiac rehabilitation (CR) is an essential component of care for people with heart failure, uptake is low. A centre-based format is a known barrier, suggesting that home-based programmes might improve accessibility. The aim of SCOT: Rehabilitation EnAblement in CHronic Heart Failure (REACH-HF) is to assess the implementation of the REACH-HF home-based CR intervention in the context of the National Health Service (NHS) in Scotland.This paper presents the design and protocol for this observational implementation study. Specific objectives of SCOT:REACH-HF are to: (1) assess service-level facilitators and barriers to the implementation of REACH-HF; (2) compare real-world patient and caregiver outcomes to those seen in a prior clinical trial; and (3) estimate the economic (health and social) impact of implementing REACH-HF in Scotland.

METHODS AND ANALYSIS

The REACH-HF intervention will be delivered in partnership with four 'Beacon sites' across six NHS Scotland Health Boards, covering rural and urban areas. Health professionals from each site will be trained to facilitate delivery of the 12-week programme to 140 people with heart failure and their caregivers. Patient and caregiver outcomes will be assessed at baseline and 4-month follow-up. Assessments include the Minnesota Living with Heart Failure Questionnaire (MLHFQ), five-dimension EuroQol 5L, Hospital Anxiety and Depression Scale, and the Caregiver Burden Questionnaire. Qualitative interviews will be conducted with up to 20 health professionals involved in programme delivery (eg, cardiac nurses, physiotherapists). 65 facilitator-patient consultations will be audio recorded and assessed for fidelity. Integrative analysis will address key research questions on fidelity, context and CR participant-related outcomes. The SCOT:REACH-HF findings will inform the future potential roll-out of REACH-HF in Scotland.

ETHICS AND DISSEMINATION

The study has been given ethical approval by the West of Scotland Research Ethics Service (reference 20/WS/0038, approved 25 March 2020). Written informed consent will be obtained from all participants. The study is listed on the ISRCTN registry with study ID ISRCTN53784122. The research team will ensure that the study is conducted in accordance with both General Data Protection Regulations and the University of Glasgow's Research Governance Framework. Findings will be reported to the funder and shared with Beacon Sites, to facilitate service evaluation, planning and good practice. To broaden interest in, and understanding of REACH-HF, we will seek to publish in peer-reviewed scientific journals and present at stakeholder events, national and international conferences.

Exploring shared surgical decision-making from the patient's perspective: is the personality of the surgeon important?

AIM

The aim was to determine the importance of a colorectal surgeon's personality to patients and its influence on their decision-making.

METHODS

We present a two-part mixed methods study using the Guidance for Reporting Involvement of Patients and the Public (GRIPP-2) long form. Part 1 was an online survey (25 questions) and Part 2 a face-to-face patient and public involvement exercise. Part 1 included patient demographics, details of surgery, overall patient satisfaction (net promoter score) and patient views on surgeon personality (Gosling 10 Item Personality Index). The thematic analysis of free-text responses generated four themes that were taken forward to Part 2. These themes were used to structure focus group discussions on surgeon-patient interactions.

RESULTS

Part 1 yielded 296 responses: 72% women, 75.3% UK-based and 55.1% aged 40-59 years. Inflammatory bowel disease (45.3%) and cancer (40.2%) were the main indications. 84.1% of respondents reported satisfaction with their surgical experience (net promoter score). Four key themes were generated from Part 1 and validated in Part 2: (i) surgeon personality stereotypes (media differed from patients' perspective); (ii) favourable and unfavourable surgical personality traits (openness, conscientiousness, emotional stability preferred over risk-taking and narcissism); (iii) patient-surgeon interaction (mutual respect and rapport valued); (iv) impact of surgeon personality on decision-making (majority unaware of second opinion option; management of postoperative complications).

CONCLUSION

Patients believe surgeon personality influences shared decision-making. Low levels of emotional stability and conscientiousness are perceived by patients to increase the likelihood of postoperative adverse events. Further work is required to explore the potential influence of surgeon personality on shared decision-making and postoperative outcomes.

Technology-supported home monitoring in heart failure patients

Background

Digital health promises to enhance the prevailing episodic models of chronic heart failure (HF) care.

Purpose

We aimed to test the hypothesis that digital home monitoring with centralised specialist support for remote management of HF and major vascular comorbidities is more effective in optimising medical therapy and improving patients' quality of life than digital home monitoring alone.

Methods and results

In a two-armed partially blinded parallel randomised controlled trial, seven sites in the United Kingdom recruited a total of 202 adults with HF (71.3 years SD 11.1; mean left ventricular ejection fraction 32.9% SD 15.4). Participants were selected for being at high risk of adverse outcomes or high potential to benefit from remote management. Participants in both study arms were given an internet-enabled tablet computer, Bluetooth-enabled blood pressure monitor and weighing scales for health monitoring. After a run-in period, participants randomized to intervention received additional regular feedback to support self-management and their primary care doctors received instructions on blood investigations and pharmacological treatment. The primary outcome was the use of recommended medical therapy, for chronic HF and major comorbidities, measured as a composite opportunity score. Co-primary outcome was change in physical score of Minnesota Living with Heart failure questionnaire.

At the end of the trial, the weighted opportunity score was 0.54 (CI 95% 0.46, 0.62) in the control group and 0.61 (CI 95% 0.52, 0.70) in the intervention arm (p for mean difference=0.25). Physical well-being of participants did not differ significantly between the groups either (p=0.55).

Conclusions

Central provision of tailored specialist management in a multimorbid HF population was feasible. However, there was no strong evidence for improvement in use of evidence-based therapies nor health-related quality of life.

Figure 1

Funding Acknowledgement

Type of funding source: Public Institution(s). Main funding source(s): National Institute for Health Research (NIHR) Health Services Research and Delivery; NIHR Career Development Fellowship

A comparison of machine learning models for predicting rehospitalisation and death after a first hospitalisation with heart failure

Background

Many machine learning models exist, including Multilayer Perceptron (MLP), Random Forest algorithm (RF), Support Vector Machine (SVM), and Gradient Boosted Machine (GBM), but their value for predicting outcome in patients with heart failure has not been compared.

Aim

To predict rehospitalisation (all-cause) and death (all-cause) at 1-, 3- and 12 months after discharge from a first hospitalisation for heart failure using four machine learning models.

Methods

The National Health Service Greater Glasgow and Clyde Health Board serves a population of ∼1.1 million. We obtained de-identified administrative data, including investigations, diagnosis and prescriptions, linked to hospital admissions and deaths for anyone with a diagnosis of vascular disease or heart failure or prescribed loop diuretics, statins or neuro-endocrine antagonists at any time between 1st January 2010 and 1st June 2018. Patients who were under 18 or had no prior hospitalisation for heart failure were excluded. Four ML algorithms using 46 variables were applied.

Results

Of 360,000 people who met the above criteria between 2010–2018, 6,372 had a hospitalisation for heart failure prior to 1st January 2010 and 8,304 had a first hospitalisation for heart failure thereafter. Between 2010 and 2018 there were 3,086 re-hospitalisations over 24 hours and 3,706 patients died, with 5,070 patients experiencing the composite outcome.

GBM and RF consistently outperformed MLP and SVM when comparing AUC, sensitivity and specificity combined, with GBM performing best in all scenarios. Since GBM and RF are both tree-based models, and with SVM and MLP regularly reporting very poor sensitivity or specificity despite a similar AUC to the others, this suggests that SVM and MLP may be suffering from overfitting and might perform better in larger data-sets.

Both GBM and RF work by ordering variables, so the final model can be used to determine the most important prediction variables. Age, number of times a blood sample was taken out of hospital, length of stay, social deprivation index and haemoglobin concentration consistently ranked amongst the most important variables. Models predicted all 1-month events better than later events.

Conclusions

Some, but not all, ML models applied to this data-set predicted rehospitalisation and death with great accuracy for up to 3 months after a first hospitalisation for heart failure. The models identified several important prognostic variables that are currently seldom collected in clinical research registries but perhaps should be.

Funding Acknowledgement

Type of funding source: Public grant(s) – National budget only. Main funding source(s): Medical Research Council

Use of social media by health care professionals: is patients' privacy respected?

Background

The internet has a key role in sharing and expanding medical knowledge. Social networks offer health-care professionals the possibility to communicate, debate and learn from each other in real-time, thereby improving access to expertise and creating new knowledge. On Facebook, there are many groups that health-care professionals can join to discuss clinical cases. However, it is unknown if patient-privacy is respected and whether users are aware that they might be inadvertently involved in a criminal act for which they might be sued.

Methods

We identified the most popular Facebook group for cardiologists, “ECHO BOARD REVIEW forum” that has more than 47,000 users. We retrospectively evaluated all content posted by this group between February 6th and February 14th 2020. Information about the type of data posted, personal patient details, geographic location reported on images or videos, number of reactions and comments was collected. Privacy was considered fully violated when name and/or surname of the patient was identifiable. A comparison between the two cases (privacy preserved vs. privacy violated) was performed.

Results

Of 53 posts evaluated, 50 (94%) were echocardiograms; the remaining three cases were of an electrocardiogram, a cardiac magnetic resonance video and a coronary angiogram. The patient's identity was revealed in seven cases (13%). Compared to cases where identity was concealed, those revealing the patient's identify were more likely to report other important personal details including date of birth (n=0 (0%) vs 2 (29%)), age (n=14 (30%) vs 5 (71%)) and sex (n=15 (33%) vs 6 (86%)). The country (n=46, 87%), city (n=39, 74%), and hospital (n=34, 64%) where the cases were being evaluated were also frequently disclosed. Most cases were from Asia (n=23, 43%) or Africa (n=17, 32%). Of the 7 cases in which privacy was fully violated, 43% were from Africa, 27% were from South America and 14% were from Asia. In the majority of cases, the author of the post was seeking diagnostic help (n=33), less frequently a diagnosis was already made by the author (n=17). The median (interquartile range) number of comments/post was 12 (5–23), and of likes/post was 21 (12- 37), with no significant difference between cases in which privacy was violated or not.

Conclusion

Social media allows knowledge and expertise to be shared amongst health care professionals, but, alarmingly, violation of patient-confidentiality is common. In order to maintain patient-confidentiality and avoid breaking the law, strict rules should be applied to regulate the use of social media by health-care professionals.

Funding Acknowledgement

Type of funding source: None

Prediction of success at UK Specialty Board Examinations using the mandatory postgraduate UK surgical examination

Background

While performance in other mandatory examinations taken at the beginning of a doctor's career are predictive of final training outcomes, the influence early postgraduate surgical examinations might have on success at Specialty Board Exams in the UK is currently unknown. The aim was to investigate whether performance at the mandatory Membership of the Royal College of Surgeons (MRCS) examination, and other variables, are predictive of success at the Fellowship of the Royal College of Surgeons (FRCS) examination, thus potentially identifying those who may benefit from early academic intervention.

Methods

Pearson correlation coefficients examined the linear relationship between both examinations and logistic regression analysis identified potential independent predictors of FRCS success. All UK medical graduates who attempted either section of FRCS (Sections 1 and 2) between 2012 and 2018 were included.

Results

First attempt pass rates for Sections 1 and 2 FRCS were 87.4 per cent (n = 854) and 91.8 per cent (n = 797) respectively. In logistic regression analysis, sex (male: odds ratio (OR) 2.32, 95 per cent c.i 1.43 to 3.76), age (less than 29 years at graduation: OR 3.22, 1.88 to 5.51), Part B MRCS attempts (1 attempt: OR 1.77, 1.08 to 3.00), Part A score (OR 1.14, 1.09 to 1.89) and Part B score (OR 1.06, 1.03 to 1.09) were independent predictors of Section 1 FRCS success. Predictors of Section 2 FRCS success were age (less than 29 years at graduation: OR 3.55, 2.00 to 6.39), Part A score (OR 1.06, 1.02 to 1.11) and Section 1 FRCS score (OR 1.13, 1.07 to 1.18).

Conclusion

Part A and B MRCS performance were independent predictors of FRCS success, providing further evidence to support the predictive validity of this mandatory postgraduate exam. However, future research must explore the reasons between the attainment gaps observed for different groups of doctors.

Systematic review of ultrasound visual biofeedback in intervention for speech sound disorders

BACKGROUND

As cost and access barriers to ultrasound technology have decreased, interest in using ultrasound visual biofeedback (U-VBF) as a tool for remediating speech sound disorders (SSD) has increased. A growing body of research has investigated U-VBF in intervention for developmental SSD; however, diversity in study design, participant characteristics, clinical methods and outcomes complicate the interpretation of this literature. Thus, there is a need for a synthesis and review of the evidence base for using U-VBF in intervention for SSD.

AIMS

To synthesise and evaluate the research evidence for U-VBF in intervention for developmental SSD.

METHODS

A systematic review was conducted. Eight electronic databases were searched for peer-reviewed articles published before 2018. Details about study design, participants, intervention procedures, service delivery, intervention intensity and outcomes were extracted from each study that met the inclusion criteria. The included studies were rated using both a critical appraisal tool and for their reporting of intervention detail.

MAIN CONTRIBUTIONS

Twenty-eight papers, comprising 29 studies, met the inclusion criteria. The most common research design was single-case experimental design (44.8% of studies). The studies included between one and 13 participants (mean = 4.1) who had a mean age of approximately 11 years (range = 4;0-27 years). Within the research evidence, U-VBF intervention was typically provided as part of, or as an adjunct to, other articulatory-based therapy approaches. A range of lingual sounds were targeted in intervention, with 80.6% of participants across all reviewed studies receiving intervention targeting rhotics. Outcomes following therapy were generally positive with the majority of studies reporting that U-VBF facilitated acquisition of targets, with effect sizes ranging from no effect to a large effect. Difficulties with generalisation were observed for some participants. Most studies (79.3%) were categorised as efficacy rather than effectiveness studies and represented lower levels of evidence. Overall, the reviewed studies scored more highly on measures of external validity than internal validity.

CONCLUSIONS

The evidence base for U-VBF is developing; however, most studies used small sample sizes and lower strength designs. Current evidence indicates that U-VBF may be an effective adjunct to intervention for some individuals whose speech errors persist despite previous intervention. The results of this systematic review underscore the need for more high-quality and large-scale research exploring the use of this intervention in both controlled and community contexts.

The Impact of Real-Time Articulatory Information on Phonetic Transcription: Ultrasound-Aided Transcription in Cleft Lip and Palate Speech

OBJECTIVE

This study investigated whether adding an additional modality, namely ultrasound tongue imaging (UTI), to perception-based phonetic transcription impacted on the identification of compensatory articulations and on interrater reliability.

PATIENTS AND METHODS

Thirty-nine English-speaking children aged 3-12 years with cleft lip and palate (CLP) were recorded producing repetitions of /aCa/ for all places of articulation with simultaneous audio recording and probe-stabilized ultrasound (US). Three types of transcriptions were performed: (1) descriptive observations from the live US by the clinician recording the data, (2) US-aided transcription (UA) by two US-trained clinicians, and (3) traditional phonetic transcription by two CLP specialists from audio recording. We compared the number of consonants identified as in error by each transcriber and then classified errors into eight different subcategories.

RESULTS

Both UA and traditional transcription yielded similar error detection rates; however, these were significantly higher than the observations recorded live in the clinic. Interrater reliability for the US transcribers was substantial (κ = 0.65) compared to moderate (κ = 0.47) for the traditional transcribers. US transcribers were more likely to identify covert errors such as double articulations and retroflexion than the audio-only transcribers.

CONCLUSION

UTI is a useful complement to traditional phonetic transcription for CLP speech.

AMEE Guide No. 123 - How to read studies of educational costs

Healthcare and health professions education share many of the same problems in decision making. In both cases, there is a finite amount of resources, and so choices need to be made between alternatives. To navigate the options available requires effective decision making. Choosing one option requires consideration of its opportunity cost - the benefit forgone of the other competing options. The purpose of this abridged AMEE guide is to introduce educational decision-makers to the economic concept of cost, and how to read studies about educational costs to inform effective cost-conscious decision-making. This guide leads with a brief review of study designs commonly utilized in this field of research, followed by an overview of how study findings are commonly presented. The tutorial will then offer a four-step model for appraising and considering the results of an economic evaluation. It asks the questions: (1) Can I trust the results? (2) What are the results telling me? (3) Could the results be transferred to my context? (4) Should I change my practice?

The effects of human factor related issues on assessors during the recruitment process for general and vascular surgery in the UK

INTRODUCTION

Healthcare professionals increasingly recognise how human factors (HF) can contribute to medical error. An understanding of HF is also important during other high stakes activities such as summative assessments or examinations. National organisations hosting such events need to be aware of potential fatigue, boredom and stress that can occur in interviewers during these often repetitive activities.

METHODS

A previously validated questionnaire based around the well known HF analysis and classification system (HFACS) was used to evaluate four factors (care and support, asking questions about the role as an interviewer, working within the rules and boundaries, and stress and pressure) at the 2018 UK general and vascular surgery trainee national selection process.

RESULTS

A total of 92 questionnaires were completed and analysed (48% response rate). After recoding for negative phrased questions, no significant differences were found between years of experience in the selection process and mean scores obtained for all four factor items. Interviewers had a positive experience during national selection with mean factor scores ranging from 3.84 to 3.98 (out of a maximum satisfaction score of 5).

CONCLUSIONS

Organisations need to plan carefully and recognise the human element to ensure that their interviewers are cared for during any high stakes assessment such as national selection. Our work suggests that a positive assessor experience will further help contribute to a reliable and fair recruitment process.

The effectiveness of superficial versus deep dry needling or acupuncture for reducing pain and disability in individuals with spine-related painful conditions: a systematic review with meta-analysis

Objective: The purpose of this systematic review was to evaluate the effects of deep versus superficial dry needling or acupuncture on pain and disability for spine-related painful conditions. A secondary purpose was to account for the differences of needling location in relation to the painful area. Methods: This PROSPERO (#CRD42018106237) registered review found 691 titles through a multi-database search. Following a comprehensive search, 12 manuscripts were included in the systematic review and 10 in the meta-analysis. Standardized mean differences (SMD) with 95% confidence intervals were calculated for pain and disability. Results: The included studies demonstrated an unclear to high risk of bias recommending a cautious interpretation of the results. A consistent effect supporting deep needling over superficial with an SMD of 0.585 [0.335, 0.835], p < 0.001 from 10 articles for pain but a non-significant effect of 0.197 [-0.066, 0.461], p = 0.14 from 2 studies for disability. A temporal examination was similar for effects on pain with an SMD of 0.450 [0.104, 0.796] immediately, 0.711 [0.375, 1.048] short-term (1 to 11 weeks), and 0.470 [0.135, 0.805] for time-points ≥12 weeks. Regionally, there was a greater effect needling the area of pain locally (SMD = 0.754) compared to remotely (SMD = 0.501). Discussion: Statistically significant between-group differences were observed favoring deep needling over superficial. Both superficial and deep needling resulted in clinically meaningful changes in pain scores over time. However, differences between groups may not be clinically meaningful. More high-quality trials are needed to better estimate the effect size of deep versus superficial needling while controlling for location and depth of the lesion. Level of evidence: 1a.

Use of electropalatography in the treatment of speech disorders in children with Down syndrome: a randomized controlled trial

BACKGROUND

Electropalatography (EPG) records details of the location and timing of tongue contacts with the hard palate during speech. It has been effective in treating articulation disorders that have failed to respond to conventional therapy approaches but, until now, its use with children and adolescents with intellectual/learning disabilities and speech disorders has been limited.

AIMS

To evaluate the usefulness of EPG in the treatment of speech production difficulties in children and adolescents with Down syndrome (DS) aged 8-18 years.

METHODS & PROCEDURES

A total of 27 children with DS were assessed on a range of cognitive and speech and language measures and underwent additional EPG assessment. Participants were randomly allocated to one of three age-matched groups receiving either EPG therapy, EPG-informed conventional therapy or 'treatment as usual' over a 12-week period. The speech of all children was assessed before therapy using the Diagnostic Evaluation of Articulation and Phonology (DEAP) and reassessed immediately post- and 3 and 6 months post-intervention to measure percentage consonants correct (PCC). EPG recordings were made of the DEAP assessment items at all time points. Per cent intelligibility was also calculated using the Children's Speech Intelligibility Measure (CSIM).

OUTCOMES & RESULTS

Gains in accuracy of production immediately post-therapy, as measured by PCC, were seen for all groups. Reassessment at 3 and 6 months post-therapy revealed that those who had received therapy based directly on EPG visual feedback were more likely to maintain and improve on these gains compared with the other groups. Statistical testing showed significant differences between groups in DEAP scores across time points, although the majority did not survive post-hoc evaluation. Intelligibility across time points, as measured by CSIM, was also highly variable within and between the three groups, but despite significant correlations between DEAP and CSIM at all time points, no statistically significant group differences emerged.

CONCLUSIONS & IMPLICATIONS

EPG was an effective intervention tool for improving speech production in many participants. This may be because it capitalizes on the relative strength of visual over auditory processing in this client group. The findings would seem to warrant an increased focus on addressing speech production difficulties in current therapy.

Enabling New Articulatory Gestures in Children With Persistent Speech Sound Disorders Using Ultrasound Visual Biofeedback

Purpose This study evaluated ultrasound visual biofeedback treatment for teaching new articulations to children with a wide variety of speech sound disorders. It was hypothesized that motor-based intervention incorporating ultrasound would lead to rapid acquisition of a range of target lingual gestures with generalization to untreated words. Method Twenty children aged 6-15 years with a range of mild to severe speech disorders affecting a variety of lingual targets enrolled in a case series with replication. Of these, 15 children completed the intervention. All of the children presented with a variety of errors. We therefore employed a target selection strategy to treat the most frequent lingual error. These individual speech targets were treated using ultrasound visual biofeedback as part of ten to twelve 1-hr intervention sessions. The primary outcome measure was percentage of target segments correct in untreated wordlists. Results Six children were treated for velar fronting; 3 children, for postalveolar fronting; 2 children, for backing alveolars to pharyngeal or glottal place; 1 child, for debuccalization (production of all onsets as [h]); 1 child, for vowel merger; and 2 children, for lateralized sibilants. Ten achieved the new articulation in the 1st or 2nd session of intervention, despite no children being readily stimulable for their target articulation before intervention. In terms of generalization, effect sizes for percentage of target segments correct ranged from no effect (5 children), small effect (1 child), medium effect (4 children), and large effect (5 children). Conclusions Ultrasound visual biofeedback can be used to treat a wide range of lingual errors in children with various speech sound disorders, from mild to severe. Visual feedback may be useful for establishing new articulations; however, generalization is more variable.

2018 Ottawa consensus statement: Selection and recruitment to the healthcare professions

Selection and recruitment into healthcare education and practice is a key area of interest for educators with significant developments in research, policy, and practice in recent years. This updated consensus statement, developed through a multi-stage process, examines future opportunities and challenges in selection and recruitment. There is both a gap in the literature around and a compelling case for further theoretical and empirical literature to underpin the development of overall selection philosophes and policies and their enactment. More consistent evidence has emerged regarding the quality of different selection methods. Approaches to selection are context-dependent, requiring the consideration of an institution's philosophy regarding what they are trying to achieve, the communities it purports to serve, along with the system within which they are used. Diversity and globalization issues continue to be critically important topics. Further research is required to explore differential attainment and explain why there are substantial differences in culturally acceptable ways of approaching diversity and widening access. More sophisticated evaluation approaches using multi-disciplinary theoretical frameworks are required to address the issues. Following a discussion of these areas, 10 recommendations are presented to guide future research and practice and to encourage debate between colleagues across the globe.

Does the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination predict 'on-the-job' performance during UK higher specialty surgical training?

INTRODUCTION

The Intercollegiate Membership of the Royal College of Surgeons (MRCS) is a mandatory examination to enter higher surgical specialty training in the UK. It is designed to help to ensure that successful candidates are competent to practice as higher surgical trainees. The annual review of competence progression (ARCP) assesses trainees' competence to progress to the next level of training and can be interpreted as a measure of 'on-the-job' performance. We investigated the relationship between MRCS performance and ARCP outcomes.

MATERIALS AND METHODS

All UK medical graduates who passed MRCS (Parts A and B) from 2007 to 2016 were included. MRCS scores, attempts and sociodemographics for each candidate were crosslinked with ARCP outcomes (satisfactory, unsatisfactory and insufficient evidence). Multinomial logistic regression was used to identify potential independent predictors of ARCP outcomes.

RESULTS

A total of 2570 trainees underwent 11,064 ARCPs; 1589 (61.8%) had only satisfactory outcomes recorded throughout training; 510 (19.9%) had at least one unsatisfactory outcome; and 471 (18.3%) supplied insufficient evidence. After adjusting for age, gender, first language and Part A performance, ethnicity (non-white vs white, OR 1.36, 95% CI 1.08 to 1.71), Part B passing score (OR 0.98, 95% CI 0.98 to 1.00) and number of attempts at Part B (two or more attempts vs one attempt, OR 1.50, 95% CI 1.16 to 1.94) were found to be independent predictors of an unsatisfactory ARCP outcome.

CONCLUSIONS

This is the first study to identify predictors of ARCP outcomes during higher surgical specialty training in the UK and provides further evidence of the predictive validity of the MRCS examination.