O46 Differences in ARCP outcome by surgical specialty: a longitudinal cohort study

Introduction

Surgical training in the UK is comprised of ten specialties: cardiothoracic, general, neurosurgery, oral and maxillofacial (OMFS), otolaryngology, paediatric, plastic, trauma and orthopaedics, urology and vascular surgery. Progression through training is assessed by the Annual Review of Competency Progression (ARCP). The aim is to examine ARCP outcomes within UK surgical specialty training and identify differences between specialties.

Method

A longitudinal cohort study using data from United Kingdom Medical Education Database (UKMED) was performed across surgical specialities. ARCP outcome was the primary outcome measure. Multi-level univariate and multiple ordinal regression analyses were performed.

Result

8,220 trainees with an ARCP outcome between 2010 and 2017 were included, comprising 31,788 ARCP outcomes. There was substantial variation in the proportion of non-standard outcomes across specialties with general surgery trainees having the highest proportion of non-standard outcomes (22.5%) and urology trainees the fewest 12.4%. After adjustment, general surgery trainees were 1.3 times more likely to receive a non-standard outcome compared to T&O trainees (OR 1.33 95% CI 1.21–1.45). Urology trainees were 36% less likely to receive a non-standard outcome compared to T&O trainees (OR 0.64 95% CI 0.54–0.75). Female trainees and older age were associated with non-standard outcomes (OR 1.11 95% CI 1.02–1.22; OR 1.04 95% CI 1.03–1.05).

Conclusion

There is wide variation in the outcomes of surgical ARCP’s across specialties. General surgery has higher rates of non-standard ARCP outcomes compared to other surgical specialities. Across all specialities, female sex and older age were associated with non-standard outcomes. Further studies are required to explore these associations.

Take-home Message

There is significant variation in ARCP outcomes between specialities. Women and older trainees receive significantly more non-standard outcomes.

The quantitative impact of COVID-19 on surgical training in the United Kingdom

Background

COVID-19 has had a global impact on all aspects of healthcare including surgical training. This study aimed to quantify the impact of COVID-19 on operative case numbers recorded by surgeons in training, and annual review of competency progression (ARCP) outcomes in the UK.

Methods

Anonymized operative logbook numbers were collated from electronic logbook and ARCP outcome data from the Intercollegiate Surgical Curriculum Programme database for trainees in the 10 surgical specialty training specialties.

Operative logbook numbers and awarded ARCP outcomes were compared between predefined dates. Effect sizes are reported as incident rate ratios (IRR) with 95 per cent confidence intervals.

Results

Some 5599 surgical trainees in 2019, and 5310 in surgical specialty training in 2020 were included. The IRR was reduced across all specialties as a result of the COVID-19 pandemic (0.62; 95 per cent c.i. 0.60 to 0.64). Elective surgery (0.53; 95 per cent c.i. 0.50 to 0.56) was affected more than emergency surgery (0.85; 95 per cent c.i. 0.84 to 0.87). Regional variation indicating reduced operative activity was demonstrated across all specialties. More than 1 in 8 trainees in the final year of training have had their training extended and more than a quarter of trainees entering their final year of training are behind their expected training trajectory.

Conclusion

The COVID-19 pandemic has had a major effect on surgical training in the UK. Urgent, coordinated action is required to minimize the impacts from the reduction in training in 2020.

Effect of publishing surgeon-specific outcomes on surgical training

Background

Over the past 10 years, the National Health Service in England has started to publish surgeon-specific outcomes publicly. The aim of this study was to investigate how this has affected training case exposure for surgeons in training.

Methods

Anonymized data were collected from the Intercollegiate Surgical Curriculum Programme database for operations in each specialty with published surgeon outcomes, involving surgical trainees on an approved training programme between 1 January 2011 and 31 December 2016. Trainee and supervisor involvement in operations before and after the start of publication of surgeon-specific outcomes were compared using mixed-effects models.

Results

A total of 163 076 recorded operative procedures were included. A statistically significant improvement in exposure to training procedures was observed for anterior resection of rectum, carotid endarterectomy, gastrectomy, meningioma excision, prostatectomy and thyroidectomy following the introduction of publication of surgeon outcomes. In coronary artery bypass grafting (CABG) and total hip replacement (THR), however, there was a reduction in involvement in training procedures. This was apparent for both trainee and supervisor involvement in CABG, and for trainee involvement in THR.

Conclusion

Exposure to training procedures has improved rather than declined in the UK in the majority of surgical specialties, since the publication of surgeon-specific outcomes.

The effects of human factor related issues on assessors during the recruitment process for general and vascular surgery in the UK

INTRODUCTION

Healthcare professionals increasingly recognise how human factors (HF) can contribute to medical error. An understanding of HF is also important during other high stakes activities such as summative assessments or examinations. National organisations hosting such events need to be aware of potential fatigue, boredom and stress that can occur in interviewers during these often repetitive activities.

METHODS

A previously validated questionnaire based around the well known HF analysis and classification system (HFACS) was used to evaluate four factors (care and support, asking questions about the role as an interviewer, working within the rules and boundaries, and stress and pressure) at the 2018 UK general and vascular surgery trainee national selection process.

RESULTS

A total of 92 questionnaires were completed and analysed (48% response rate). After recoding for negative phrased questions, no significant differences were found between years of experience in the selection process and mean scores obtained for all four factor items. Interviewers had a positive experience during national selection with mean factor scores ranging from 3.84 to 3.98 (out of a maximum satisfaction score of 5).

CONCLUSIONS

Organisations need to plan carefully and recognise the human element to ensure that their interviewers are cared for during any high stakes assessment such as national selection. Our work suggests that a positive assessor experience will further help contribute to a reliable and fair recruitment process.

Does the Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination predict 'on-the-job' performance during UK higher specialty surgical training?

INTRODUCTION

The Intercollegiate Membership of the Royal College of Surgeons (MRCS) is a mandatory examination to enter higher surgical specialty training in the UK. It is designed to help to ensure that successful candidates are competent to practice as higher surgical trainees. The annual review of competence progression (ARCP) assesses trainees' competence to progress to the next level of training and can be interpreted as a measure of 'on-the-job' performance. We investigated the relationship between MRCS performance and ARCP outcomes.

MATERIALS AND METHODS

All UK medical graduates who passed MRCS (Parts A and B) from 2007 to 2016 were included. MRCS scores, attempts and sociodemographics for each candidate were crosslinked with ARCP outcomes (satisfactory, unsatisfactory and insufficient evidence). Multinomial logistic regression was used to identify potential independent predictors of ARCP outcomes.

RESULTS

A total of 2570 trainees underwent 11,064 ARCPs; 1589 (61.8%) had only satisfactory outcomes recorded throughout training; 510 (19.9%) had at least one unsatisfactory outcome; and 471 (18.3%) supplied insufficient evidence. After adjusting for age, gender, first language and Part A performance, ethnicity (non-white vs white, OR 1.36, 95% CI 1.08 to 1.71), Part B passing score (OR 0.98, 95% CI 0.98 to 1.00) and number of attempts at Part B (two or more attempts vs one attempt, OR 1.50, 95% CI 1.16 to 1.94) were found to be independent predictors of an unsatisfactory ARCP outcome.

CONCLUSIONS

This is the first study to identify predictors of ARCP outcomes during higher surgical specialty training in the UK and provides further evidence of the predictive validity of the MRCS examination.

Impact of performance in a mandatory postgraduate surgical examination on selection into specialty training

Background

The Intercollegiate Membership of the Royal College of Surgeons (MRCS) examination is undertaken by large numbers of trainees in the UK and internationally as a mandatory step within surgical training. Unlike some high-stakes medical examinations, the MRCS is yet to be validated. A quantitative study was undertaken to assess its predictive validity by investigating the relationship between MRCS (Parts A and B) and national selection interview scores for general and vascular surgery in the UK.

Methods

Pearson correlation coefficients were used to examine the linear relationship between each assessment, and linear regression analyses were employed to identify potential independent predictors of the national selection score. All UK medical graduates who attempted the interview in 2011-2015 were included.

Results

Some 84·4 per cent of the candidates (1231 of 1458) were matched with MRCS data. There was a significant positive correlation between the first attempt score at Part B of the MRCS examination and the national selection score (r = 0·38, P < 0·001). In multivariable analysis, 17 per cent of variance in the national selection first attempt score was explained by the Part B MRCS score and number of attempts (change in R ² value of 0·10 and 0·07 respectively; P < 0·001). Candidates who required more than two attempts at Part B were predicted to score 8·1 per cent less than equally matched candidates who passed at their first attempt.

Conclusion

This study supports validity of the MRCS examination, and indicates its predictive value regarding entry into specialist training.

Long-term results and recurrence patterns from SCALOP: a phase II randomised trial of gemcitabine- or capecitabine-based chemoradiation for locally advanced pancreatic cancer

BACKGROUND

SCALOP, a randomised, phase II trial, tested the activity and safety of gemcitabine (GEM)-based and capecitabine (CAP)-based chemoradiation (CRT) for locally advanced pancreatic cancer (LAPC). Here we present the long-term outcomes.

METHODS

Eligibility: histologically proven LAPC ⩽7 cm. Following 12 weeks of induction GEMCAP chemotherapy (three cycles: GEM 1000 mg m-2 days 1, 8, 15; CAP 830 mg m-2 days 1-21 q28 days) patients with stable/responding disease, tumour ⩽6 cm, and WHO Performance Status 0-1 were randomised to receive one cycle GEMCAP followed by CAP (830 mg m-2 b.d. on weekdays only) or GEM (300 mg m-2 weekly) with radiation (50.4 Gy per 28 fractions).

RESULTS

One-hundred fourteen patients (28 UK centres) were registered between 24 December 2009 and 25 October 2011, and 74 were randomised (CAP-RT=36; GEM-RT=38). At the time of this analysis, 105 of the 114 patients had died and the surviving 9 patients had been followed up for a median of 10.9 months (IQR: 2.9-18.7). Updated median OS was 17.6 months (95% CI: 14.6-22.7) in the CAP-CRT arm and 14.6 months (95% CI: 11.1-16.0) in the GEM-CRT arm (intention-to-treat adjusted hazard ratio (HR): 0.68 (95% CI: 0.38-1.21, P=0.185)); median progression-free survival (PFS) was 12.0 months (95% CI: 10.0-15.2) in the CAP-CRT arm and 10.4 months (95% CI: 8.8-12.7) in the GEM-CRT arm (intention-to-treat adjusted HR: 0.60 (95% CI: 0.32-1.14, P=0.120)). In baseline multivariable model, age ⩾65 years, better performance status, CA19.9<613 IU l-1, and shorter tumour diameter predicted improved OS. CAP-CRT, age ⩾65 years, better performance status, CA19.9 <46 IU ml-1 predicted improved OS and PFS in the pre-radiotherapy model. Nine-month PFS was highly predictive of OS.

CONCLUSIONS

CAP-CRT remains the superior regimen. SCALOP showed that patients with CA19.9 <46 IU ml-1 after induction chemotherapy are more likely to benefit from CRT.

Meta-analysis of operative experiences of general surgery trainees during training

BACKGROUND

General surgical training curricula around the world set defined operative numbers to be achieved before completion of training. However, there are few studies reporting total operative experience in training. This systematic review aimed to quantify the published global operative experience at completion of training in general surgery.

METHODS

Electronic databases were searched systematically for articles in any language relating to operative experience in trainees completing postgraduate general surgical training. Two reviewers independently assessed citations for inclusion using agreed criteria. Studies were assessed for quantitative data in addition to study design and purpose. A meta-analysis was performed using a random-effects model of studies with appropriate data.

RESULTS

The search resulted in 1979 titles for review. Of these, 24 studies were eligible for inclusion in the review and data from five studies were used in the meta-analysis. Studies with published data of operative experience at completion of surgical training originated from the USA (19), UK (2), the Netherlands (1), Spain (1) and Thailand (1). Mean total operative experience in training varied from 783 procedures in Thailand to 1915 in the UK. Meta-analysis produced a mean pooled estimate of 1366 (95 per cent c.i. 1026 to 1707) procedures per trainee at completion of training. There was marked heterogeneity between studies (I²  = 99·6 per cent).

CONCLUSION

There is a lack of robust data describing the operative experiences of general surgical trainees outside the USA. The number of surgical procedures performed by general surgeons in training varies considerably across the world.

Long-term results and recurrence patterns from SCOPE-1: a phase II/III randomised trial of definitive chemoradiotherapy +/- cetuximab in oesophageal cancer

BACKGROUND

The SCOPE-1 study tested the role of adding cetuximab to conventional definitive chemoradiotherapy (dCRT), and demonstrated greater toxicity and worse survival outcomes. We present the long-term outcomes and patterns of recurrence.

METHODS

SCOPE-1 was a phase II/III trial in which patients were randomised to cisplatin 60 mg m-2 (day 1) and capecitabine 625 mg m-2 bd (days 1-21) for four cycles +/- cetuximab 400 mg m-2 day 1 then by 250 mg m-2 weekly. Radiotherapy consisted of 50 Gy/25# given concurrently with cycles 3 and 4. Recruitment was between February 2008 and February 2012, when the IDMC recommended closure on the basis of futility.

RESULTS

About 258 patients (dCRT=129; dCRT+cetuximab (dCRT+C)=129) were recruited from 36 centres. About 72.9% (n=188) had squamous cell histology. The median follow-up (IQR) was 46.2 (35.9-48.3) months for surviving patients. The median overall survival (OS; months; 95% CI) was 34.5 (24.7-42.3) in dCRT and 24.7 (18.6-31.3) in dCRT+C (hazard ratio (HR)=1.25, 95% CIs: 0.93-1.69, P=0.137). Median progression-free survival (PFS; months; 95% CI) was 24.1 (15.3-29.9) and 15.9 (10.7-20.8) months, respectively (HR=1.28, 95% CIs: 0.94-1.75; P=0.114). On multivariable analysis only earlier stage, full-dose RT, and higher cisplatin dose intensity were associated with improved OS.

CONCLUSIONS

The mature analysis demonstrates that the dCRT regimen used in the study provided useful survival outcomes despite its use in patients who were largely unfit for surgery or who had inoperable disease. Given the competing risk of systemic and local failure, future studies should continue to focus on enhancing local control as well as optimising systemic therapy.

Patient-reported outcomes during and after definitive chemoradiotherapy for oesophageal cancer

BACKGROUND

Limited data describe patient-reported outcomes (PROs) of localised oesophageal cancer treated with definitive chemoradiotherapy(CRT). The phase 2/3 SCOPE-1 trial assessed the effectiveness of CRT±cetuximab. The trial for the first time provided an opportunity to describe PROs from a multi-centre group of patients treated with CRT that are presented here.

METHODS

Patients undergoing CRT±cetuximab within the SCOPE-1 trial (258 patients from 36 UK centres) completed generic-, disease- and treatment-specific health-related quality of life (HRQL) questionnaires (EORTC QLQ-C30, QLQ-OES18, Dermatology Life-Quality Index (DLQI)) at baseline and at 7, 13, 24, 52 and 104 weeks. Mean EORTC functional scale scores (>15 point change significant), DLQI scores (>4 point change significant) and proportions of patients (>15% significant) with 'minimal' or 'severe' symptoms are presented.

RESULTS

Questionnaire response rates were good. At baseline, EORTC functional scores were high (>75%) and few symptoms were reported except for severe problems with fatigue, insomnia and eating-related symptoms (e.g., appetite loss, dysphagia, dry mouth) in both groups(>15%). Functional aspects of health deteriorated and symptoms increased with treatment and by week 13 global quality of life, physical, role and social function significantly deteriorated and more problems with fatigue, dyspnoea, appetite loss and trouble with taste were reported. Recovery occurred by 6 months (except severe fatigue and insomnia in >15% of patients) and maintained at follow-up with no differences between groups.

CONCLUSIONS

CRT for localised oesophageal cancer has a significant detrimental impact on many aspects of HRQL; however, recovery is achieved by 6 months and maintained with the exception of persisting problems with severe fatigue and insomnia. The data suggest that the HRQL recovery after definitive CRT is quicker, and there is little lasting deficit compared with treatment including surgery. These data need to be compared with HRQL data from studies evaluating treatments including surgery for oesophageal cancer.

General Surgery Logbook Survey

Application for a Certificate of Completion of Training (CCT) in general surgery includes assessment of a validated logbook. The content of a satisfactory logbook has long been an area of contention. The logbook allows trainees to record their operative experience and to show the level of supervision. It is tempting to set a specific number of procedures to be completed by the end of training. However, such a number must be evidence based rather than chosen subjectively.

Abstract PD07-09: Zoledronate versus ibandronate comparative evaluation (ZICE) trial - first results of a UK NCRI 1,405 patient phase III trial comparing oral ibandronate versus intravenous zoledronate in the treatment of breast cancer patients with bone metastases

Introduction Bone metastases in patients with breast cancer have serious effects on health including pain, poor mobility, skeletal fractures, spinal cord compression and the need for radiotherapy/surgery. The introduction of intravenous (IV) bisphosphonates, such as zoledronic acid (Z) has significantly delayed the onset of skeletal-related events (SRE). However, prolonged IV bisphosphonates place burdens upon patient and hospital, and can also cause renal and acute phase toxicities. Ibandronic acid (I), a third generation amino-bisphosphonate in its oral form has previously been compared with placebo and was shown to be well tolerated and effective. Indirect comparisons with IV Z indicated similar efficacy in reducing bone events, but adverse events were overall comparable with placebo. One might therefore assume that oral ibandronate would be more acceptable to patients, and the ZICE Trial is the only large scale direct randomised comparison between IV Z and oral I to report.

Methods Between January 2006 and October 2010, 1405 newly diagnosed metastatic breast cancer patients with proven bone metastases were randomised 1:1 to IV Z (4mg 15 min infusion every 3–4 weeks) or oral I (50mg per day) for up to 96 weeks. All patients were prescribed daily calcium & vitamin D supplementation, and patients with current active dental problems including infection were excluded. Patients also received chemotherapy, and or endocrine therapy as determined by their physician. The primary objective was to demonstrate non-inferiority of oral I in comparison with IV Z in terms of the SRE rate, defined as the number of SREs reported per year (using multiple event analysis). Secondary endpoints included time to 1st SRE, proportion of patients with SRE, Pain Scores, side effect profiles including ONJ and renal toxicities, quality of life and Health resources and overall survival. The trial was run under the auspices of the NCRI, sponsored by Velindre NHS Trust, coordinated by the Wales Cancer Trials Unit, funded by an educational grant from Roche and peer reviewed/endorsed by Cancer Research UK (CRUKE/04/022).

Results At the time of this analysis the last randomised patient had completed 96 weeks of therapy, median follow up was 18.4 months and total number of SREs was 865 (468 in I and 397 in Z). For the primary objective, the SRE rate was 0.543 and 0.444 in I and Z groups respectively (Hazard ratio, 1.22; 95% CI, 1.04 to 1.45; P = .017). Ibandronate failed to meet the criteria for non-inferiority to Zoledronate, but was similar in delaying time to first SRE (hazard ratio, 1.11; 95% CI, 0.94 to 1.31; P = .233). Overall survival (disease progression), was very similar between groups but renal AEs occurred more frequently with Z than I; Compliance with oral therapy was 82%. ONJ rate was very low in both arms (0.71%, I; 1.29%, Z; P = 0.28).

Conclusion Oral I is inferior to Z in terms of the SRE rate in metastatic breast cancer patients with bone metastases, but is similar to Z in delaying time to first SRE. Both drugs had acceptable safety profiles, with adverse events consistent with those reported previously.

Citation Information: Cancer Res 2012;72(24 Suppl):Abstract nr PD07-09.

Using in-vivo fluorescence imaging in personalized cancer diagnostics and therapy, an image and treat paradigm

The major goal in developing drugs targeting specific tumor receptors, such as Monoclonal AntiBodies (MAB), is to make a drug compound that targets selectively the cancer-causing biomarkers, inhibits their functionality, and/or delivers the toxin specifically to the malignant cells. Recent advances in MABs show that their efficacy depends strongly on characterization of tumor biomarkers. Therefore, one of the main tasks in cancer diagnostics and treatment is to develop non-invasive in-vivo imaging techniques for detection of cancer biomarkers and monitoring their down regulation during the treatment. Such methods can potentially result in a new imaging and treatment paradigm for cancer therapy. In this article we have reviewed fluorescence imaging approaches, including those developed in our group, to detect and monitor Human Epidermal Growth Factor 2 (HER2) receptors before and during therapy. Transition of these techniques from the bench to bedside is the ultimate goal of our project. Similar approaches can be used potentially for characterization of other cancer related cell biomarkers.

Researching breathlessness in palliative care: consensus statement of the National Cancer Research Institute Palliative Care Breathlessness Subgroup

Breathlessness is common in advanced disease and can have a devastating impact on patients and carers. Research on the management of breathlessness is challenging. There are relatively few studies, and many studies are limited by inadequate power or design. This paper represents a consensus statement of the National Cancer Research Institute Palliative Care Breathlessness Subgroup. The aims of this paper are to facilitate the design of adequately powered multi-centre interventional studies in breathlessness, to suggest a standardised, rational approach to breathlessness research and to aid future 'between study' comparisons. Discussion of the physiology of breathlessness is included.

Molecular targeting of HER2 for diagnosis and therapy of breast cancer

Abstract #6004

Background: Expression of HER2 receptors in breast cancer is correlated with poor prognosis and may be different in distant metastases as compared to the primary tumor. We are developing methods to assess global expression of HER2 in vivo and to deliver therapeutic agents specifically to HER2-positve cells.&#x2028; Materials and Methods: As the targeting agent we use an Affibody molecule (http://www.affibody.com). These very stable and highly soluble proteins are relatively small (8.3 kDa) and bind to HER2 receptors with high affinity (22 pM). For imaging with PET, SPECT, or optical methods, an appropriate group containing the imaging beacon can be attached by a selective chemical reaction to a unique C-terminal cysteine residue of Affibody. For therapeutic purposes, they can be conjugated to multifunctional nanoparticles containing both imaging and therapeutic agents. We have conjugated affibody molecules with thermo-sensitive liposomes or gold nanoparticles (subsequently activated with neutrons) and characterized their biodistribution using optical imaging and SPECT, respectively. We used PET imaging with 18F-ZHER2-Affibody to monitor the down-regulation of HER2 following four doses (50 mg/kg) of 17-dimethylaminoethylamino-17-demethoxy-geldanamycin, 17-DMAG, an inhibitor of Hsp90 known to decrease HER2 expression. Animals were scanned before and after treatment. Immediately after the last scan, the mice were euthanized and tumors were frozen for ex-vivo analysis of receptor expression. For optical imaging, we used AlexaFluor dyes conjugated with affibody molecules containing an albumin binding domain that extended their circulation time. We have attached nanoparticles (liposomes and gold) to Affibody molecules using the same type of maleimide chemistry.&#x2028; Results: Our results showed that Affibody molecules do not affect the targeted cells and that their binding does not interfere with either the binding or the effectiveness of trastuzumab. 18F-ZHER2-Affibody was eliminated quickly from blood and normal tissues, providing high tumor/blood and tumor/muscle ratios by 1h post injection. The signal obtained from PET and optical imaging correlated well with the number of receptors expressed in the studied tumors as assessed by western blot, ELISA, and IHC. Following 17-DMAG treatment, the level of HER2 expression, estimated by PET imaging, in BT474 and Mcf-7/clone18 tumors decreased 70% and 30%. This change was confirmed by the biodistribution studies, ELISA and western blot.&#x2028; Discussion: This strategy, involving assessment of target presence and distribution in an individual patient followed by optimized, target-specific drug delivery, may significantly improve efficacy of breast cancer treatment while reducing side effects.

Citation Information: Cancer Res 2009;69(2 Suppl):Abstract nr 6004.