Prediction of medical sciences students' performance on high-stakes examinations using machine learning models: a protocol for a systematic review

INTRODUCTION

Predicting medical science students' performance on high-stakes examinations has received considerable attention. Machine learning (ML) models are well-known approaches to enhance the accuracy of determining the students' performance. Accordingly, we aim to provide a comprehensive framework and systematic review protocol for applying ML in predicting medical science students' performance on high-stakes examinations. Improving the current understanding of the input and output features, preprocessing methods, setting of ML models and required evaluation metrics seems essential.

METHODS AND ANALYSIS

A systematic review will be conducted by searching the electronic bibliographic databases of MEDLINE/PubMed, EMBASE, SCOPUS and Web of Science. The search will be limited to studies published from January 2013 to June 2023. Studies explicitly predicting student performance in high-stakes examinations and referencing their learning outcomes and use of ML models will be included. Two team members will first screen literature meeting the inclusion criteria at the title, abstract and full-text levels. Second, the Best Evidence Medical Education quality framework rates the included literature. Later, two team members will extract data, including the studies' general data and the ML approach's details. Finally, the information consensus will be reached and submitted for analysis. The synthesised evidence from this review provides helpful information for medical education policy-makers, stakeholders and other researchers in adopting the ML models to evaluate medical science students' performance in high-stakes exams.

ETHICS AND DISSEMINATION

This systematic review protocol summarises findings of existing publications rather than primary data and does not require an ethics review. The results will be disseminated in publications of peer-reviewed journals.

Association between incident falls and subsequent fractures in patients attending the fracture liaison service after an index fracture: a 3-year prospective observational cohort study

OBJECTIVES

To evaluate the risk of subsequent fractures in patients who attended the Fracture Liaison Service (FLS), with and without incident falls after the index fracture.

DESIGN

A 3-year prospective observational cohort study.

SETTING

An outpatient FLS in the Netherlands.

PARTICIPANTS

Patients aged 50+ years with a recent clinical fracture.

OUTCOME MEASURES

Incident falls and subsequent fractures.

RESULTS

The study included 488 patients (71.9% women, mean age: 64.6±8.6 years). During the 3-year follow-up, 959 falls had been ascertained in 296 patients (60.7%) (ie, fallers), and 60 subsequent fractures were ascertained in 53 patients (10.9%). Of the fractures, 47 (78.3%) were fall related, of which 25 (53.2%) were sustained at the first fall incident at a median of 34 weeks. An incident fall was associated with an approximately 9-fold (HR: 8.6, 95% CI 3.1 to 23.8) increase in the risk of subsequent fractures.

CONCLUSION

These data suggest that subsequent fractures among patients on treatment prescribed in an FLS setting are common, and that an incident fall is a strong predictor of subsequent fracture risk. Immediate attention for fall risk could be beneficial in an FLS model of care.

TRIAL REGISTRATION NUMBER

NL45707.072.13.

Culture and understanding the role of feedback for health professions students: realist synthesis protocol

INTRODUCTION

Clinical education has moved to a 'competency-based' model with an emphasis on workplace-based learning and assessment which, in turn, depends on feedback to be effective. Further, the understanding of feedback has changed from information about a performance directed to the learner performing the task, to a dialogue, which enables the learner to act and develop.In health professional education, feedback is a complex interaction between trainee, supervisor and the healthcare system. Most published research on feedback in health professional education originates in Europe and North America. Our interest is on the impact of Culture on this process, particularly in the context of Asian cultures.The (scientific) realist approach of Pawson and Tilley provides a means to examine complex interventions in social situations, and thus is an appropriate lens to use for this study. This is a protocol for a realist synthesis which asks how, why and in what circumstances do Asian Cultures influence health professional trainees to seek, respond to and use feedback given in the clinical environment, if at all.

METHODS AND ANALYSIS

An initial search was performed to help define the scope of the review question and develop our initial programme theory. The formal electronic search was carried out in February 2020 and included: CINAHL, ERIC, Medline and PsycInfo, and repeated in October 2020. Retrieved articles were imported into Covidence for screening and data extraction, after which components of the Context-Mechanisms-Outcomes configurations will be sought to refine the initial programme theory.

ETHICS AND DISSEMINATION

As this study is a literature review, ethics approval is not required.The findings will be documented in line with the RAMESES (Realist And MEta-narrative Evidence Syntheses: Evolving Standards) publications standards for Realist syntheses, and we plan to disseminate the findings by means of a peer-reviewed journal article and conference presentation(s).

Residency training in family medicine and its impact on coordination and continuity of care: an analysis of referrals to secondary care in Rio de Janeiro

OBJECTIVE

To measure the effect that residency training in family medicine (RTFM) has on continuity and coordination of care.

DESIGN

Observational cohort study using electronic health records.

SETTING

Rio de Janeiro, Brazil, public primary care system.

PARTICIPANTS

504 940 patients, 633 generalists (physicians without RTFM) and 204 family physicians (FP-doctors with 2 years of RTFM) from one health district between January 2015 and December 2018.

INTERVENTION

Two years of RTFM.

MAIN OUTCOME MEASURES

Relative risks of patients being referred to secondary care for outpatient consultations and diagnostics tests; and having a follow-up medical consultation in primary care within 3 and 6 months after being referred.

RESULTS

We examined 2 414 508 medical consultations and 284 754 referrals to secondary care. FPs were less likely to request ambulatory care services (including surgical specialties), but were more likely to request ophthalmology, physiotherapy, rehabilitationand surgical evaluations for their patients. Patients referred to secondary care by FPs were more likely to have a follow-up visit in primary care for almost every service requested. If all medical consultations were performed by FPs, a 37.6% (95% CI 32.4% to 42.4%) increased demand for rehabilitation services would be noticed. Oppositely, 1532 (95% CI 1458 to 1602) fewer requests for dermatology would happen every year.

CONCLUSIONS

RTFM improves coordination and continuity of care by making FPs more competent to retain those health conditions that can be properly managed in primary care and making FPs more competent to detect health conditions that require specific biomedical technologies and skills, increasing the demand for those services. Besides, it increases the chances of patients having follow-up visits in primary care. Policy-makers in low-income and middle-income countries must consider investing in RTFM to make primary care systems more comprehensive, with better coordination and continuity of care.

More GP contacts and poorer health of informal caregivers with low socioeconomic status in Germany: results from the population-based DEGS1 and the cross-sectional GPCare-1 study

OBJECTIVES

Informal caregivers are known to have poorer mental health. Risk factors for caregiver burden include low education, female gender, cohabitation with the care recipient and lack of resources. General practitioners (GPs) have an important role in supporting caregivers. Drawing on data from two surveys, associations between caregivers' socioeconomic status (SES), psychophysical health and GP contacts are analysed.

DESIGN

Cross-sectional study. The study draws on data from two surveys (German Health Interview and Examination Survey for Adults, DEGS1 and General Practice Care-1, GPCare-1).

SETTING

Germany.

PARTICIPANTS

DEGS1: German general population (18+ years) n=7987. GPCare-1: general practice patients (18+ years) n=813.

PRIMARY OUTCOME

Psychophysical health, GP contacts and communication.

METHODS

Using representative DEGS1 data, the prevalence of informal caregivers, caregivers' burden, chronic stress, various health conditions and frequency of GP contacts were evaluated stratified by SES. Data from the GPCare-1 study addressed caregivers' experiences and communication preferences with GPs.

RESULTS

In the DEGS1, the prevalence of caregivers was 6.5%. Compared with non-caregivers, caregivers scored significantly higher for chronic stress (15.45 vs 11.90), self-reported poor health (37.6% vs 23.7%) and GP visits last year (3.95 vs 3.11), while lifestyle and chronic diseases were similar. Compared with caregivers with medium/high SES, those with low SES had a significantly lower prevalence of high/medium caregiver burden (47.9% vs 67.7%) but poorer self-reported health (56.9% vs 33.0%), while other characteristics did not differ. In the GPCare-1 study, the prevalence of caregivers was 12.6%. The majority of them felt that their GP takes their problems seriously (63.6%) without difference by SES.

CONCLUSION

Caregivers with low SES constitute an especially high-risk group for psychological strain, requiring special GP attention to support their needs.

Effectiveness of acute geriatric unit care on functional decline and process outcomes among older adults admitted to hospital with acute medical complaints: a protocol for a systematic review

INTRODUCTION

Older adults are clinically heterogeneous and are at increased risk of adverse outcomes during hospitalisation due to the presence of multiple comorbid conditions and reduced homoeostatic reserves. Acute geriatric units (AGUs) are units designed with their own physical location and structure, which provide care to older adults during the acute phase of illness and are underpinned by an interdisciplinary comprehensive geriatric assessment model of care. This review aims to update and synthesise the totality of evidence related to the effectiveness of AGU care on clinical and process outcomes among older adults admitted to hospital with acute medical complaints.

DESIGN

Updated systematic review and meta-analysis METHODS AND ANALYSIS: MEDLINE, Cumulative Index of Nursing and Allied Health Literature, Controlled Trials in the Cochrane Library and Embase electronic databases will be systematically searched from 2008 to February 2021. Trials with a randomised design that deliver an AGU intervention to older adults admitted to hospital for acute medical complaints will be included. The primary outcome measure will be functional decline at discharge from hospital and at follow-up. Secondary outcomes will include length of stay, cost of index admission, incidence of unscheduled hospital readmission, living at home (the inverse of death or institutionalisation combined; used to describe someone who is in their own home at follow-up), mortality, cognitive function and patient satisfaction with index admission. Title and abstract screening of studies for full-text extraction will be conducted independently by two authors. The Cochrane risk of bias 2 tool will be used to assess the methodological quality of the included trials. The quality of evidence for outcomes reported will be assessed using the Grading of Recommendations Assessment, Development and Evaluations framework. A pooled meta-analysis will be conducted using Review Manager, depending on the uniformity of the data.

ETHICS AND DISSEMINATION

Formal ethical approval is not required as all data collected will be secondary data and will be analysed anonymously. The authors will present the findings of the review to a patient and public involvement stakeholder panel of older adults that has been established at the Ageing Research Centre in the University of Limerick. This will enable the views and opinions of older adults to be integrated into the discussion section of the paper.

PROSPERO REGISTRATION NUMBER

CRD42021237633.

Impact of COVID-19 on patient health and self-care practices: a mixed-methods survey with German patients

OBJECTIVE

This study aimed to examine German patients': (1) self-estimation of the impact of the pandemic on their health and healthcare; and (2) use of digital self-care practices during the pandemic.

DESIGN

Cross-sectional mixed-methods survey.

SETTING AND PARTICIPANTS

General practice patients from four physicians' offices located in urban and rural areas of Bavaria, Germany, between 21 July 2020 and 17 October 2020. A total of 254 patients participated (55% response rate); 57% (262 of 459) identified as female and participants had an average age of 39.3 years. Patients were eligible to participate if they were 18 years or older and spoke German, and had access to the internet.

RESULTS

(1) Healthcare for patients was affected by the pandemic, and the mental health of a small group of respondents was particularly affected. The risk of depression and anxiety disorder was significantly increased in patients with quarantine experience. (2) Self-care practices have increased; more than one-third (39%) of participants indicated that they started a new or additional self-care practice during the pandemic, and about a quarter (23%) of patients who were not previously engaged in self-care practices started new self-care activities for the first time; however, such practices were not necessarily digital.

CONCLUSIONS

Further investigation is required to understand the relationship between digital self-care and public health events such as the COVID-19 pandemic, and to develop strategies to alleviate the burden of the quarantine experience for patients.

Cohort study of hospitalists' procedural skills: baseline competence and durability after simulation-based training

OBJECTIVES

Hospitalists are expected to be competent in performing bedside procedures, which are associated with significant morbidity and mortality. A national decline in procedures performed by hospitalists has prompted questions about their procedural competency. Additionally, though simulation-based mastery learning (SBML) has been shown to be effective among trainees whether this approach has enduring benefits for independent practitioners who already have experience is unknown. We aimed to assess the baseline procedural skill of hospitalists already credentialed to perform procedures. We hypothesised that simulation-based training of hospitalists would result in durable skill gains after several months.

DESIGN

Prospective cohort study with pretraining and post-training measurements.

SETTING

Single, large, urban academic medical centre in the USA.

PARTICIPANTS

Twenty-two out of 38 eligible participants defined as hospitalists working on teaching services where they would supervise trainees performing procedures.

INTERVENTIONS

One-on-one, 60 min SBML of lumbar puncture (LP) and abdominal paracentesis (AP).

PRIMARY AND SECONDARY OUTCOME MEASURES

Our primary outcome was the percentage of hospitalists obtaining minimum passing scores (MPS) on LP and AP checklists; our secondary outcomes were average checklist scores and self-reported confidence.

RESULTS

At baseline, only 16% hospitalists met or exceeded the MPS for LP and 32% for AP. Immediately after SBML, 100% of hospitalists reached this threshold. Reassessment an average of 7 months later revealed that only 40% of hospitalists achieved the MPS. Confidence increased initially after training but declined over time.

CONCLUSIONS

Hospitalists may be performing invasive bedside procedures without demonstration of adequate skill. A single evidence-based training intervention was insufficient to sustain skills for the majority of hospitalists over a short period of time. More stringent practices for certifying hospitalists who perform risky procedures are warranted, as well as mechanisms to support skill maintenance, such as periodic simulation-based training and assessment.

Opioid analgesic use after ambulatory surgery: a descriptive prospective cohort study of factors associated with quantities prescribed and consumed

OBJECTIVES

To prospectively characterise: (1) postoperative opioid analgesic prescribing practices; (2) experience of patients undergoing elective ambulatory surgeries and (3) impact of patient risk for medication misuse on postoperative pain management.

DESIGN

Longitudinal survey of patients 7 days before and 7-14 days after surgery.

SETTING

Academic urban safety-net hospital.

PARTICIPANTS

181 participants recruited, 18 surgeons, follow-up data from 149 participants (82% retention); 54% women; mean age: 49 years.

INTERVENTIONS

None.

PRIMARY AND SECONDARY OUTCOME MEASURES

Total morphine equivalent dose (MED) prescribed and consumed, percentage of unused opioids.

RESULTS

Surgeons postoperatively prescribed a mean of 242 total MED per patient, equivalent to 32 oxycodone (5 mg) pills. Participants used a mean of 116 MEDs (48%), equivalent to 18 oxycodone (5 mg) pills (~145 mg of oxycodone remaining per patient). A 10-year increase in patient age was associated with 12 (95% CI (-2.05 to -0.35)) total MED fewer prescribed opioids. Each one-point increase in the preoperative Graded Chronic Pain Scale was associated with an 18 (6.84 to 29.60) total MED increase in opioid consumption, and 5% (-0.09% to -0.005%) fewer unused opioids. Prior opioid prescription was associated with a 55 (5.38 to -104.82) total MED increase in opioid consumption, and 19% (-0.35% to -0.02%) fewer unused opioids. High-risk drug use was associated with 9% (-0.19% to 0.002%) fewer unused opioids. Pain severity in previous 3 months, high-risk alcohol, use and prior opioid prescription were not associated with postoperative prescribing practices.

CONCLUSIONS

Participants with a preoperative history of chronic pain, prior opioid prescription, and high-risk drug use were more likely to consume higher amounts of opioid medications postoperatively. Additionally, surgeons did not incorporate key patient-level factors (eg, substance use, preoperative pain) into opioid prescribing practices. Opportunities to improve postoperative opioid prescribing include system changes among surgical specialties, and patient education and monitoring.

Cohort profile: follow-up of a Berlin Aging Study II (BASE-II) subsample as part of the GendAge study

PURPOSE

The study 'Sex- and gender-sensitive prevention of cardiovascular and metabolic disease in older adults in Germany', the GendAge study, focuses on major risk factors for cardiovascular and metabolic diseases and on the development of major outcomes from intermediate phenotypes in the context of sex and gender differences. It is based on a follow-up examination of a subsample (older group) of the Berlin Aging Study II (BASE-II).

PARTICIPANTS

The GendAge study assessments took place between 22 June 2018 and 10 March 2020. A total of 1100 participants (older BASE-II subsample, aged ≥65 years) with baseline data assessed at least by one of the BASE-II partner sites were investigated in the follow-up. These participants had a mean age of 75.6 years (SD ±3.8), with a mean follow-up at 7.4 years (SD ±1.5).

FINDINGS TO DATE

Data from different domains such as internal medicine, geriatrics, immunology and psychology were collected, with a focus on cardiometabolic diseases and in the context of sex and gender differences. Diabetes mellitus type 2 was reported by 15.6% and 8.6% of men and women, respectively. In contrast, this disease was diagnosed in 20.7% of men and 13.3% of women, indicating that a substantial proportion of almost 30% was unaware of the disease. Echocardiography revealed that left ventricular ejection fraction was higher in women than in men, in agreement with previous reports.

FUTURE PLANS

A gender questionnaire assessing sociocultural aspects implemented as part of the follow-up described here will allow to calculate a gender score and its evaluation based on the newly collected data. At the same time, the other BASE-II research foci established over the past 10 years will be continued and strengthened by the BASE-II transition into a longitudinal study with follow-up data on the older subsample.

TRIAL REGISTRATION NUMBER

DRKS00016157.

Systematic review on the instruments used for measuring the association of the level of multimorbidity and clinically important outcomes

OBJECTIVES

There are multiple instruments for measuring multimorbidity. The main objective of this systematic review was to provide a list of instruments that are suitable for use in studies aiming to measure the association of a specific outcome with different levels of multimorbidity as the main independent variable in community-dwelling individuals. The secondary objective was to provide details of the requirements, strengths and limitations of these instruments, and the chosen outcomes.

METHODS

We conducted the review according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines (PROSPERO registration number: CRD42018105297). We searched MEDLINE, Embase and CINAHL electronic databases published in English and manually searched the Journal of Comorbidity between 1 January 2010 and 23 October 2020 inclusive. Studies also had to select adult patients from primary care or general population and had at least one specified outcome variable. Two authors screened the titles, abstracts and full texts independently. Disagreements were resolved with a third author. The modified Newcastle-Ottawa Scale was used for quality assessment.

RESULTS

Ninety-six studies were identified, with 69 of them rated to have a low risk of bias. In total, 33 unique instruments were described. Disease Count and weighted indices like Charlson Comorbidity Index were commonly used. Other approaches included pharmaceutical-based instruments. Disease Count was the common instrument used for measuring all three essential core outcomes of multimorbidity research: mortality, mental health and quality of life. There was a rise in the development of novel weighted indices by using prognostic models. The data obtained for measuring multimorbidity were from sources including medical records, patient self-reports and large administrative databases.

CONCLUSIONS

We listed the details of 33 instruments for measuring the level of multimorbidity as a resource for investigators interested in the measurement of multimorbidity for its association with or prediction of a specific outcome.

Reviewing the use and quality of machine learning in developing clinical prediction models for cardiovascular disease

Cardiovascular disease (CVD) is one of the leading causes of death across the world. CVD can lead to angina, heart attacks, heart failure, strokes, and eventually, death; among many other serious conditions. The early intervention with those at a higher risk of developing CVD, typically with statin treatment, leads to better health outcomes. For this reason, clinical prediction models (CPMs) have been developed to identify those at a high risk of developing CVD so that treatment can begin at an earlier stage. Currently, CPMs are built around statistical analysis of factors linked to developing CVD, such as body mass index and family history. The emerging field of machine learning (ML) in healthcare, using computer algorithms that learn from a dataset without explicit programming, has the potential to outperform the CPMs available today. ML has already shown exciting progress in the detection of skin malignancies, bone fractures and many other medical conditions. In this review, we will analyse and explain the CPMs currently in use with comparisons to their developing ML counterparts. We have found that although the newest non-ML CPMs are effective, ML-based approaches consistently outperform them. However, improvements to the literature need to be made before ML should be implemented over current CPMs.

Emergency preparedness, resilience and response to a biological outbreak

Major disease outbreaks continue to be a significant risk to public health, with pandemic influenza or an emerging infectious disease outbreak at the top of the UK National Risk Register. The risk of deliberate release of a biological agent is lower but remains possible and may only be recognised after casualties seek medical attention. In this context the emergency preparedness, resilience and response (EPRR) process protects the public from high consequence infectious diseases, other infectious disease outbreaks and biological agent release. The core elements of the EPRR response are recognition of an outbreak, isolation of patients, appropriate personal protective equipment for medical staff and actions to minimise further disease spread. The paper discusses how high-threat agents may be recognised by clinicians, the initial actions to be taken on presentation and how the public health system is notified and responds. It draws on the national pandemic influenza plans to describe the wider response to a major disease outbreak and discusses training requirements and the potential role of the military.

Protocol for an implementation and realist evaluation of a new organisational model for primary care practices in the canton of Vaud, Switzerland

INTRODUCTION

Continuity of care, especially for patients with complex needs, is a major challenge for healthcare systems in many high-income countries, including Switzerland. Since 2015, a collaborative project between Unisanté-Department of Family Medicine (DMF), some general practitioners (GPs) and canton of Vaud's public health authorities has sought to develop a new organisational model for the provision of primary care to ensure better care coordination and to provide adapted care deliveries to patients' healthcare needs. The model's main component is the addition of a primary care nurse to GPs practices. Three additional tools are individualised patient care plans, electronic medical records and patient empanelment. To assess this model, a 2-year pilot study has begun in nine GPs' practices in the canton. This paper presents the protocol for an evaluation of the implementation and effectiveness of the new organisational model.

METHOD AND ANALYSIS

We will conduct a before-and-after study using a mixed-methods and a realist approach. First, we will use quantitative and qualitative data to assess the new organisational model's implementation (feasibility, fidelity, acceptability and costs) and effectiveness (healthcare services use, patient experience, staff experience and patient-level costs). Combining this data with focus group data will enable a realist evaluation of the pilot project, which will help understand the elements of context and mechanism that affect implementation.

ETHICS AND DISSEMINATION

The evaluation will inform the canton of Vaud's health authorities about the limits of and perspectives for this organisational model. All results will also be made available to the practices and the patients involved. At the end of the project, we will propose organisational adaptations and a sustainable financial model for extending the model to other practices in the canton and potentially to the national level.The canton of Vaud's Human Research Ethics Committee approved the study, and Data Protection and Information Law Authority gave a favourable opinion concerning data processing procedures.

Diagnostic accuracy of X-ray versus CT in COVID-19: a propensity-matched database study

OBJECTIVES

To identify the diagnostic accuracy of common imaging modalities, chest X-ray (CXR) and CT, for diagnosis of COVID-19 in the general emergency population in the UK and to find the association between imaging features and outcomes in these patients.

DESIGN

Retrospective analysis of electronic patient records.

SETTING

Tertiary academic health science centre and designated centre for high consequence infectious diseases in London, UK.

PARTICIPANTS

1198 patients who attended the emergency department with paired reverse transcriptase PCR (RT-PCR) swabs for SARS-CoV-2 and CXR between 16 March and 16 April 2020.

MAIN OUTCOME MEASURES

Sensitivity and specificity of CXR and CT for diagnosis of COVID-19 using the British Society of Thoracic Imaging reporting templates. Reference standard was any RT-PCR positive naso-oropharyngeal swab within 30 days of attendance. ORs of CXR in association with vital signs, laboratory values and 30-day outcomes were calculated.

RESULTS

Sensitivity and specificity of CXR for COVID-19 diagnosis were 0.56 (95% CI 0.51 to 0.60) and 0.60 (95% CI 0.54 to 0.65), respectively. For CT scans, these were 0.85 (95% CI 0.79 to 0.90) and 0.50 (95% CI 0.41 to 0.60), respectively. This gave a statistically significant mean increase in sensitivity with CT of 29% (95% CI 19% to 38%, p<0.0001) compared with CXR. Specificity was not significantly different between the two modalities.CXR findings were not statistically significantly or clinically meaningfully associated with vital signs, laboratory parameters or 30-day outcomes.

CONCLUSIONS

CT has substantially improved diagnostic performance over CXR in COVID-19. CT should be strongly considered in the initial assessment for suspected COVID-19. This gives potential for increased sensitivity and considerably faster turnaround time, where capacity allows and balanced against excess radiation exposure risk.

Reproductive patterns, pregnancy outcomes and parental leave practices of women physicians in Ontario, Canada: the Dr Mom Cohort Study protocol

INTRODUCTION

Surveys and qualitative studies suggest that women physicians may delay childbearing, be at increased risk of adverse peripartum complications when they do become pregnant, and face discrimination and lower earnings as a result of parenthood. Observational studies enrolling large, representative samples of women physicians are needed to accurately evaluate their reproductive patterns, pregnancy outcomes, parental leave practices and earnings. This protocol provides a detailed research plan for such studies.

METHODS AND ANALYSIS

The Dr Mom Cohort Study encompasses a series of retrospective observational studies of women physicians in Ontario, Canada. All practising physicians in Ontario are registered with the College of Physicians and Surgeons of Ontario (CPSO). By linking a dataset of physicians from the CPSO to existing provincial administrative databases, which hold health data and physician billing records, we will be able to retrospectively assess the healthcare utilisation, work practices and pregnancy outcomes of women physicians at the population level. Specific outcomes of interest include: (1) rates and timing of pregnancy; (2) pregnancy-related care and complications; and (3) duration of parental leave and subsequent earnings, each of which will be evaluated with regression methods appropriate to the form of the outcome. We estimate that, at minimum, 5000 women physicians will be eligible for inclusion.

ETHICS AND DISSEMINATION

This protocol has been approved by the Research Ethics Board at St. Michael's Hospital in Toronto, Ontario, Canada (#18-248). We will disseminate findings through several peer-reviewed publications, presentations at national and international meetings, and engagement of physicians, residency programmes, department heads and medical societies.

Electronic health records (EHR) simulation-based training: a scoping review protocol

INTRODUCTION

Effective electronic health record (EHR)-based training interventions facilitate improved EHR use for healthcare providers. One such training intervention is simulation-based training that emphasises learning actual tasks through experimentation in a risk-free environment without negative patient outcomes. EHR-specific simulation-based training can be employed to improve EHR use, thereby enhancing healthcare providers' skills and behaviours. Despite the potential advantages of this type of training, no study has identified and mapped the available evidence. To fill that gap, this scoping review will synthesise the current state of literature on EHR simulation-based training.

METHODS AND ANALYSIS

The Arksey and O'Malley methodological framework will be employed. Three databases (PubMed, Embase and Cumulative Index to Nursing and Allied Health Literature) will be searched for published articles. ProQuest and Google Scholar will be searched to identify unpublished articles. Databases will be searched from inception to 29 January 2020. Only articles written in English, randomised control trials, cohort studies, cross-sectional studies and case-control studies will be considered for inclusion. Two reviewers will independently screen titles and abstracts against inclusion and exclusion criteria. Then, they will review full texts to determine articles for final inclusion. Citation chaining will be conducted to manually screen references of all included studies to identify additional studies not found by the search. A data abstraction form with relevant characteristics will be developed to help address the research question. Descriptive numerical analysis will be used to describe characteristics of included studies. Based on the extracted data, research evidence of EHR simulation-based training will be synthesised.

ETHICS AND DISSEMINATION

Since no primary data will be collected, there will be no formal ethical review. Research findings will be disseminated through publications, presentations and meetings with relevant stakeholders.