Measuring social accountability in health professional education: development and international pilot testing of an evaluation framework

Education for rural practice in rural practice

Despite the substantial differences between developing and developed countries, access is the major rural health issue. Studies in many countries have shown that the three factors most strongly associated with entering rural practice are: (1) a rural upbringing; (2) positive clinical and educational experiences in rural settings as part of undergraduate medical education; (3) targeted training for rural practice at the postgraduate level. This paper presents examples of successful rural primary care-based education in different parts of the world, then introduces the Wonca Rural Medical Education Guidebook which was launched at the 2014 Wonca Rural Health World Conference and concludes with a brief report of the 2015 conference held in Dubrovnik Croatia.

Rural Health Care Access and Policy in Developing Countries

Compared to their urban counterparts, rural and remote inhabitants experience lower life expectancy and poorer health status. Nowhere is the worldwide shortage of health professionals more pronounced than in rural areas of developing countries. Sub-Saharan Africa (SSA) includes a disproportionately large number of developing countries; therefore, this article explores SSA in depth as an example. Using the conceptual framework of access to primary health care, sustainable rural health service models, rural health workforce supply, and policy implications, this article presents a review of the academic and gray literature as the basis for recommendations designed to achieve greater health equity. An alternative international standard for health professional education is recommended. Decision makers should draw upon the expertise of communities to identify community-specific health priorities and should build capacity to enable the recruitment and training of local students from underserviced areas to deliver quality health care in rural community settings.

Putting communities in the driver's seat: the realities of community-engaged medical education

"Community" has featured in the discourse about medical education for over half a century. This discourse has explored relationships between medical education programs and communities in community-oriented medical education and community-based medical education and, in recent years, has extended to community-engaged medical education (CEME). This Perspective explores the developing focus on "community" in medical education, describes CEME as a concept, and presents examples of CEME in action at Flinders University School of Medicine (Australia), the Northern Ontario School of Medicine (Canada), and Ateneo de Zamboanga University School of Medicine (Philippines).The authors describe the ways in which CEME, which features active community participation, can improve medical education while meeting community needs and advancing national and international health equity agendas. They suggest that CEME can redefine student learning as taking place at the center of the partnership between communities and medical schools. They also consider the challenges of CEME and caution that criteria for community engagement must be sensitive to cultural variations and to the nature of the social contract in different sociocultural settings.The authors argue that CEME is effective in producing physicians who choose to practice in rural and underserved areas. Further research is required to demonstrate that CEME contributes to improved health, and ultimately health equity, for the populations served by the medical school.

Outcomes of the Northern Ontario School of Medicine's distributed medical education programmes: protocol for a longitudinal comparative multicohort study

INTRODUCTION

The Northern Ontario School of Medicine (NOSM) has a social accountability mandate to serve the healthcare needs of the people of Northern Ontario, Canada. A multiyear, multimethod tracking study of medical students and postgraduate residents is being conducted by the Centre for Rural and Northern Health Research (CRaNHR) in conjunction with NOSM starting in 2005 when NOSM first enrolled students. The objective is to understand how NOSM's selection criteria and medical education programmes set in rural and northern communities affect early career decision-making by physicians with respect to their choice of medical discipline, practice location, medical services and procedures, inclusion of medically underserved patient populations and practice structure.

METHODS AND ANALYSIS

This prospective comparative longitudinal study follows multiple cohorts from entry into medical education programmes at the undergraduate (UG) level (56-64 students per year at NOSM) or postgraduate (PG) level (40-60 residents per year at NOSM, including UGs from other medical schools and 30-40 NOSM UGs who go to other schools for their residency training) and continues at least 5 years into independent practice. The study compares learners who experience NOSM UG and NOSM PG education with those who experience NOSM UG education alone or NOSM PG education alone. Within these groups, the study also compares learners in family medicine with those in other specialties. Data will be analysed using descriptive statistics, χ(2) tests, logistic regression, and hierarchical log-linear models.

ETHICS AND DISSEMINATION

Ethical approval was granted by the Research Ethics Boards of Laurentian University (REB #2010-08-03 and #2012-01-09) and Lakehead University (REB #031 11-12 Romeo File #1462056). Results will be published in peer-reviewed scientific journals, presented at one or more scientific conferences, and shared with policymakers and decision-makers and the public through 4-page research summaries and social media such as Twitter (@CRaNHR, @NOSM) or Facebook.

Designing an evaluation framework for WFME basic standards for medical education

PURPOSE

To create an evaluation plan for the World Federation for Medical Education (WFME) accreditation standards for basic medical education.

METHODS

We conceptualized the 100 basic standards from "Basic Medical Education: WFME Global Standards for Quality Improvement: The 2012 Revision" as medical education program objectives. Standards were simplified into evaluable items, which were then categorized as inputs, processes, outputs and/or outcomes to generate a logic model and corresponding plan for data collection.

RESULTS

WFME standards posed significant challenges to evaluation due to complex wording, inconsistent formatting and lack of existing assessment tools. Our resulting logic model contained 244 items. Standard B 5.1.1 separated into 24 items, the most for any single standard. A large proportion of items (40%) required evaluation of more than one input, process, output and/or outcome. Only one standard (B 3.2.2) was interpreted as requiring evaluation of a program outcome.

CONCLUSIONS

Current WFME standards are difficult to use for evaluation planning. Our analysis may guide adaptation and revision of standards to make them more evaluable. Our logic model and data collection plan may be useful to medical schools planning an institutional self-review and to accrediting authorities wanting to provide guidance to schools under their purview.

Impact of selection strategies on representation of underserved populations and intention to practise: international findings

CONTEXT

Socially accountable medical schools aim to reduce health inequalities by training workforces responsive to the priority health needs of underserved communities. One key strategy involves recruiting students from underserved and unequally represented communities on the basis that they may be more likely to return and address local health priorities. This study describes the impacts of different selection strategies of medical schools that aspire to social accountability on the presence of students from underserved communities in their medical education programmes and on student practice intentions.

METHODS

A cross-sectional questionnaire was administered to students starting medical education in five institutions with a social accountability mandate in five different countries. The questionnaire assessed students' background characteristics, rurality of background, and practice intentions (location, discipline of practice and population to be served). The results were compared with the characteristics of students entering medical education in schools with standard selection procedures, and with publicly available socio-economic data.

RESULTS

The selection processes of all five schools included strategies that extended beyond the assessment of academic achievement. Four distinct strategies were identified: the quota system; selection based on personal attributes; community involvement, and school marketing strategies. Questionnaire data from 944 students showed that students at the five schools were more likely to be of non-urban origin, of lower socio-economic status and to come from underserved groups. A total of 407 of 810 (50.2%) students indicated an intention to practise in a non-urban area after graduation and the likelihood of this increased with increasing rurality of primary schooling (p = 0.000). Those of rural origin were statistically less likely to express an intention to work abroad (p = 0.003).

CONCLUSIONS

Selection strategies to ensure that members of underserved communities can pursue medical careers can be effective in achieving a fair and equitable representation of underserved communities within the student body. Such strategies may contribute to a diverse medical student body with strong intentions to work with underserved populations.

Training socially responsive health care graduates: is service learning an effective educational approach?

BACKGROUND

Health care educators strive to train graduates who are socially responsive and can act as "change agents" for communities they serve. Service learning (SL) is increasingly being used to teach the social aspects of health care and develop students' social responsiveness. However, the effectiveness of SL as an educational intervention has not been established.

AIM

To assess the evidence for the effectiveness of SL.

METHOD

Seven electronic databases were searched up to 2012 and included all articles on SL for pre-professional health care students. Hand searching was also conducted.

RESULTS

A total of 1485 articles were identified, 53 fulfilled the search and quality appraisal criteria and were reviewed across six domains of potential SL effects: (i) personal and interpersonal development; (ii) understanding and applying knowledge; (iii) engagement, curiosity and reflective practice; (iv) critical thinking; (v) perspective transformation and (vi) citizenship.

CONCLUSION

While SL experiences appear highly valued by educators and students the effectiveness of SL remains unclear. SL is different from other forms of experiential learning because it explicitly aims to establish reciprocity between all partners and increase students' social responsiveness. Impact studies based on the interpretative paradigm, aligned with the principles of social accountability and including all stakeholder perspectives are necessary.

Transforming health professional education through social accountability: Canada's Northern Ontario School of Medicine

BACKGROUND

The Northern Ontario School of Medicine (NOSM) has a social accountability mandate to contribute to improving the health of the people and communities of Northern Ontario. NOSM recruits students from Northern Ontario or similar backgrounds and provides Distributed Community Engaged Learning in over 70 clinical and community settings located in the region, a vast underserved rural part of Canada.

METHODS

NOSM and the Centre for Rural and Northern Health Research (CRaNHR) used mixed methods studies to track NOSM medical learners and dietetic interns, and to assess the socioeconomic impact of NOSM.

RESULTS

Ninety-one percent of all MD students come from Northern Ontario with substantial inclusion of Aboriginal (7%) and Francophone (22%) students. Sixty-one percent of MD graduates have chosen family practice (predominantly rural) training. The socioeconomic impact of NOSM included new economic activity, more than double the School's budget; enhanced retention and recruitment for the universities and hospital/health services; and a sense of empowerment among community participants attributable in large part to NOSM.

DISCUSSION

There are signs that NOSM is successful in graduating health professionals who have the skills and desire to practice in rural/remote communities and that NOSM is having a largely positive socioeconomic impact on Northern Ontario.