Development and validation of inventory tool to evaluate social accountability principles in case scenarios used in problem-based curriculum (Social accountability inventory for PBL)

Exploring the development of a framework of social accountability standards for healthcare service delivery: a qualitative multipart, multimethods process

OBJECTIVES

Social accountability is an equity-oriented health policy strategy that requires institutions to focus on local population needs. This strategy is well established in health professional education, but there is limited understanding of its application in healthcare service delivery. Building on what is known in the education setting, this study aimed to explore the development of a framework of comprehensive, evidence-based social accountability standards for healthcare service delivery institutions.

DESIGN

This qualitative, multipart, multimethods study consisted of a modified Delphi process guided by an evidence-based social accountability tool for health professional education and complementary methods including developmental evaluation and a review of select literature to capture emerging evidence and contextual relevance.

SETTING

The study took place in Northern Ontario, Canada at a medical school and a tertiary, regional academic health sciences centre that are both grounded in social accountability.

PARTICIPANTS

Eight expert participants from diverse, multidisciplinary backgrounds, including a patient advocate, were purposefully recruited from both institutions, enrolled and seven completed the study.

MAIN OUTCOME

The resulting framework of social accountability standards is organised into 4 major sections that capture broad and critical concepts; 17 key component reflective questions that address key themes; 39 aspirations that describe objective standards and 197 indicators linked to specific expectations.

RESULTS

Three modified Delphi rounds were completed producing a framework of consensus derived standards. Developmental evaluation helped identify facilitators, barriers and provided real-time feedback to the study's processes and content. The literature reviewed identified 10 new concepts and 43 amendments.

CONCLUSION

This study highlights the development of a comprehensive, evidence-based framework of social accountability standards for healthcare service delivery institutions. Future studies will aim to evaluate the application of these standards to guide equity-oriented social accountability health policy strategies in healthcare service delivery.

Validation of IFMSA social accountability assessment tool: exploratory and confirmatory factor analysis

BACKGROUND

IFMSA Social Accountability Assessment Tool has been developed for medical students by medical students to assess medical schools. However, its psychometric characteristics are unknown since it was developed without any analysis. We aimed to reveal its reliability and validity.

METHODS

1122 undergraduate medical students from various years in Gazi University Faculty of Medicine have participated in the study. They have answered the Turkish version of IFMSA Social Accountability Assessment Tool created through a translation process by experts. Exploratory and confirmatory factor analyses were carried out.

RESULTS

Exploratory factor analysis showed that factor loadings were between 0.46 and 0.73 for Factor 1, 0.68 and 0.87 for Factor 2. The two-factor model, which consists of "Community Centeredness" and "Socio-Demographic Characteristics", was evaluated through confirmatory factor analysis. The goodness-of-fit statistics of the model showed well-fit: CMIN/df 4.46, GFI 0.96, CFI 0.95, RMSEA 0.05, SRMR 0.03. Standardized regression weights were between 0.43 and 0.77.

CONCLUSION

The tool has acceptable psychometric characteristics, with good reliability and validity. It could be considered as a point of departure for the change in the way of being socially accountable since it enables medical students to explore the weak areas of their medical schools in terms of social accountability.

Mapping health, social and health system issues and applying a social accountability inventory to a problem based learning medical curriculum

Social accountability is a powerful concept. It is applied to medical education to encourage future doctors to take action to address health inequalities and overlooked health needs of disadvantaged populations. Problem-based learning (PBL) provides an ideal setting to teach medical students about these topics. The objective of this study is to explore how well the components of social accountability are covered in a pre-clinical PBL medical curriculum and to determine the usefulness of an adapted validated social accountability framework. We identified Irish health needs and social issues through a literature review. The retrieved documents were aligned to four values (relevance, equity, cost-effectiveness and quality) from a validated social accountability inventory, to generate a map of social accountability values present in the Irish health system and population. We then used the adapted validated social accountability inventory to evaluate the content of the PBL medical curriculum at an Irish medical school. We identified 45 documents, which upon analysis lead to the identification of health and social issues related to social accountability. 66 pre-clinical PBL cases included demographic, health and psychosocial issues similar to the local population. Analysing along the four social accountability values, the PBL cases demonstrated room for improvement in the equity and relevance domains. Topics for expansion are Traveller health, LGBTI health, alcohol use, climate change and more. Medical educators can use the paper as an example of how to apply this methodology to evaluate PBL cases. Adapting and applying a validated framework is a useful pedagogical exercise to understand established societal values related to social accountability to inform a medical curriculum. We identified opportunities to improve the PBL cases to depict emerging global and social issues.

Evaluation of the integration of social accountability values into medical education using a problem-based learning curriculum

BACKGROUND

Medical schools have the obligation to direct their education toward addressing the priority health concerns of the societies that they serve. The purpose of this study was to evaluate the integration of the concepts and values of social accountability into the case scenarios that are used in a problem-based learning (PBL) curriculum at a medical school in the United Arab Emirates (UAE).

METHODS

A validated "social accountability inventory for PBL" was used for examining 70 case scenarios in a problem-based learning (PBL) medical curriculum.

RESULTS

The findings of the study showed that patient gender and age were included in all the 70 case scenarios. Vast majority of the case scenarios had successfully integrated the social accountably values in addressing the following: the major health problems or social health concerns of the UAE (73%), the social determinants of health (70%), the contextual integration of medical professionalism (87%), the evolving roles of doctors in the health system (79%), the healthcare referral system based on the case complexity (73%), the involvement of different stakeholders in healthcare (87%), psychosocial issues rather than only the disease-oriented issues (80%) and the values of health promotion/prevention (59%) cases. On the other hand, the case scenarios were deficient in integrating other social accountability values that related to the importance of treatment cost-effectiveness (91%), consideration of the underserved, disadvantaged or vulnerable populations in the society (89%), patient's ethnicity (77%), multidisciplinary approach to patient management (67%), the socioeconomic statuses of patients (53%), the issues regarding the management of the health system (39%) respectively. There was variability in integrating the social accountability values in case scenarios across different units which are based on organ system.

CONCLUSION

Medical educators and healthcare leaders can use this valuable data to calibrate the curriculum content, especially when using a problem-based learning curriculum to integrate the values of social accountability such as relevance, quality, equity and cost-effectiveness to train the future generation of healthcare providers to be ready to address the ever-changing and diverse needs of the societies.