Evaluation of a virtual interprofessional oral-systemic health simulation experience in nursing, dentistry, medicine, and pharmacy education

PURPOSE

The annual teaching oral-systemic health (TOSH) virtual clinical simulation and case study activity exposes interprofessional teams of nurse practitioner, nurse midwifery, dental, medical, and pharmacy students to a virtual clinical simulation experience that uses oral-systemic health as a clinical exemplar for promoting interprofessional core competencies. The present study examines changes in participating students' self-reported interprofessional competencies following participation in virtual TOSH from 2020 to 2022. These findings are also compared to those from in-person TOSH (2019) to examine the equivalence of student outcomes of both the in-person and virtual programs.

METHODS

A pre- and post-test evaluation design was used to examine the effectiveness of exposure to the TOSH program on self-reported attainment of interprofessional competencies for participating students using the interprofessional collaborative competency attainment scale.

RESULTS

Analysis of pre- and post-surveys demonstrated statistically significant improvement in students' self-rated interprofessional experience competencies following the virtual TOSH program, which aligns with results from the in-person cohorts. Similar findings between the in-person and virtual cohorts indicated no statistically significant difference between the two formats.

CONCLUSION

These findings demonstrate the success of TOSH in promoting attainment of interprofessional competencies among future health professionals. We encourage administrators and faculty who lead health professional programs to take advantage of using virtual simulations as an integral component of interprofessional oral health clinical experiences where students from different health professions learn from and about each other in assessing and treating patients across the lifespan.

Validation of the Interprofessional Collaborative Competency Attainment Survey (ICCAS) retrospective pre-test measures

Establishing the effectiveness of IPE experiences is essential, and current assessment measures may be subject to various types of bias. The Interprofessional Collaborative Competency Attainment Survey (ICCAS) is administered after the learning experience as retrospective pretest and posttest measures of perceived collaborative practice skills. Because the ICCAS does not have an actual pretest, there are potential risks of recall bias and social desirability bias. To address these concerns, Jackson (2017) proposed conducting a true ICCAS pretest before the learning experience and examining the differences between the true and retrospective pretest scores and the differences between these pretest and posttest scores. This study design was implemented for two in-person Interprofessional forums conducted in the Fall (N = 745) and following Spring (N = 599) semesters. Students from 11 (Fall) and 12 (Spring) health professions education programs were included. True ICCAS pretest scores did not significantly differ from the retrospective pretest scores in either sample, although the effect sizes for pretest to posttest gains were slightly smaller for the true pretest scores. These results support and provide confidence for using the standard ICCAS administration methodology by demonstrating the administration methodology is not adversely impacted by recall or social desirability biases.

Education without walls: Using a street medicine program to provide real-world interprofessional learning

Interprofessional education (IPE) is a core component of the curricula for many healthcare and social work training programs and has been shown to increase student self-efficacy, communication skills, and attitudes toward other professions. Street medicine programs expand options for teaching interprofessional, team-based care of vulnerable populations, such as those experiencing homelessness. Street Medicine Phoenix is an interprofessional team of health professions students and faculty that provides outreach to Phoenix's homeless population. This study demonstrates the impact of volunteering in our street medicine program on the perceived development of interprofessional skills and behaviors. Volunteer teams, with representatives from medicine, nursing, social work, physical therapy, occupational therapy, public health, and undergraduate studies, completed the Interprofessional Collaborative Competencies Attainment Survey (ICCAS) before and after semester-long, monthly outreach events. Results demonstrate statistically significant improvements in overall ICCAS scores for all volunteers, but there was no relationship between number of shifts completed and ICCAS score improvement. Based on these findings, street medicine programs could be considered as an option for providing interprofessional learning to students in healthcare and social work degree programs. Street medicine outreach can supplement didactic and simulation skill-building activities in the IPE curricula with point of care, real-world experiential learning.

Assessing the assessment: a comparison of the IPASS and ICCAS to measure change in interprofessional competencies following a large-scale interprofessional forum

Measuring the effectiveness of interprofessional education (IPE) experiences is essential but challenging. Surveying learners before (pretest) and after (posttest) an IPE experience may result in minimal change due to response shift bias. Retrospective pretest/posttest assessment may ameliorate response shift bias but may also result in inflated change scores due to social desirability bias. We studied a cohort of 675 students from 12 health professions who completed the Interprofessional Attitudes Scale (IPAS) within the 4 weeks before (pretest) and the 3 weeks after (posttest) an IPE forum and completed the Interprofessional Collaborative Competency Attainment Survey (ICCAS) within the 3 weeks after the forum as a retrospective pretest/posttest. We found higher scores on the pretest IPAS than the retrospective pretest ICCAS and greater change in scores on the ICCAS than the IPAS, indicating potential response shift and social desirability biases. Furthermore, we found few significant correlations between change scores in subscales of the two tests, but a high number of strong and significant correlation among the ICCAS subscale change scores. Our results indicate the timing of pretest administration may impact change scores or that subscales of IPAS may be more unique than those of ICCAS. These findings suggest that educators should consider the potential impact of response shift and social desirability biases when interpreting results of the IPAS and ICCAS in response to an IPE learning experience.

Evidence of validity for the Norwegian version of the interprofessional collaborative competency attainment survey (ICCAS)

This was a validation study of the Norwegian version of The Interprofessional Collaborative Competency Attainment Survey (ICCAS). ICCAS consists of 20 retrospective pre- and post-questions, where respondents rate their agreement with regard to self-assessed competencies after participating in interprofessional education courses. It has been validated across various settings. The questionnaire was translated using the back-translation technique. We investigated evidence of validity regarding content, response process, and internal structure. Data were obtained from health and social care students (n = 1440, response rate 42.8%) participating in 12 different interprofessional courses in seven education institutions in Norway using a cross-sectional design. Exploratory factor analysis indicated one retracted factor for pre-scores and one retracted factor for post-scores. High McDonald's omega values indicated good internal consistency. Item deletion did not improve the scale's overall consistency on pre- or post-scores. We observed higher mean post-scores than pre-scores with moderate-to-large effect sizes, indicating a positive change in self-assessed interprofessional capabilities after training. Our findings indicate that the Norwegian version of ICCAS is a valid tool that may be implemented across a wide range of interprofessional education courses. Finally, our findings support earlier recommendations that ICCAS should be analyzed at an overall level to address change in interprofessional capabilities.

A team-based learning approach to interprofessional education of medical and pharmacy students

BACKGROUND

As collaborative team-based healthcare expands, there is a need for effective interprofessional education (IPE). Although the desired outcomes of IPE are defined by the Interprofessional Education Collaborative (IPEC), resources often limit IPE implementation. The purpose of this study is to assess the effectiveness of a novel interprofessional activity in improving health professions students' interprofessional competencies using team-based learning (TBL).

INTERPROFESSIONAL EDUCATION ACTIVITY

Teams of second year pharmacy and medical students participated in a novel IPE session targeting roles and responsibilities. This activity was designed and implemented by a small number of faculty and used TBL to educate a large number of students using limited resources. Class averages for individual and team readiness assurance test (iRAT/tRAT) scores were collected, and students were invited to complete the Interprofessional Collaborative Competencies Attainment Survey (ICCAS) to evaluate the effectiveness of the activity.

DISCUSSION

On average, tRAT scores were 20% higher than iRAT scores. While there was significant improvement for all items on the ICCAS, questions within the roles and responsibilities domain of the ICCAS were most affected.

IMPLICATIONS

This novel IPE activity was successful in teaching a large group of professional students in the targeted domain of roles and responsibilities in a single session. This activity was a rich experience in which students learned together using limited resources which can be easily replicated at other institutions to help professional students gain proficiency in interprofessional competencies.