Refinement of a training concept for tutors in problem-based learning

Does prior knowledge affect interaction dynamics and learning achievement in digital problem-based learning? A pilot study

Objective

Previous research on problem-based learning (PBL) describes that videotaped observations develop meaningful insights into cognitive processes in tutorial groups. Analysis regarding the amount of prior knowledge on learning achievement has not been investigated in medical education so far, although both are key factors of PBL success. Thus, we intended to analyse videos of digital problem-based learning (dPBL) sessions, focusing on knowledge acquisition and interaction dynamics among groups with different levels of prior knowledge to reveal any distinctions.

Methods

This study employed a pilot design by dividing 60 dental students into twelve subgroups with less or more prior knowledge, determined by a pre-semester multiple choice test (MCQ). The groups engaged in videotaped dPBL cases, which were examined regarding group interactions and tutor effectiveness. The learning achievement was assessed through a post-semester MCQ, an oral and practical exam.

Results

The video analysis showed that dPBL groups with less prior knowledge achieved significantly higher tutor effectiveness and group interaction utterances, but that the percentage of time in which utterances occurred was similar in both groups. Related to the MCQ results, the students with less prior knowledge learned four times more than those with profound previous abilities, but no significant difference was found in the results of the oral exam and practical exam.

Conclusions

The interaction dynamics in dPBL depend on the group's amount of prior knowledge. Especially groups including participants with less prior knowledge seemed to benefit from dPBL in comparison to groups with more prior knowledge. The dPBL groups acquired knowledge in different ways during the courses but, finally, all students arrived at a similar level of knowledge.

Does the tutors' academic background influence the learning objectives in problem-based learning?

Background: Problem-based learning (PBL) is an essential element of the curriculum of the Medical University of Vienna (MUV) and is performed in an eight steps model with: clarifying, defining, analysing, shifting & sorting, identifying learning objectives, going to learn and coming back to talk and feedback. With an annual intake of up to 740 students the MUV has to recruit PBL tutors from various academic backgrounds including undergraduate near-peer students. Therefore, we were interested to see whether a tutor's academic background had an influence on the resulting PBL sessions as reflected by the percentage of learning objectives (LOs) which were actually achieved in relation to the intended LOs. Methods: For each PBL session "intended learning objectives" (ILOs) were defined. ILOs were communicated to all tutors by means of PBL session guides in order to provide homogenous learning opportunities to all students. However, it was not mandatory to reach all ILOs. The PBL coordination regarded a range of two thirds to three quarters of ILOs as a desirable goal. For analysis we retrieved data concerning ILOs, characteristics of tutors and PBL groups from the institution's PBL quality assurance system. Results: From 2012-2014, 216 PBL groups were facilitated by 106 tutors with different academic backgrounds. On average, 70.8% (95% CI: 69.2-72.5%) of the ILOs were achieved; MUV clinicians reached 74.3% (70.8-77.8%), MUV non-clinicians 74.2% (71.7-76.6%), external faculty (clinicians and non-clinicians) 68.6% (64.4-72.8%), and near-peer students 64.7% (61.8-67.7%). Statistically significant differences were found between near-peer students and MUV clinicians (p<.001) as well as MUV non-clinicians (p<.001). Conclusions: ILOs were reached within a satisfactory range. However, groups taught by near-peer students reached significantly fewer ILOs than groups taught by MUV faculty tutors. This finding raises the question whether tutor training for near-peer students should be intensified. Also, further research is needed to explore the group dynamics of student-led PBL groups.