Is learning in problem-based learning cumulative?

Evaluation of problem-based learning in dental trauma education: An observational cohort study

BACKGROUND/AIM

Problem-based learning (PBL) allows higher thinking among dental students and has improved first-time pass-rates in predoctoral pediatric dentistry education. The aim of this retrospective observational cohort study was to evaluate the impact of PBL-based, traumatic dental injuries case discussions on predoctoral dental trauma education.

MATERIALS AND METHODS

Student performance and perceptions after receiving dental trauma curriculum with or without PBL-based dental trauma case discussions were evaluated. All the students challenged their simulated patient-based assessments. Three recall-based, objective structured clinical examinations, and critical thinking competencies assessed student knowledge about management of traumatic injuries affecting primary or permanent dentition including avulsion. The scores and number of attempts for each competency were compared between the study cohorts using t-tests. Student's self-perceived learning outcomes were measured through a voluntary, five-question survey. Mantel-Haenszel ordinal Chi-square tests were used to assess for differences in rates of agreement on survey responses from the students. Linear regression was used to assess effect of training on scores adjusting for student type (predoctoral or advanced standing). Pearson's correlations were used to assess association between scores. Significance was set at 0.05.

RESULTS

For the PBL cohort, there was a significant (p > 0.05) improvement in the first-time pass-rates and scores in three out of four competencies. A higher proportion of students in the PBL cohort perceived that their dental trauma education improved their radiographic and diagnostic skills compared to the cohort that did not receive PBL (p > 0.05). There was no correlation between recall-memory versus critical thinking competencies (r < 0.5).

CONCLUSION

The PBL-based dental trauma case discussion had a positive impact on predoctoral student learning and perceived benefits while managing simulated traumatic dental injuries. Due to a lack of correlation between recall-memory and critical thinking assessments, evaluation of predoctoral student's dental trauma competencies should involve multi-model assessment.

Team-based learning (TBL): Each phase matters! An empirical study to explore the importance of each phase of TBL

CONTEXT

In Team Based Learning (TBL), it is, based on theory, assumed that knowledge development in each phase contributes to the subsequent phase and to learning performance. However, there is no empirical evidence for this assumption.

AIM

In order to find support for the relation between TBL and the underlying theory, we determined to what extent each phase of TBL is associated with the knowledge development in the next phase and with the total learning performance.

METHODS

We measured the scientific concepts recalled by 56 second-year undergraduate medical students before TBL, after each of the three phases and after TBL. We used multivariate regression analysis to determine the statistical association between the phases as well as the total learning performance.

RESULTS

Results showed that in each phase, students produced new concepts in addition to those previously recalled. Regression models showed statistically significant explained variance ranging from 0.19 to 0.26, between the three phases and the total learning performance.

DISCUSSION

Each phase of the TBL is significantly associated with knowledge development in the subsequent phase and with the total learning performance, and therefore matters. This study contributes to the scientific underpinning of TBL and offers leads to more elaborate research and interventions to improve TBL.

Discovering Entrepreneurship Competencies through Problem-Based Learning in Higher Education Students

The increase in student engagement in the learning process has driven educators to use more dynamic pedagogical methodologies. Several studies have shown evidence of increased interest in learning when real-world problems are integrated into the learning environment. This paper presents the competencies developed by higher education students through application of the problem-based learning (PBL) methodology in higher education courses. The research begins with the identification of a set of competencies developed by higher education students in other studies developed and reported in the last five years and includes them in a survey to analyze the level of development of those competencies when problem-based learning is applied in university courses. To identify the competencies developed by applying the problem-based learning methodology, the research employed a document analysis and a survey of the students that participated in the experimental application. The research questions “What are the competencies developed by students in problem-based learning?” and “Are the competencies identified by the students sufficiently learned in universities?” guided the study. The competencies found by the students were identified through a questionnaire given as an online survey to 76 students. The key outcome of the research is the identification in the bachelor courses of the competencies perceived as essential by students participating in the application of PBL in terms of their advancement.

The Effects of Sequencing Strategies in Teaching Methods on Nursing Students’ Knowledge Acquisition and Knowledge Retention

Background: No existing research has determined which teaching sequence strategy is the best for nursing students. Purpose: To find out which sequence is most effective in knowledge acquisition and knowledge retention and to further verify knowledge acquisition between problem-based learning (PBL) and lecture-based learning (LBL). Methods: This was a quasi-experimental design with a comparison of two nursing student groups selected from students in their final program year who were invited to participate. Generalized estimating equation was used to compare Group I (LBL-PBL-clinical practicum) and Group II (PBL-LBL-clinical practicum) by using knowledge acquisition and knowledge retention as outcome variables. Findings: Fifty-six senior students joined this study. Group I was significantly better than Group II on both knowledge acquisition (β = 7.05, p = 0.04) and knowledge retention (β = 9.40, p = 0.03). Discussion: The sequence of LBL-PBL-clinical practicum or policy of allowing practicum and courses in the same semester might be the best strategy to enhance knowledge retention.

Dyadic explanations during preparatory self-study enhance learning: A randomised controlled study

OBJECTIVES

The objective of the present study was to investigate to which extent preparatory self-study can be improved by encouraging students to engage in individual self-explanations or dyadic explanations (ie in pairs). Individual self-explanations refer to an act of metacognition in which students, after having processed a certain amount of information, attempt to explain their understanding to themselves of what was just learned. Dyadic explanations refer to the same process, but instead of explaining to oneself, the student explains his/her understanding to another student.

METHOD

An experiment was conducted in which 120 medical students studied a video-recorded lecture on the role of protein synthesis inhibition on memory reconsolidation. Participants were randomly allocated to one of four conditions: (1) a control condition in which they listened to the lecture once; (2) a control condition in which they listened to the lecture twice; (3) an experimental condition in which they had to listen to the lecture and provide self-explanations individually; and (4) an experimental condition in which they had to listen to the lecture and provide dyadic explanations. Participants' knowledge regarding the topic was measured three times: at the start and end of the experiment, and one week after the experiment to determine knowledge retention. Data were analysed by means of a 2 × 2 and 4 × 3 repeated-measures ANOVA.

RESULTS

The results suggest that participants who engaged in individual self- or dyadic explanations significantly outperformed participants in the two control conditions in terms of learning and retention (F = 5.67, Wilks Λ = 0.94, P = .019, η²  = 0.05). Moreover, the results suggest that dyadic explanations were more effective than individual self-explanations (F = 3.70, Wilks Λ = 0.83, P = .002, η²  = 0.09).

CONCLUSIONS

These outcomes suggest that encouraging students to work in pairs or in small teams to prepare for a learning event results in superior preparation and learning.

Perceptions of radiography students toward problem-based learning almost two decades after its introduction at Makerere University, Uganda

Introduction

Problem-based learning (PBL) has been reported to be a valuable student-centred learning approach across the globe. In PBL students first encounter a problem, which triggers discussion, followed by student-centred inquiry. Makerere University College of Health Sciences has been using PBL for radiography students since 2002. Over the years, the learning landscape may have changed, including the significant disruption of learning by the coronavirus disease 2019 global pandemic. The study aimed at exploring the perceptions of undergraduate radiography students about the PBL curriculum at Makerere University almost two decades after its introduction.

Methods

This exploratory qualitative study involved 18 radiography students sampled purposively, from whom data were gathered using focus group discussions. Thematic analysis was subsequently used.

Results

Three key themes emerged from the data: (1) quality of teaching, (2) curriculum efficiency, and (3) curriculum expectations and rating. All students were generally positive about the curriculum. Most agreed that the curriculum was efficient to a greater extent and had met their expectations and desired objectives. Students, however, faced challenges; for example, with limited learning resources during the learning process.

Conclusion

This study highlights the significant role of PBL in enhancing student's problem-solving, critical thinking, literature search, and, most of all, their practical skills. Prioritization of teaching based on practical relevance and learning objectives is of great importance. The radiography students believed that their curriculum program was generally beneficial to them; however, it was affected by limited resources and limited availability of teaching personnel, which needs to be addressed.

Facilitating learning of community-based rehabilitation through problem-based learning in higher education

BACKGROUND

The quality of community-based rehabilitation (CBR) personnel is one of the key factors that contributes to the success of CBR programs. Integrating knowledge and practical skills in various stages of the learning process is essential in community-based rehabilitation. Problem-based learning (PBL) is a pedagogical strategy that uses real-world situations as the basis for developing knowledge and problem-solving skills. Through PBL, learners are guided and facilitated in assuming active problem-solving roles in real-world situations. This study developed and tested a framework and a PBL protocol for use in teaching community-based rehabilitation (CBR) in higher education.

METHODS

Part I of this study focused on the development of a framework and a protocol for PBL. An initial framework for the development of this protocol was formed based on a review of relevant literature. Concrete guidelines were delineated to describe the application, process, and delivery of teaching and learning. PBL was implemented in three CBR related courses. Students were facilitated to learn CBR in passing various stages of PBL through a self-directed learning process. The cumulative efforts of each group were compiled, recorded, and displayed using e-portfolios. In Part II, the processes and outcomes of using this new learning mode were evaluated using a case study approach to examine the protocol's efficacy. Focus group interviews, a questionnaire, and a detailed examination of the e-portfolios were administered for evaluation.

RESULTS

One hundred thirty-three students from three CBR related courses were recruited. PBL was regarded as an effective, realistic and practical method that enables critical thinking in CBR. Practicality was addressed by covering context-related materials with the use of real cases or examples. Participants were actively engaged in the learning process and their CBR competence was enhanced.

CONCLUSIONS

Through the new protocol, the students were equipped with active learning, critical thinking, and problem-solving skills that should facilitate success in CBR.

Does PBL deliver constructive collaboration for students in interprofessional tutorial groups?

BACKGROUND

Training health professional students in teamwork is recognized as an important step to create interprofessional collaboration in the clinical workplace. Interprofessional problem-based learning (PBL) is one learning approach that has been proposed to provide students with the opportunity to develop the necessary skills to work collaboratively with various health professionals. This study aimed to explore the extent to which students in interprofessional tutorial groups demonstrate constructive collaboration during group discussions.

METHODS

Students (N = 52) from the Medical, Midwifery and Nursing programmes took part in the study. Video-recordings were made of interprofessional PBL discussions (N = 40) in five groups, eight videos per group. Over a period of 4 weeks, participants discussed four scenarios concerned with the reproductive system. The resulting 67 h of video data were analysed qualitatively. To ensure inter-rater reliability, two tutors assessed the students' constructive, collaborative activities using the Maastricht Peer-Activity Rating Scale (MPARS). Finally, to gain an understanding of students' perceptions of their performance and participation in the interprofessional PBL tutorial, we organized three uni-professional focus groups (FGs) at the end of pilot project.

RESULTS

The translated MPARS was reliable (Kappa coefficient 0.01-0.20 and p < 0.05). Students were actively involved in the discussion and contributed to a better understanding regardless of their professional background. Group members from different professions complemented one another in solving learning issues. They were open, feeling free to question and argue from the viewpoint of their own profession, and also understood their strengths and limitations. The statistical test of the scores for constructive and collaborative activities indicated a significant difference between students and the various healthcare professionals, p = 0.000, with medical students scoring highest on both activities. Focus groups further clarified some of the observed dynamics.

CONCLUSION

Implementing interprofessional PBL could motivate students to engage collaboratively in co-constructing knowledge to solve the patients' problem. Medical students scored highest on constructive and collaborative activities.

Technology in problem-based learning: helpful or hindrance?

Purpose

The purpose of this paper is to examine the relationship between student motivation and technology in the implementation of problem-based learning (PBL) in a technologically enhanced active learning classroom (ALC).

Design/methodology/approach

PBL was implemented in an undergraduate course in human osteology (n=49) at a large Canadian University. Numerous activities using the ALC technology were conducted to engage students in self-directed active learning. Students wrote critical self-reflections at the beginning of the course and with each PBL report. They completed a survey at the end of the course using a Likert scale that included written comments on their motivation toward different uses of technology.

Findings

Students generally had high motivation toward PBL at the end of the course. Their evaluation of the technology to support PBL was dependent on the activity. Students (88 percent) appreciated the use of an overhead camera to visualize anatomical elements, and short problem-solving exercises using the whiteboard but they negatively evaluated the real-time projection of PBL sessions through a discussion board (52 percent). Almost half of the class (43 percent) felt that technology was a hindrance to their learning process in PBL.

Originality/value

This study demonstrates the complex relationship between student motivation toward active learning, the learning environment, and technology. Instructors and students influence the learning environment through their conceptions of effective teaching. According to this framework, technology should be implemented not only according to the teaching method, but consider teaching conceptions and the learning environment.

Educational Intervention on Undergraduate Cancer Awareness and Self-Directed Learning

Traditional lecture-based learning (LBL) can increase cancer awareness in undergraduates. However, because of the rapidly changing knowledge base in medicine, undergraduates must develop skills required for lifelong self-directed learning (SDL). Problem-based learning (PBL) has been suggested as an SDL approach. This study used a nonequivalent control group with a pretest-posttest design for comparing PBL and LBL for their effectiveness in increasing cancer awareness and SDL among nonmedicine or nonnursing major undergraduates in a health-related general education course. Experimental groups 1 and 2 were instructed using PBL while the control group was instructed using LBL. Cancer educational programs were offered to experimental group 1 and the control group but not to experimental group 2. Among the 325 undergraduates who completed a questionnaire regarding cancer awareness and SDL in the pretest, 223 completed the 12-week follow-up survey of the posttest. Cancer awareness significantly improved between the pretest and posttest in the control group (P < 0.001). No significant difference in cancer awareness improvement was observed between experimental group 1 and the control group (P = 0.934). Cancer awareness improvement in experimental group 2 was significantly less than in the control group (P = 0.010). No statistically significant change in SDL was observed in the control group during the study (P = 0.897). However, the SDL of experimental groups 1 and 2 improved more significantly than that of the control group (P = 0.049 and 0.023, respectively). Therefore, PBL is an effective method of increasing cancer awareness and SDL in undergraduates.

Assessment test before the reporting phase of tutorial session in problem-based learning

PURPOSE

In our context, problem-based learning is not used in the preuniversity environment. Consequently, students have a great deal of difficulty adapting to this method, particularly regarding self-study before the reporting phase of a tutorial session. Accordingly, the aim of this study was to assess if the application of an assessment test (multiple choice questions) before the reporting phase of a tutorial session would improve the academic achievement of students at the preclinical stage of our medical course.

METHODS

A test consisting of five multiple choice questions, prepared by tutors of the module at hand and related to the problem-solving process of each tutorial session, was applied following the self-study phase and immediately before the reporting phase of all tutorial sessions. The questions were based on the previously established student learning goals. The assessment was applied to all modules from the fifth to the eighth semesters. The final scores achieved by students in the end-of-module tests were compared.

RESULTS

Overall, the mean test score was 65.2±0.7% before and 68.0±0.7% after the introduction of an assessment test before the reporting phase (P<0.05). Students in the sixth semester scored 67.6±1.6% compared to 63.9±2.2% when they were in the fifth semester (P<0.05). Students in the seventh semester achieved a similar score to their sixth semester score (64.6±2.6% vs 63.3±2%, respectively, P>0.05). Students in the eighth semester scored 71.8±2.3% compared to 70±2% when they were in the seventh semester (P>0.05).

CONCLUSION

In our medical course, the application of an assessment test (a multiple choice test) before the reporting phase of the problem-based learning tutorial process increases the overall academic achievement of students, especially of those in the sixth semester in comparison with when they were in the fifth semester.

Group interaction in problem-based learning tutorials: a systematic review

INTRODUCTION

This review aimed at identifying studies on group interaction in problem-based learning (PBL) and elucidate methods used, factors affecting group interaction and the relationship between interaction and student's learning.

MATERIALS AND METHODS

PubMed, EMBASE, PsycINFO and HighWire were searched (January 1999 to June 2013) using a combination of pre-specified search terms. The search words were also used in searching nine journals in dental and medical education. Also edited research books on PBL were searched. Both qualitative and descriptive studies of group interaction were selected and critically appraised.

RESULTS

Finally, 42 of 10,606 papers were included (35 journal articles and seven from research books). The materials used in assessing group interaction varied depending on the methodology design. Forty-three percent of the studies used video recording to evaluate group interaction. Other studies used indirect approaches such as focus groups, interviews and questionnaires. Factors affecting group interactions were students' and tutors' perceptions, tutor's subject-matter expertise, training students, tutor's group dynamics. There was no conclusive evidence about the impact of interaction in PBL on learning. Most studies were from medicine (64%), and 35 papers were published in the last 10 years. The majority of studies were conducted in Europe, North America and Asia.

CONCLUSIONS

Although there is a progressive increase in publications on PBL group interaction during the last 10 years, there are knowledge gaps and deficiencies in this area and most studies are lacking solid theoretical basis and are descriptive. There is a deficiency in the literature in this area from dentistry and other allied health disciplines.

Enhancing students' learning in problem based learning: validation of a self-assessment scale for active learning and critical thinking

BACKGROUND

Problem based learning (PBL) is a powerful learning activity but fidelity to intended models may slip and student engagement wane, negatively impacting learning processes, and outcomes. One potential solution to solve this degradation is by encouraging self-assessment in the PBL tutorial. Self-assessment is a central component of the self-regulation of student learning behaviours. There are few measures to investigate self-assessment relevant to PBL processes. We developed a Self-assessment Scale on Active Learning and Critical Thinking (SSACT) to address this gap. We wished to demonstrated evidence of its validity in the context of PBL by exploring its internal structure.

METHODS

We used a mixed methods approach to scale development. We developed scale items from a qualitative investigation, literature review, and consideration of previous existing tools used for study of the PBL process. Expert review panels evaluated its content; a process of validation subsequently reduced the pool of items. We used structural equation modelling to undertake a confirmatory factor analysis (CFA) of the SSACT and coefficient alpha.

RESULTS

The 14 item SSACT consisted of two domains "active learning" and "critical thinking." The factorial validity of SSACT was evidenced by all items loading significantly on their expected factors, a good model fit for the data, and good stability across two independent samples. Each subscale had good internal reliability (>0.8) and strongly correlated with each other.

CONCLUSIONS

The SSACT has sufficient evidence of its validity to support its use in the PBL process to encourage students to self-assess. The implementation of the SSACT may assist students to improve the quality of their learning in achieving PBL goals such as critical thinking and self-directed learning.

To what extent do tutor-related behaviours influence student learning in PBL?

The purpose of this study was to investigate how tutor behaviours influence learning in problem-based learning (PBL). A previous study had indicated a significant influence of the tutor's social congruent behaviour on the PBL process and this study further investigates this finding by examining two groups of tutors displaying differences in social congruence. The participants were 77 students under the tutelage of four tutors and a self-report questionnaire ranked two tutors to be more socially congruent as compared to the other two. Student learning was measured by a concept recall test and the results from the analysis of covariance indicated a significant impact of the tutor's social congruent behaviour on learning after the problem analysis phase but not on the self-directed learning and reporting phases. It was concluded that the academic abilities of students and the small number of tutors involved may have affected the results, which led to the second part of this study. A group of 11 tutors were selected and the impact of their behaviours on student achievement measured by the module grade was examined. Results indicated that the tutor behaviours had a greater influence on average students as compared to the academically stronger and weaker students. This finding suggests that students who are academically stronger are not as reliant on the tutor while average students may depend more on the tutor to guide and motivate them in order to achieve the learning goals.

Effect of worksheet scaffolds on student learning in problem-based learning

The purpose of this study was to investigate the effect of worksheets as a scaffolding tool on students' learning achievement in a problem-based learning (PBL) environment. Seventeen PBL classes (N = 241) were randomly assigned to two experimental groups-one with a worksheet provided and the other without. Students' learning of the topic at hand was evaluated by comparing results from pre- and post-lesson concept recall tests. We also obtained information about students' perceptions of factors impacting their learning using a Learning Impact Questionnaire. The data was analyzed by means of analyses of variance. Results of the study indicated that there was no statistically significant difference between the levels of understanding for both groups of students. In addition, survey results revealed that the strongest factor perceived by students to impact their learning in a PBL context is the tutor followed by team and class dynamics, while the influence of the worksheet was rated lowest. These findings suggest that scaffolds such as worksheets may not play a significant role in enhancing students' learning within the social constructivist framework of problem-based learning. On the other hand, the importance of the role of tutor and collaborative small group learning which are key features of PBL is reinforced.

Effects of tutor-related behaviours on the process of problem-based learning

Tutors in a Problem-Based Learning (PBL) curriculum are thought to play active roles in guiding students to develop frameworks for use in the construction of knowledge. This implies that both subject-matter expertise and the ability of tutors to facilitate the learning process must be important in helping students learn. This study examines the behavioural effects of tutors in terms of subject-matter expertise, social congruence and cognitive congruence on students' learning process and on their final achievement. The extent of students' learning at each PBL phase was estimated by tracking the number of relevant concepts recalled at the end of each learning phase, while student achievement was based on students' ability to describe and elaborate upon the relationship between relevant concepts learned. By using Analysis of Covariance, social congruence of the tutor was found to have a significant influence on learning in each PBL phase while all of the tutor-related behaviours had a significant impact on student achievement. The results suggest that the ability of tutors to communicate informally with students and hence create a less threatening learning environment that promotes a free flow exchange of ideas, has a greater impact on learning at each of the PBL phases as compared to tutors' subject-matter expertise and their ability to explain concepts in a way that is easily understood by students. The data presented indicates that these tutor-related behaviours are determinants of learning in a PBL curriculum, with social congruence having a greater influence on learning in the different PBL phases.

The process of problem-based learning: what works and why

OBJECTIVES

In this review, we portray the process of problem-based learning (PBL) as a cognitive endeavour whereby the learner constructs mental models relevant to problems. Two hypotheses are proposed to explain how learning is driven in PBL; an activation-elaboration hypothesis and a situational interest hypothesis.

METHODS

Research relevant to these hypotheses is discussed. In addition, research studying the effects of various support strategies used in PBL is reviewed. Finally, we summarise a number of recent studies in which a new 'micro-analytical' methodology was used to trace the process of PBL in the natural classroom setting.

CONCLUSIONS

We conclude that there is considerable support for the idea that PBL works because it encourages the activation of prior knowledge in the small-group setting and provides opportunities for elaboration on that knowledge. These activities facilitate the comprehension of new information related to the problem and enhance its long-term memorability. In addition, there is evidence that problems arouse situational interest that drives learning. Flexible scaffolding provided by cognitively and socially congruent tutors also seems to be reasonably effective, as opposed to 'hard' scaffolding represented by, for instance, worksheets or questions added to problems. Small-group work protects against dropout and encourages students to study regularly. Initially, students do not study much beyond the learning issues generated; the development of personal agency in self-study needs time to develop. The extent of learning in PBL results from neither group collaboration only (the social constructivist point of view) nor individual knowledge acquisition only; both activities contribute equally to learning in PBL.