Tutor intervention profile: reliability and validity

Development and validation of a questionnaire on problem-based learning to evaluate facilitation by the tutor and the student group

BACKGROUND

The study objective was to develop and validate a questionnaire to capture facilitation activities in PBL by the tutor and the group with reference to a theoretical model of teaching quality.

METHODS

We developed 19 items assigned to six factors to evaluate collaborative learning processes in relation to facilitation by the tutor and the student PBL group. We analysed construct and criterion validity in 419 undergraduate medical students in 152 online PBL groups.

RESULTS

Construct validity was confirmed based on factor dimensionality in line with the theoretical assumptions as well as satisfactory internal reliabilities and intraclass correlation coefficients. Criterion validity was supported by the correlation of a) tutor facilitation activities with the success of group self-facilitation and b) facilitation activities with learning gain and satisfaction in the PBL sessions.

DISCUSSION

The questionnaire provides a more comprehensive understanding of collaborative learning processes in PBL and the interplay between facilitation activities by the tutor and the group.

Measuring group function in problem-based learning: development of a reflection tool

BACKGROUND

Problem-based learning (PBL) is a pedagogy involving self-directed learning in small groups around case problems. Group function is important to PBL outcomes, but there is currently poor scaffolding around key self-reflective practices that necessarily precedes students' and tutors' attempts to improve group function. This study aims to create a structured, literature-based and stakeholder-informed tool to help anchor reflective practices on group function. This article reports on the development process and perceived utility of this tool.

METHODS

Tool development unfolded in four steps: 1) a literature review was conducted to identify existent evaluation tools for group function in PBL, 2) literature findings informed the development of this new tool, 3) a group of PBL experts were consulted for engagement with and feedback of the tool, 4) four focus groups of stakeholders (medical students and tutors with lived PBL experiences) commented on the tool's constructs, language, and perceived utility. The tool underwent two rounds of revisions, informed by the feedback from experts and stakeholders.

RESULTS

Nineteen scales relating to group function assessment were identified in the literature, lending 18 constructs that mapped into four dimensions: Learning Climate, Facilitation and Process, Engagement and Interactivity, and Evaluation and Group Improvement. Feedback from experts informed the addition of missing items. Focus group discussions allowed further fine-tuning of the organization and language of the tool. The final tool contains 17 descriptive items under the four dimensions. Users are asked to rate each dimension holistically on a 7-point Likert scale and provide open comments. Researchers, faculty, and students highlighted three functions the tool could perform: (1) create space, structure, and language for feedback processes, (2) act as a reference, resource, or memory aid, and (3) serve as a written record for longitudinal benchmarking. They commented that the tool may be particularly helpful for inexperienced and poor-functioning groups, and indicated some practical implementation considerations.

CONCLUSION

A four-dimension tool to assist group function reflection in PBL was produced. Its constructs were well supported by literature and experts. Faculty and student stakeholders acknowledged the utility of this tool in addressing an acknowledged gap in group function reflection in PBL.

Integrated clinical case discussions - a fully student-organized peer-teaching program on internal medicine

BACKGROUND

In response to students´ poor ratings of emergency remote lectures in internal medicine, a team of undergraduate medical students initiated a series of voluntary peer-moderated clinical case discussions. This study aims to describe the student-led effort to develop peer-moderated clinical case discussions focused on training cognitive clinical skill for first and second-year clinical students.

METHODS

Following the Kern Cycle a didactic concept is conceived by matching cognitive learning theory to the competence levels of the German Medical Training Framework. A 50-item survey is developed based on previous evaluation tools and administered after each tutorial. Educational environment, cognitive congruence, and learning outcomes are assessed using pre-post-self-reports in a single-institution study.

RESULTS

Over the course of two semesters 19 tutors conducted 48 tutorials. There were 794 attendances in total (273 in the first semester and 521 in the second). The response rate was 32%. The didactic concept proved successful in attaining all learning objectives. Students rated the educational environment, cognitive congruence, and tutorials overall as "very good" and significantly better than the corresponding lecture. Students reported a 70%-increase in positive feelings about being tutored by peers after the session.

CONCLUSION

Peer-assisted learning can improve students´ subjective satisfaction levels and successfully foster clinical reasoning skills. This highlights successful student contributions to the development of curricula.

An Analysis of the Factors on the Problem-Solving Competencies of Engineering Employees in Korea

The purpose of this study is to analyze the effect of the factors on the problem-solving competency of engineering graduates. To this end, we use the 2016 Korean survey data among the Program for the International Assessment of Adult Competencies (PIAAC) survey data conducted by the Organization for Economic Co-operation and Development (OECD). In summary of the study’s major results, older people and females have lower problem-solving competencies (Model 1); higher literacy and numeracy competencies lead to higher problem-solving competencies (Model 2); and those with more experiences of sharing work-related information have higher problem-solving competencies. However, those who give more presentations have lower problem-solving competencies (Model 3), and those who make frequent use of Information and Communications Technology (ICT) to send or receive e-mails or conduct real-time discussions have higher problem-solving competencies (Model 4). These results present implications from the two perspectives of “sustainability” and “integration.” Sustainability is further classified into the following two perspectives: (1) sustainability from the longitudinal viewpoint of middle school, high school, and then job education, and (2) sustainability from the cross-sectional perspective of sustainable organization cultures. In addition, the implications of integration are based on common growth with other related core competencies besides problem-solving competencies.

Tutor assessment of PBL process: does tutor variability affect objectivity and reliability?

BACKGROUND

Ensuring objectivity and maintaining reliability are necessary in order to consider any form of assessment valid. Evaluation of students in Problem-Based Learning (PBL) tutorials by the tutors has drawn the attention of critiques citing many challenges and limitations. The aim of this study was to determine the extent of tutor variability in assessing the PBL process in the Faculty of Medical Sciences, The University of the West Indies, St Augustine Campus, Trinidad and Tobago.

METHOD

All 181 students of year 3 MBBS were assigned randomly to 14 PBL groups. Out of 18 tutors, 12 had an opportunity to assess three groups: one assessed 2 groups and 4 tutors assessed one group each; at the end each group had been assessed three times by different tutors. The tutors used a PBL assessment rating scale of 12 different criteria on a six-point scale to assess each PBL Group. To test the stated hypotheses, independent t-test, one-way ANOVA followed by post-hoc Bonferroni test, Intra Class Correlation, and Pearson product moment correlations were performed.

RESULT

The analysis revealed significant differences between the highest- and lowest-rated groups (t-ratio = 12.64; p < 0.05) and between the most lenient and most stringent raters (t-ratio = 27.96; p < 0.05). ANOVA and post-hoc analysis for highest and lowest rated groups revealed that lenient- and stringent-raters significantly contribute (p < 0.01) in diluting the score in their respective category. The intra class correlations (ICC) among rating of different tutors for different groups showed low agreement among various ratings except three groups (Groups 6, 8 and 13) (r = 0.40). The correlation between tutors' PBL experiences and their mean ratings was found to be moderately significant (r = 0.52; p > 0.05).

CONCLUSION

Leniency and stringency factors amongst raters affect objectivity and reliability to a great extent as is evident from the present study. Thus, more rigorous training in the areas of principles of assessment for the tutors are recommended. Moreover, putting that knowledge into practice to overcome the leniency and stringency factors is essential.

[Postgraduate training for specialists in psychiatry and psychotherapy. Problem-based learning - evaluation of a pilot project]

Problem-based learning (PBL) emphasizes the student's individual needs, their ability to solve complex clinical problems, and a professional attitude that facilitates communication among colleagues. Thus, PBL appears to provide a perfectly suitable didactic format for postgraduate training of medical specialties. To date, it is only rarely used in this area though. In a pilot project, we implemented PBL into the curriculum of postgraduate training in psychiatry and psychotherapy, and evaluated the program over a period of 12 months, using structured questionnaires. A total of 41 PBL courses were held, with 447 residents participating. Participants as well as tutors assessed 19 of 21 aspects as good or very good (5-point Likert scale, mean value >4). Overall, PBL was rated as highly suitable for advanced training (participants: 4.5±0.8; tutors: 5.0±0.2). The results of this pilot project suggest that PBL might be a useful element of multifaceted advanced training programs, strengthening their practical component and the applicability of knowledge in the daily clinical routine.

Teacher perceptions of desired qualities, competencies and strategies for clinical skills teachers

INTRODUCTION

Clinical skills centres (or Skillslabs) prepare students for patient-encounters. Evidence on teaching skills in these centres is lacking. What teaching skills do teachers view as effective in supporting the acquisition of physical examination skills in undergraduate medical training?

METHOD

Structured interviews of 10 teachers (1/3 of staff of Maastricht University, Skillslab) were conducted. Selection was based on even representation of age, years teaching experience, gender and previous experience at Maastricht University. A topic grid was used to ensure comparability. Interviews (average 70 min, range 33-95 min) were recorded and transcripts were analyzed independently by two researchers.

RESULTS

Teaching skills identified include the ability to adapt content of the training, level of depth and teaching method according to the needs of any particular group. Thorough comprehension of students' context (level of knowledge,prior experience and insight in the curriculum) is considered helpful. Explicitly inviting students to ask questions and providing relevant literature is seen to stimulate learning. Providing constructive feedback is essential, as is linking physical examination skills training to clinical situations. The ideal attitude includes appropriate dress and behaviour, as well as the use of humour. Affinity for teaching is regarded as the most important reason to work as a teacher.

CONCLUSION

Desired characteristics for undergraduate skills teachers resemble findings in other teaching roles. Affinity for teaching and flexibility in teaching methods are novel findings.

Readiness for self-directed change in professional behaviours: factorial validation of the Self-Reflection and Insight Scale

CONTEXT

Self-reflection, the practice of inspecting and evaluating one's own thoughts, feelings and behaviour, and insight, the ability to understand one's own thoughts, feelings and behaviour, are central to the self-regulation of behaviours. The Self-Reflection and Insight Scale (SRIS) measures three factors in the self-regulation cycle: need for reflection; engagement in reflection, and insight.

METHODS

We used structural equation modelling to undertake a confirmatory factor analysis of the SRIS. We re-specified our model to analyse all of the data to explain relationships between the SRIS, medical student characteristics, and responses to issues of teaching and learning in professionalism.

RESULTS

The factorial validity of a modified SRIS showed all items loading significantly on their expected factors, with a good fit to the data. Each subscale had good internal reliability (> 0.8). There was a strong relationship between the need for reflection and engagement in reflection (r = 0.77). Insight was related to need for reflection (0.22) and age (0.21), but not to the process of engaging in reflection (0.06).

CONCLUSIONS

Validation of the SRIS provides researchers with a new instrument with which to measure and investigate the processes of self-reflection and insight in the context of students' self-regulation of their professionalism. Insight is related to the motive or need for reflection, but the process of reflection does not lead to insight. Attending to feelings is an important and integral aspect of self-reflection and insight. Effective strategies are needed to develop students' insight as they reflect on their professionalism.

Problem-based learning: where are we now?

The definition of problem-based learning (PBL) as an educational concept is as elusive in 2008 as it has been since the concept was first expressed over forty years ago. A definitive guide to the practice of PBL is equally elusive. Like all worthwhile educational ideas, PBL has proved attractive to those teachers who seek improvements for their courses. Its appeal has transcended the traditional boundaries in formal education so that there are examples of PBL from primary to tertiary education, and across many disciplines within these. Dissemination, however, has wrought confusion in understanding and practice, and consequent difficulties for researchers in evaluating its efficacy, and lack of clear advice for those who would like to adopt PBL. Rather than attempting to be definitive, this Guide explores the various interpretations and practices that claim the label PBL, and critiques these against the original concept and practice. The primary aim is to provide insight into the causes of the confusion about PBL in 2008. The second aim is to point a feasible way forward so that, where appropriate, the potential of PBL as a whole-of-curriculum concept may be realised; and, where it is not possible to implement the whole concept, worthwhile educational principles that have been associated more or less with PBL may be recognised as such and given value in their own right.

Improving the teaching skills of residents as tutors/facilitators and addressing the shortage of faculty facilitators for PBL modules

BACKGROUND

Residents play an important role in teaching of medical undergraduate students. Despite their importance in teaching undergraduates they are not involved in any formal training in teaching and leadership skills. We aimed to compare the teaching skills of residents with faculty in facilitating small group Problem Based Learning (PBL) sessions.

METHODS

This quasi experimental descriptive comparative research involved 5 postgraduate year 4 residents and five senior faculty members. The study was conducted with all phase III (Final year) students rotating in Gastroenterology. The residents and faculty members received brief training of one month in facilitation and core principles of adult education. Different aspects of teaching skills of residents and faculty were evaluated by students on a questionnaire (graded on Likert Scale from 1 to 10) assessing i) Knowledge Base-content Learning (KBL), ii) PBL, iii) Student Centered Learning (SCL) and iv) Group Skills (GS).

RESULTS

There were 33 PBL teaching sessions in which 120 evaluation forms were filled; out of these 53% forms were filled for residents and 47% for faculty group. The faculty showed a statistically greater rating in "KBL" (faculty 8.37 Vs resident 7.94; p-value 0.02), "GS" (faculty 8.06 vs. residents 7.68; p-value 0.04). Differences in faculty and resident scores in "the PBL" and "SCL" were not significant. The overall score of faculty facilitators, however, was statistically significant for resident facilitators. (p = .05).

CONCLUSION

1) Residents are an effective supplement to faculty members for PBL; 2) Additional facilitators for PBL sessions can be identified in an institution by involvement of residents in teacher training workshops.

Viewpoint: leaving the "empty glass" of problem-based learning behind: new assumptions and a revised model for case study in preclinical medical education

The popularity of problem-based learning (PBL) reflects medical educators' recognition that case study can enhance the preclinical medical school curriculum. However, the PBL method itself has features, particularly its reliance on small-group work with tutor-facilitators, that are expensive to implement and that limit the potential educational value of case study. The author systematically analyzes specific aspects of the PBL methodology and concludes that the PBL approach misuses the faculty, tends to compromise the authenticity of cases, and results in an unnecessarily varied and impoverished educational experience for students. Approaches to case study with different assumptions need to be devised. A model is proposed that shifts the goal of case study from development of problem-solving skills to development of ideas that allow meaningful engagement in sophisticated discussions of medicine. In this model, the method shifts from self-directed learning to independent study guided by the expertise of the faculty. One possible approach to case study based on this model is briefly described. It consists of reading published cases from the medical literature, with analysis and discussion of the cases led by faculty experts in large-group format. The approach immerses students in an authentic, state-of-the-art discussion of medicine and is easily incorporated into any curriculum structure at limited cost. The author argues that, contrary to the claims of proponents, the glass is "mostly empty" for PBL and that we can generate the higher-level discussion that case study merits only by moving away from PBL's extraneous assumptions.

Psychometric properties of an instrument to measure the clinical learning environment

OBJECTIVES

The clinical learning environment is an influential factor in work-based learning. Evaluation of this environment gives insight into the educational functioning of clinical departments. The Postgraduate Hospital Educational Environment Measure (PHEEM) is an evaluation tool consisting of a validated questionnaire with 3 subscales. In this paper we further investigate the psychometric properties of the PHEEM. We set out to validate the 3 subscales and test the reliability of the PHEEM for both clerks (clinical medical students) and registrars (specialists in training).

METHODS

Clerks and registrars from different hospitals and specialties filled out the PHEEM. To investigate the construct validity of the 3 subscales, we used an exploratory factor analysis followed by varimax rotation, and a cluster analysis known as Mokken scale analysis. We estimated the reliability of the questionnaire by means of variance components according to generalisability theory.

RESULTS

A total of 256 clerks and 339 registrars filled out the questionnaire. The exploratory factor analysis plus varimax rotation suggested a 1-dimensional scale. The Mokken scale analysis confirmed this result. The reliability analysis showed a reliable outcome for 1 department with 14 clerks or 11 registrars. For multiple departments 3 respondents combined with 10 departments provide a reliable outcome for both groups.

DISCUSSION

The PHEEM is a questionnaire measuring 1 dimension instead of the hypothesised 3 dimensions. The sample size required to achieve a reliable outcome is feasible. The instrument can be used to evaluate both single and multiple departments for both clerks and registrars.

Twelve tips for recruiting and retaining facilitators in a problem-based learning programme

Successful curriculum reform requires considerable staff development. It is imperative for management to ensure that its academic staff members are committed to the change. This requires planning and negotiation. As facilitators form the 'teaching' backbone of a problem-based learning programme, faculty management must ensure mechanisms are in place to recruit facilitators, and that once recruited, the experience is sufficiently rewarding personally for their enthusiasm to be sustained. This article offers several solutions to difficulties which many medical schools encounter during the early years of an undergraduate PBL programme which replaces a traditional curriculum. The advice offered ranges from recruiting facilitators from the private sector to encouraging staff to become involved in other areas of curriculum development. Most importantly, however, is the reward and incentive system, which must be well advertised in advance of any programme implementation. The suggestions presented in this article will be useful to faculties planning to implement problem-based learning as well as those who already have a programme in place.

Can students differentiate between PBL tutors with different tutoring deficiencies?

Many medical schools evaluate the performance of their tutors by using questionnaires. One of the aims of these evaluations is to provide tutors with diagnostic feedback on strong and weak aspects of their performance. Although everyone will agree that students are able to distinguish between poor and excellent tutors, one can question whether students are also able to differentiate between tutors with different tutoring deficiencies--tutors who perform badly on a specific key aspect of their performance. The aim of this study was to investigate to what degree students are able to differentiate between tutors with different tutoring deficiencies, how effective tutors are with different deficiencies and what kind of tips students give for improvement of a tutor's behaviour. Based on students' ratings on a tutor evaluation questionnaire, tutors were ranked in groups with different deficiencies and the average overall tutor performance score was computed for each group with a particular deficiency. In addition, students' tips for improvement given in the open-ended question at the end of the questionnaire were analysed. The results demonstrated that on average one out of five tutors showed a deficiency on only one key aspect. Tutors who did not stimulate students towards active learning were perceived as least effective. Furthermore, students' tips for improvement could be categorized into four groups: tutors who do not evaluate adequately, tutors who are too directive, tutors who are too passive and tutors who lack content knowledge. The results of this study demonstrate that students are not only able to distinguish between poor and excellent tutors, but are also able to diagnose tutors with different tutoring deficiencies and are able to provide tutors with specific feedback to improve their performance.

On the relationship between group functioning and study success in problem-based learning

INTRODUCTION

In problem-based learning (PBL), discussion in the tutorial group plays a central role in stimulating student learning. Problems are the principal input for stimulating discussion. The quality of discussion is assumed to influence student learning and, in the end, study success.

AIMS

To investigate the relationships between aspects of group functioning and study success.

METHODS

First-year medical students (n = 116), forming 12 PBL groups, completed a 21-item questionnaire on various aspects of a PBL session. At the end of the unit, a course examination was administered. Scales were constructed and reliability analyses conducted.

RESULTS

Group functioning and case quality were strongly correlated with students' grades in a course examination. Further, students' perceptions of group functioning, case quality and the quality of their own contribution were linked strongly with each other.

CONCLUSIONS

Group functioning, case quality and study success are associated with each other in PBL. The interaction between these aspects of PBL in promoting learning calls for further investigation.

Assessment of 'borderline' clinical competence using generalisability and decision studies in dental skills training

INTRODUCTION

Generalisability coefficients are widely used as a measure of reliability in educational sciences. However, coefficients do not inform about how much individual and/or educational variance is needed for borderline competence. Probing depth measurements were used as an example to demonstrate the use of generalisability and decision studies in educational decision-making.

METHOD

All six probing depths of seven elements of the first quadrant were assessed in a random crossed four-way 'elements' (7), 'probing depth' (6) 'observers' (7-8) and 'repetitions' design for both students (8) and faculty staff (7). Borderline competence was assessed in four decision study designs.

RESULTS

In decision studies the generalisability coefficient varied from 0.31 to 0.88 for the first single and fourth repeated study design, respectively. The standard error of the measurement varied from 1.73 to 0.64 mm with a corresponding 95% confidence interval varying from 3 to 1 mm.

CONCLUSION

Repeated measurement is not the most efficient way to improve educational decision-making. What is new to this approach is that we used the 95% confidence interval of the standard error of measurement as a measure for 'borderline competence' expressed in the unity of the measurement instrument. Correctly performing the procedure of probing depth assessment is of clinical and educational importance in deciding whether further treatment is necessary and whether students fail or pass their exams.

What can we learn from facilitator and student perceptions of facilitation skills and roles in the first year of a problem-based learning curriculum?

BACKGROUND

The small group tutorial is a cornerstone of problem-based learning. By implication, the role of the facilitator is of pivotal importance. The present investigation canvassed perceptions of facilitators with differing levels of experience regarding their roles and duties in the tutorial.

METHODS

In January 2002, one year after problem-based learning implementation at the Nelson R. Mandela School of Medicine, facilitators with the following experience were canvassed: trained and about to facilitate, facilitated once only and facilitated more than one six-week theme. Student comments regarding facilitator skills were obtained from a 2001 course survey.

RESULTS

While facilitators generally agreed that the three-day training workshop provided sufficient insight into the facilitation process, they become more comfortable with increasing experience. Many facilitators experienced difficulty not providing content expertise. Again, this improved with increasing experience. Most facilitators saw students as colleagues. They agreed that they should be role models, but were less enthusiastic about being mentors. Students were critical of facilitators who were not up to date with curriculum implementation or who appeared disinterested. While facilitator responses suggest that there was considerable intrinsic motivation, this might in fact not be the case.

CONCLUSIONS

Even if they had facilitated on all six themes, facilitators could still be considered as novices. Faculty support is therefore critical for the first few years of problem-based learning, particularly for those who had facilitated once only. Since student and facilitator expectations in the small group tutorial may differ, roles and duties of facilitators must be explicit for both parties from the outset.

An exploration of tutors' experiences of facilitating problem-based learning. Part 1--an educational research methodology combining innovation and philosophical tradition

The use of problem-based learning (PBL) in Health Professional curricula is becoming more wide spread. Although the way in which the tutor facilitates PBL can have a major impact on students' learning (Andrews and Jones 1996), the literature provides little consistency as to how the tutor can effectively facilitate PBL (Haith-Cooper 2000). It is therefore important to examine the facilitation role to promote effective learning through the use of PBL. This article is the first of two parts exploring a study that was undertaken to investigate tutors' experiences of facilitating PBL. This part focuses on the methodology and the combining of innovative processes with traditional philosophical traditions to develop a systematic educational research methodology. The study was undertaken respecting the philosophy of hermeneutic phenomenology but utilised alternative data collection and analysis technique. Video conferencing and e-mail were used in conjunction with more traditional processes to access a worldwide sample. This paper explores some of the issues that arose when undertaking such a study. The second article then focuses on exploring the findings of the study and their implications for the facilitation of PBL.

An exploration of tutors' experiences of facilitating problem-based learning. Part 2--implications for the facilitation of problem based learning

This paper is the second of two parts exploring a study that was undertaken to investigate the role of the tutor in facilitating problem-based learning (PBL). The first part focussed on the methodological underpinnings of the study. This paper aims to focus on the findings of the study and their implications for the facilitation of PBL. Six essential themes emerged from the findings that described the facilitation role. The tutors believed that their facilitation role was essentially structured around the decision of when to intervene and how to intervene in the PBL process. Modelling and non-verbal communication were seen as essential strategies for the facilitator. Underpinning these decisions was the need to trust in the philosophy of PBL. However, within many of the themes, there was a divergence of opinion as to how the role should actually be undertaken. Despite this, these findings have implications for the future role of PBL facilitators in Health Professional Education.

Assessment of medical courses in Brazil using student-completed questionnaires. Is it reliable?

INTRODUCTION

Debates about the quality of medical education have become more evident in the recent past, and as a result several different assessment methods have been refined for that purpose. The use of questionnaires filled out by medical students to assess the quality of lectures is one of the most common methods employed in our milieu. However, the reliability of this investigation method has not yet been systematically tested. The authors present the reliability of a specific form applied to the fourth grade medical students during the clinical psychiatry course.

METHOD

Eighty-one fourth grade medical students were instructed to complete a form immediately after each clinical psychiatry lecture. Thirty-four students (42%) failed to turn in the forms after the final lecture. These students were given an identical form to assess the lectures in a retrospective fashion. The grades given by both groups of students for each performed lecture and the number of students who have graded an unperformed lecture were compared. Statistical significance for both groups was determined by means of the chi-square test (p< 0.05).

RESULTS

Eighteen out of the 34 students who filled out the forms retrospectively (53%) rated the unperformed lecture, whereas only 5 out of the 47 students who filled out the forms during the course (11%) did so. This is statistically significant (p< 0.05). There was no statistical difference for the grades given to the lectures that were actually performed.

DISCUSSION

The authors concluded the low reliability rate of the retrospective evaluation warrant a continuous assessment method during the course.

Profiles of effective tutors in problem-based learning: scaffolding student learning

OBJECTIVES

Research on tutoring in problem-based learning has not focused so far on the variation in tutoring and how this variation can be interpreted by conceptions about effective tutoring.

DESIGN

This study focuses on the profiles of tutors generated by means of an instrument, the so-called Tutor Intervention Profile (TIP), and tries to determine which profiles are more or less effective. The TIP contains four dimensions of tutor behaviour: (1) elaboration; (2) directing the learning process; (3) integration of knowledge; and (4) stimulating interaction and individual accountability.

SETTING

The medical school of the University of Maastricht, The Netherlands.

SUBJECTS

Sixty-seven tutors who run 67 tutorial groups across three units (courses) in the academic year 1996-97.

RESULTS

It appeared that high, average and low performing tutors differ in their performance on each of the four dimensions of the TIP. Several different profiles of tutor performance could be distinguished, which were more or less effective. One group of tutors demonstrated a tutor intervention profile that was characterized as relying more on the use of expert knowledge, whereas another group of tutors was characterized as relying more on their abilities to stimulate the learning process in the tutorial group. The tutor intervention profile that was perceived by students as most effective showed high scores on each of the four dimensions, as expected. Notably, a tutor stressing the learning process in the tutorial group was perceived as more effective than a tutor stressing content (expert tutor). This is especially true for a relatively poor scoring tutor.

CONCLUSIONS

The results of this study are consistent with research on human tutoring and research on tutoring in problem-based learning.