Exposure or expert? Setting standards for postgraduate education through a Delphi technique

Development of an integrated competency framework for postgraduate paediatric training: a Delphi study

Competency-based education (CBE) has transformed medical training during the last decades. In Flanders (Belgium), multiple competency frameworks are being used concurrently guiding paediatric postgraduate CBE. This study aimed to merge these frameworks into an integrated competency framework for postgraduate paediatric training. In a first phase, these frameworks were scrutinized and merged into one using the Canadian Medical Education Directives for Specialists (CanMEDS) framework as a comprehensive basis. Thereafter, the resulting unified competency framework was validated using a Delphi study with three consecutive rounds. All competencies (n = 95) were scored as relevant in the first round, and twelve competencies were adjusted in the second round. After the third round, all competencies were validated for inclusion. Nevertheless, differences in the setting in which a paediatrician may work make it difficult to apply a general framework, as not all competencies are equally relevant, applicable, or suitable for evaluation in every clinical setting. These challenges call for a clear description of the competencies to guide curriculum planning, and to provide a fitting workplace context and learning opportunities.Conclusion: A competency framework for paediatric post-graduate training was developed by combining three existing frameworks, and was validated through a Delphi study. This competency framework can be used in setting the goals for workplace learning during paediatric training. What is Known: •Benefits of competency-based education and its underlying competency frameworks have been described in the literature. •A single and comprehensive competency framework can facilitate training, assessment, and certification. What is New: •Three existing frameworks were merged into one integrated framework for paediatric postgraduate education, which was then adjusted and approved by an expert panel. •Differences in the working environment might explain how relevant a competency is perceived.

Determining electrocardiography training priorities for medical students using a modified Delphi method

BACKGROUND

Although electrocardiography is considered a core learning outcome for medical students, there is currently little curricular guidance for undergraduate ECG training. Owing to the absence of expert consensus on undergraduate ECG teaching, curricular content is subject to individual opinion. The aim of this modified Delphi study was to establish expert consensus amongst content and context experts on an ECG curriculum for medical students.

METHODS

The Delphi technique, an established method of obtaining consensus, was used to develop an undergraduate ECG curriculum. Specialists involved in ECG teaching were invited to complete three rounds of online surveys. An undergraduate ECG curriculum was formulated from the topics of ECG instruction for which consensus (i.e. ≥75% agreement) was achieved.

RESULTS

The panellists (n = 131) had a wide range of expertise (42.8% Internal Medicine, 22.9% Cardiology, 16% Family Medicine, 13.7% Emergency Medicine and 4.6% Health Professions Education). Topics that reached consensus to be included in the undergraduate ECG curriculum were classified under technical aspects of performing ECGs, basic ECG analysis, recognition of the normal ECG and abnormal rhythms and waveforms and using electrocardiography as part of a clinical diagnosis. This study emphasises that ECG teaching should be framed within the clinical context. Course conveners should not overload students with complex and voluminous content, but rather focus on commonly encountered and life-threatening conditions, where accurate diagnosis impacts on patient outcome. A list of 23 "must know" ECG diagnoses is therefore proposed.

CONCLUSION

A multidisciplinary expert panel reached consensus on the ECG training priorities for medical students.

Planning the content of a brief educational course in maxillofacial emergencies for staff in accident and emergency departments: a modified Delphi study

It is well known that staff in accident and emergency (A&E) departments lack the knowledge and confidence needed to deal with maxillofacial emergencies, and that it is related to limited education at undergraduate and postgraduate levels. We therefore aimed to design a syllabus for a short course to educate staff about the most common emergencies. To find out which learning outcomes should be included and to reach a consensus, we did a 3-stage modified Delphi study of the opinions of members of the British Association of Oral and Maxillofacial Surgeons (BAOMS). Of a possible 890 members, 188 responded (21%) in the second round and 105 in the third (12%). Eighteen (37%) of the 49 proposed learning outcomes were rated very important and all of them were retained in the syllabus after the third round. Thirty (61%) items were retained with a consensus of 51% or above in the final round. The Delphi technique is a useful addition to the armamentarium of those involved in education, and has been used effectively in syllabus design. We achieved good consensus on the items to be included and the syllabus will be piloted locally.

A Delphi consensus study to identify current clinically most valuable orthopaedic anatomy components for teaching medical students

BACKGROUND

Over recent years, wide ranging changes have occurred in undergraduate medical curricula with reduction of hours allocated for teaching anatomy. Anatomy forms the foundation of clinical practice. However, the challenge of acquiring sufficient anatomical knowledge in undergraduate medical education for safe and competent clinical practice remains. The purpose of this study is to identify clinically most valuable orthopaedic anatomy components that are relevant to current clinical practice in order to reinforce anatomy teaching.

METHODS

Modified Delphi technique with three rounds involving twenty currently practicing orthopaedic consultants and senior speciality orthopaedic registrars (StR, year six and above) was conducted. Anatomical components applied in corresponding clinical situations were generated from the opinions of this expert panel in the first round and the clinical importance of each of these components were rated with a four point Likert scale in the subsequent two rounds to generate consensus. Percentage agreement was utilised as outcome measure for components rated as considerably/very important with consensus of more than 94%.

RESULTS

Response rates were 90% for the first round and 100% for the next two rounds. After three Delphi rounds, thirty four anatomy components applied in general/ specific clinical conditions and clinical tests were identified as clinically most valuable following iteration.

CONCLUSIONS

The findings of this study provide clinicians opinions regarding the current required essential anatomical knowledge for a graduating medical student to apply during their orthopaedic clinical encounters. The information obtained can be utilised to encourage further development of clinical anatomy curriculum reflecting the evolving nature of health care.

Expectations of clinical teachers and faculty regarding development of the CanMEDS-Family Medicine competencies: Laval developmental benchmarks scale for family medicine residency training

BACKGROUND

The CanMEDS-Family Medicine (CanMEDS-FM) framework defines the expected terminal enabling competencies (EC) for family medicine (FM) residency training in Canada. However, benchmarks throughout the 2-year program are not yet defined.

PURPOSES

This study aimed to identify expected time frames for achievement of the CanMEDS-FM competencies during FM residency training and create a developmental benchmarks scale for family medicine residency training.

METHODS

This 2011-2012 study followed a Delphi methodology. Selected faculty and clinical teachers identified, via questionnaire, the expected time of EC achievement from beginning of residency to one year in practice (0, 6, 12, […] 36 months). The 15-85th percentile intervals became the expected competency achievement interval. Content validity of the obtained benchmarks was assessed through a second Delphi round.

RESULTS

The 1st and 2nd rounds were completed by 33 and 27 respondents, respectively. A developmental benchmarks scale was designed after the 1st round to illustrate expectations regarding achievement of each EC. The 2nd round (content validation) led to minor adjustments (1.9±2.7 months) of intervals for 44 of the 92 competencies, the others remaining unchanged.

CONCLUSIONS

The Laval Developmental Benchmarks Scale for Family Medicine clarifies expectations regarding achievement of competencies throughout FM training. In a competency-based education system this now allows identification and management of outlying residents, both those excelling and needing remediation. Further research should focus on assessment of the scale reliability after pilot implementation in family medicine clinical teaching units at Laval University, and corroborate the established timeline in other sites.

First aid kits for recreational dive boats, what should they contain?

BACKGROUND

Well-equipped first-aid kits are necessary but not always provided on recreational dive boats. We aimed to review the types of illness and injury likely to be encountered on such boats and inform a content list for such kits.

METHOD

We conducted a 3-round Delphi study by email using a volunteer panel of 18 experts drawn from diving, dive medicine and nursing. In round 1, panellists shared examples of illnesses and injuries they had come across personally. These scenarios were circulated along with findings from a literature review, including existing recommendations. In rounds 2 and 3, the list of kit for dive boats in different settings was iteratively refined through online discussion and feedback.

MAIN FINDINGS

Passengers and crew on recreational dive boats may encounter a range of medical problems from minor injuries to serious accidents and non-dive-related illnesses. Recommended kit varied depending on context and setting (e.g. distance from land, qualifications and experience of crew). Consensus was quickly reached on key first-aid items but experts' views on emergency medicines differed.

CONCLUSIONS

The study highlights the diversity of medical problems encountered on recreational dive boats. We offer preliminary guidance on the content of suitable first-aid kits and suggest areas for further research.