Assessing the relationship between cardiac physical examination technique and accurate bedside diagnosis during an objective structured clinical examination (OSCE)

BACKGROUND

Many standardized patient (SP) encounters employ SPs without physical findings and, thus, assess physical examination technique. The relationship between technique, accurate bedside diagnosis, and global competence in physical examination remains unclear.

METHOD

Twenty-eight internists undertook a cardiac physical examination objective structured clinical examination, using three modalities: real cardiac patients (RP), "normal" SPs combined with related cardiac audio-video simulations, and a cardiology patient simulator (CPS). Two examiners assessed physical examination technique and global bedside competence. Accuracy of cardiac diagnosis was scored separately.

RESULTS

The correlation coefficients between participants' physical examination technique and diagnostic accuracy were 0.39 for RP (P < .05), 0.29 for SP, and 0.30 for CPS. Patient modality impacted the relative weighting of technique and diagnostic accuracy in the determination of global competence.

CONCLUSIONS

Assessments of physical examination competence should evaluate both technique and diagnostic accuracy. Patient modality affects the relative contributions of each outcome towards a global rating.

54. Assessing cardiac physical examination competence using simulation technology and real patientss

Assessment of residents’ physical examination skills often involves the use of standardized patients lacking physical abnormalities. Simulation technology offers the potential benefit of mimicking physical abnormalities. The current study was undertaken to examine the relationship between physicians’ competence in cardiac physical examination as assessed using simulation technology compared to real patients. An OSCE was created using 3 modalities of cardiac patients: real patients (RP) with cardiac abnormalities, standardized patients (SP) combined with a computer-based audio-video simulation of auscultatory abnormalities and a cardiopulmonary patient simulator (CPS). The same four cardiac diagnoses were tested with each modality. Participants were 28 internists, within 3 years of passing the Royal College of Physicians and Surgeons of Canada’s (RCPSC) Comprehensive Examination in Internal Medicine. At each station, two RCPSC examiners independently rated a participant’s physical examination technique and provided a global rating of clinical competence. The accuracy of a participant’s cardiac diagnosis for each patient was scored separately by two investigators. The inter-rater reliability between examiners, for the global rating outcome, was 0.76 for RP stations, 0.78 for SP stations and 0.75 for CPS stations. The correlations between participants’ global ratings on each modality were: RP vs. SP, r=0.19; RP vs. CPS, r=0.22; SP vs. CPS, r=0.57 (p < 0.01). A number of methodological limitations were highlighted during the study, including difficulties in truly matching patients within and between modalities, differential weighting of components into the examiners’ global ratings based on modality and limitations of case specificity. No modality provided a clear “gold standard” to assess residents’ cardiac physical examination competence. In the context of assessment, until these limitations are addressed, simulation modalities may not be directly interchangeable with real patients. Boulet JR, Swanson DB. Psychometric challenges of using simulations for high-stakes assessment. In: Dunn WF (ed). Simulators in critical care education and beyond. Des Plaines, IL: Society of Critical Care Medicine 2004; 119-30. Hatala R, Kassen BO, Nishikawa J, Cole G, Issenberg SB. Incorporating simulation technology in a Canadian national specialty examination: a descriptive report. Academic Medicine. 2005; 80(6):554-6. Issenberg SB, McGaghie WC, Petrusa ER, Gordon DL, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005; 27(1):10-28.

59. General medicine residents' perception of the mini-CEXs

The mini-CEX is a 30 minute observed clinical encounter. It can be done in the outpatient, inpatient or emergency room setting. It strives to look at several parameters including a clinical history, physical, professionalism and overall clinical competence. Trainees are rated using a 9-point scoring system: 1-3 unsatisfactory, 4-6 satisfactory and 7-9 superior. Eight months after the introduction of the mini-CEX to the core University of British Columbia Internal Medicine Residents, a one hour semi-structured focus group for residents in each of the three years took place. The focus groups were conducted by an independent moderator, audio-recorded and transcribed. Using a phenomenological approach the comments made by the focus groups participants were read independently by three authors, organized into major themes. In doing so, several intriguing common patterns were revealed on how General Medicine Residents perceive their experience in completing a mini-CEX. The themes include Education, Assessment and Preparation for the Royal College of Physicians and Surgeons Internal Medicine exam. Resident learners perceived that the mini-CEX process provided insight into their clinical strengths and weaknesses. Focus group participants favored that the mini-CEX experience will benefit them in preparation, and successful completion of their licensing exam. Daelmans HE, Overmeer RM, van der Hem-Stockroos HH, Scherpbier AJ, Stehouwer CD, van der Vleuten CP. In-training assessment: qualitative study of effects on supervision and feedback in an undergraduate clinical rotation. Medical Education 2006; 40(1):51-8. De Lima AA, Henquin R, Thierer J, Paulin J, Lamari S, Belcastro F, Van der Vleuten CPM. A qualitative study of the impact on learning of the mini clinical evaluation exercise in postgraduate training. Medical Teacher January 2005; 27(1):46-52. DiCicco-Bloom B, Crabtree BF. The Qualitative Research Interview. Medical Education 2006; 40:314-32.

Does physical examination competence correlate with bedside diagnostic acumen? An observational study

AIM

To examine the relationship between a physician's ability to examine a standardized patient (SP) and their ability to correctly identify related clinical findings created with simulation technology.

METHOD

The authors conducted an observational study of 347 candidates during a Canadian national specialty examination at the end of post-graduate internal medicine training. Stations were created that combined physical examination of an SP with evaluation of a related audio-video simulation of a patient abnormality, in the domains of cardiology and neurology. Examiners evaluated a candidate's competence at performing a physical examination of an SP and their accuracy in diagnosing a related audio-video simulation.

RESULTS

For the cardiology stations, the correlation between the physical examination scores and recognition of simulation abnormalities was 0.31 (p < 0.01). For the neurology stations, the correlation was 0.27 (p < 0.01). Addition of the simulations identified 18% of 197 passing candidates on the cardiology stations and 17% of 240 passing candidates on the neurology stations who were competent in their physical examination technique but did not achieve the passing score for diagnostic skills.

CONCLUSIONS

Assessments incorporating SPs without physical findings may need to include other methodologies to assess bedside diagnostic acumen.

Assessing the mini-Clinical Evaluation Exercise in comparison to a national specialty examination

PURPOSE

To evaluate the reliability and validity of the Mini-Clinical Evaluation Exercise (mini-CEX) for postgraduate year 4 (PGY-4) internal medicine trainees compared to a high-stakes assessment of clinical competence, the Royal College of Physicians and Surgeons of Canada Comprehensive Examination in Internal Medicine (RCPSC IM examination).

METHODS

Twenty-two PGY-4 residents at the University of British Columbia and the University of Calgary were evaluated, during the 6 months preceding their 2004 RCPSC IM examination, with a mean of 5.5 mini-CEX encounters (range 3-6). Experienced Royal College examiners from each site travelled to the alternate university to assess the encounters.

RESULTS

The mini-CEX encounters assessed a broad range of internal medicine patient problems. The inter-encounter reliability for the residents' mean mini-CEX overall clinical competence score was 0.74. The attenuated correlation between residents' mini-CEX overall clinical competence score and their 2004 RCPSC IM oral examination score was 0.59 (P = 0.01).

CONCLUSION

By examining multiple sources of validity evidence, this study suggests that the mini-CEX provides a reliable and valid assessment of clinical competence for PGY-4 trainees in internal medicine.

Beyond journal clubs. Moving toward an integrated evidence-based medicine curriculum

Incorporating evidence-based medicine (EBM) into clinical practice is an important competency that residency training must address. Residency program directors, and the clinical educators who work with them, should develop curricula to enhance residents' capacity for independent evidence-based practice. In this article, the authors argue that residency programs must move beyond journal club formats to promote the practice of EBM by trainees. The authors highlight the limitations of journal club, and suggest additional curricular approaches for an integrated EBM curriculum. Helping residents become effective evidence users will require a sustained effort on the part of residents, faculty, and their educational institutions.

Incorporating simulation technology in a canadian internal medicine specialty examination: a descriptive report

High-stakes assessment of clinical performance through the use of standardized patients (SPs) is limited by the SP's lack of real physical abnormalities. The authors report on the development and implementation of physical examination stations that combine simulation technology in the form of digitized cardiac auscultation videos with an SP assessment for the 2003 Royal College of Physicians and Surgeons of Canada's Comprehensive Objective Examination in Internal Medicine. The authors assessed candidates on both the traditional stations and the stations that combined the traditional SP examination with the digitized cardiac auscultation video. For the combined stations, candidates first completed a physical examination of the SP, watched and listened to a computer simulation, and then described their auscultatory findings. The candidates' mean scores for both types of stations were similar, as were the mean discrimination indices for both types of stations, suggesting that the combined stations were of a testing standard similar to the traditional stations. Combining an SP with simulation technology may be one approach to the assessment of clinical competence in high-stakes testing situations.

Body surface integral maps in patients with arrhythmogenic right ventricular cardiomyopathy

OBJECTIVES

The aim of this study was to evaluate changes in QRST integral maps in patients with ARVC.

BACKGROUND

Arrhythmogenic right ventricular cardiomyopathy (ARVC) is a progressive disorder of predominantly right ventricle characterized with arrhythmic events possibly leading to sudden cardiac death. QRST integral maps reflect local disparities of ventricular repolarization and resulting vulnerability to arrhythmias.

METHODS

A group of 8 patients with ARVC and a control group of 8 patients with a concealed accessory pathway were studied. Body surface mapping was performed using a 63-lead Savard's system.

RESULTS

Mean QRST integral map of patients with ARVC showed abnormal characteristics. The area of negativity was larger than normal and extended to lower border of thorax. Departure map of the mean QRST integral map of patients with ARVC showed areas with departure index < 2 and > 2 in lower part of chest and upper part of back. When statistically analyzed, areas with p < 0.05 covered nearly lower half of chest and upper half of back.

CONCLUSIONS

We consider body surface QRST integral mapping to be an adequate method for evaluation of dispersion of ventricular repolarization in ARVC patients (Tab. 1, Fig. 5, Ref. 17).

Arrhythmogenic right ventricular cardiomyopathy/dysplasia

Arrhythmogenic right ventricular cardiomyopathy/dysplasia (ARVC/D) is a progressive disease of predominantly right ventricle, characterized by ventricular arrhythmias possible leading to sudden cardiac death. Genetic predisposition was confirmed more than 15 years ago. Autosomal dominant are forms ARVD1-9, Naxos disease (with subtype Carvajal syndrome) is recessive. In ARVC/D forms associated with desmosomal disorders are ventricular arrhythmias caused by the presence of myocardial damage and in forms associated with ryanodine receptor mutation is electrical instability and subsequent myocardial damage caused by calcium cell overload. Main clinical signs are ventricular arrhythmias originated from areas with slow conduction. Progression of ARVC/D is manifested by RV dilatation and LV echocardiographic abnormalities both considered as main risk factors of fatal ventricular arrhythmias and sudden cardiac death. Therapeutic possibilities include antiarrhythmic drugs, catheter ablation and implantation of cardioverter-defibrillator, in severe right or both ventricle involvement even heart failure treatment (Tab. 1, Ref. 56).

Effect of head-down bed rest on the neuroendocrine response to orthostatic stress in physically fit men

The role of neuroendocrine responsiveness in the development of orthostatic intolerance after bed rest was studied in physically fit subjects. Head-down bed-rest (HDBR, -6 degrees, 4 days) was performed in 15 men after 6 weeks of aerobic training. The standing test was performed before, after training and on day 4 of the HDBR. Orthostatic intolerance was observed in one subject before and after training. The blood pressure response after training was enhanced (mean BP increments 18+/-2 vs. 13+/- 2 mm Hg, p<0.05, means +/- S.E.M.), although noradrenaline response was diminished (1.38+/-0.18 vs. 2.76+/-0.25 mol.l(-1), p<0.01). Orthostatic intolerance after HDBR was observed in 10 subjects, the BP response was blunted, and noradrenaline as well as plasma renin activity (PRA) responses were augmented (NA 3.10+/-0.33 mol.l(-1), p<0.001; PRA 2.98+/-1.12 vs. 0.85+/-0.15 ng.ml(-1), p<0.05). Plasma noradrenaline, adrenaline and aldosterone responses in orthostatic intolerant subjects were similar to the tolerant group. We conclude that six weeks of training attenuated the sympathetic response to standing and had no effect on the orthostatic tolerance. In orthostatic intolerance the BP response induced by subsequent HDBR was absent despite an enhanced sympathetic response.

Adapting the Key Features Examination for a clinical clerkship

PURPOSE

A written test of clinical decision-making, the Key Features Examination, was developed for use in clerkship.

METHODS

Following the guidelines provided by the Medical Council of Canada, a Key Features Examination was developed and implemented in an internal medicine clinical clerkship, during the 1998/99 clerkship year. The reliability and concurrent validity of the exam were assessed.

RESULTS

A 2 hour examination, containing 15 key feature problems, was administered to 101 students during 6 consecutive internal medicine clerkship rotations. The reliability of the exam, calculated from Cronbach's alpha, was 0.49. The exam had modest correlation with other measures of knowledge and clinical performance.

CONCLUSION

The Key Feature Examination is a feasible and reliable evaluation tool that may be implemented as a component of student assessment during a clinical clerkship.

Endocrine activation in tachycardias

This article reviews the complex character of neuroendocrine response to paroxysmal tachycardia. While the endocrine influences in arrhythmogenesis are well perceived by the cardiologists, less attention has been paid to influence of tachycardia on neuroendocrine activation. However, this may significantly alter the clinical course of tachycardias and its responses to pharmacotherapeutic interventions. Main characteristics of hormones with direct relationship to cardiovascular system (ANP, AVP, catecholamines, angiotensin and others) are listed with description of regulation of their secretion and main biological effects, especially with regard to regulation of circulation. Changes in hemodynamics during tachycardia with accompanying changes in ANP, AVP renin-angiotensin-aldosterone system, sympatho-neural and sympatho-adrenal activation are reviewed. Further research and understanding require more complex approach and concentration on interrelationship of different regulatory hormones in tachycardia. (Fig. 2, Ref. 96.)

The defibrillator in acute myocardial infarction trial (DINAMIT): study protocol

BACKGROUND

The implantable cardioverter/defibrillator (ICD) has been shown to be superior to antiarrhythmic drug therapy for the secondary prevention of sudden cardiac death. Its role in the primary prevention of sudden death after myocardial infarction is unknown. Methods and Results The Defibrillator in Acute Myocardial Infarction Trial (DINAMIT) is a randomized, open-label, parallel-group comparison of ICD therapy versus no ICD therapy in selected survivors of acute myocardial infarction. It will test the hypothesis that reduction of sudden arrhythmogenic death by means of the ICD will result in reduction of overall mortality rates in patients at high risk after acute myocardial infarction. Accordingly, this international multicenter study aims to enroll patients shortly after their infarction (day 6 to day 40) who have reduced left ventricular function (left ventricular ejection fraction </=0. 35) and impairment of cardiac autonomic function shown by depressed heart rate variability (standard deviation of normal-to-normal R-R intervals </=70 ms) or elevated average 24-hour heart rate (mean 24-hour R-R interval </=750 ms, assessed by Holter monitoring). Patients will be followed for approximately 3 years on average with subsequent data analysis based on the intent-to-treat principle. Primary outcome is all-cause death. The trial is expected to be completed in 2003.

CONCLUSIONS

DINAMIT is the first prospective study to evaluate the benefit of ICD therapy for the primary prevention of sudden cardiac death in patients at high risk after acute myocardial infarction.

Examining the influence of gender on medical students' decision making

Gender bias, described among practicing physicians, has rarely been examined in medical students. The current study examined the influence of gender bias on medical students' clinical decision making. We experimentally manipulated patient gender in 27 written clinical vignettes embedded in the United States Medical Licensing Examination (USMLE) Step 2 examination (a multiple-choice test of clinical decision making). Female and male patient versions of selected test cases were created within three categories: (1) diseases with previously established evidence of gender bias in the diagnosis or management of the disease, (2) diseases with a higher prevalence in a specific gender, and (3) diseases with similar prevalence in both genders and without evidence of gender bias in the literature. Among the 3059 students who wrote the USMLE Step 2 examination in August 1998, there were small but significant differences in performance on the 12 gender bias cases. Students performed worse for the female patient version of the cases compared with the male patient version of the cases (mean of 55.8% correct for female cases compared with 57.7% correct for male cases) (p < 0. 01). Our data suggest that students were variably influenced by gender bias in their investigation and management of patients in a written test of clinical decision making.

Therapeutic equivalence: all studies are not created equal

With an increasing number of available treatment options, clinicians must frequently evaluate whether comparable therapies are equivalent in terms of efficacy and safety. Two methodologically distinct study designs are used to establish therapeutic equivalence: standard superiority trials and true equivalence trials. In either study design, clinician-readers assess equivalence by examining both the statistical significance and the clinical importance of the study results (as defined by the minimally important difference, the smallest difference in patient outcome that would lead to an important difference in patient health status). Once therapeutic equivalence has been established, clinicians may select one therapy as the preferred treatment option because it offers other clinical benefits, such as a lower cost or a more convenient drug administration schedule.