Assessment of musculoskeletal physical examination skills and attitudes of orthopaedic residents

What do we know about Objective Structured Clinical Examination in Sport and Exercise Medicine? A scoping review

Background and objectives

Despite the importance of the Objective Structured Clinical Examination (OSCE) in Sport and Exercise Medicine, the literature on the topic is fragmented and has been poorly developed. The goal of this review was to map current knowledge about how the OSCE is used in Sport and Exercise Medicine, and to identify knowledge gaps for future research.

Method

The authors conducted a scoping review. They searched PubMed and Scopus for articles using key terms related to 'OSCE' and 'sport medicine' with no limit on search start date and up to July 2022. Retrieved records were imported, abstracts were screened, and full-text articles were reviewed. A forward and backward citation tracking was conducted. Data was extracted and a qualitative meta-summary of the studies was conducted.

Results

A total of 469 records were screened, and 22 studies were included. The objectives of the studies included using OSCEs to assess knowledge/skills after a training program (n = 11), to assess an intervention (n = 8), and to assess and improve the OSCE itself (n = 3). Thirteen studies reported validity and/or reliability of the OSCE.

Conclusion

Despite the widespread use of OSCEs in the examination of Sport and Exercise Medicine trainees, only a handful of scholarly works have been published. More research is needed to support the use of OSCE in Sport and Exercise Medicine for its initial purpose. We highlight avenues for future research such as assessing the need for a deeper exploration of the relationship between candidate characteristics and OSCE scores.

Development of an Orthopedic Surgery Anatomy Curricular Model for Fourth Year Medical Students Using a Modified Delphi Method

OBJECTIVE

The purpose of this study was to develop anatomy-focused learning outcomes that can be used to design a fourth-year elective for students matriculating into orthopedic surgery residencies.

DESIGN

A series of proposed learning outcomes (N=72) was developed using the ACGME Orthopedic Milestones 2.0 as a framework. In 2021, these were converted into a survey asking participants to rate the importance of each outcome on a 5-point Likert scale. The modified Delphi Method was used to refine the list of outcomes until group consensus was achieved. The consensus was defined using a conservative 3-tier approach.

SETTING

Eighteen academic centers with an associated orthopedic surgery residency.

PARTICIPANTS

Twenty-six orthopedic surgeons (ranging from 1 to 42 years in practice).

RESULTS

Of the 72 learning outcomes from the first-round survey, 25 met consensus criteria. Of the 62 learning outcomes from the second-round survey, 45 met consensus criteria. All learning outcomes that met consensus criteria after the second-round survey were stratified into low-yield (n = 8), intermediate-yield (n = 34), and high-yield (n = 28) categories.

CONCLUSION

Using a modified Delphi Method, this study elicited feedback from experts in the field of orthopedic surgery to develop a framework for a fourth-year elective focused on anatomical concepts important for students applying to residencies in orthopedic surgery. The product of this process affords a great deal of flexibility when utilizing the results of this study in institution-specific curricular development.

Musculoskeletal Educational Resources for the Aspiring Orthopaedic Surgeon

Musculoskeletal (MSK) education is underemphasized in medical school curricula, which can lead to decreased confidence in treating MSK conditions and suboptimal performance on orthopaedic surgery elective rotations or subinternships. Given the low amount of formalized education in MSK medicine, students aiming to learn about orthopaedic surgery must gain much of their foundational knowledge from other resources. However, there are currently no centralized introductory educational resources to fill this need. We provide a framework for navigating the different types of resources available for trainees and highlight the unaddressed needs in this area.

Improving resident education through unstable chicken hips: a novel way to teach an infant hip examination

Current clinical screening for infantile hip dysplasia relies on combined Ortolani and Barlow maneuvers, which have a quoted sensitivity and specificity of 74-98 and 84-99%, respectively. Teaching this delicate physical examination maneuver is difficult as it requires a distinct tactile feel. The purpose of this study is to validate a benchtop learning grocery-bought chicken simulator model of newborn hip instability through a pre- and post-test surveys. This model of hip dysplasia uses whole chickens. A posterior capsulotomy of the chicken's hip joint was performed to create instability. Provocative maneuvers to dislocate and relocate the hip were taught by a pediatric orthopedic surgeon. All participants completed an anonymous pre- and post-training surveys. A total of 58 participants were included in the study: 10 medical students, 13 pediatric residents, 15 orthopedic residents, and 20 orthopedic or pediatric attending physicians. The pediatric residents had performed the Barlow/Ortolani tests more than the orthopedic residents (96.15 ± 83.19 vs. 37.53 ± 60.89; P = 0.01); however, fewer pediatric residents reported feeling a positive examination (31 vs. 67%). The majority of the group agreed that the simulation felt and moved like an infant's hip (3.95 and 4.13; Likert five-point scale). The participants unanimously agreed that the model could be used to teach someone new to pediatrics the basic steps of the examination (4.91; Likert five-point scale) and should be implemented in the teaching curriculum (100%). The current study validates the benchtop model in teaching the clinical steps in detecting hip dysplasia. The model improved confidence and comfort level for all participants and proved to be a valuable tool for resident education in multiple specialties. By improving education with this model, we hope to improve early identification of hip dysplasia with increased accuracy across subspecialties.

When Is an Orthopedic Intern Ready to Take Call?

OBJECTIVE

While orthopedic residency training varies among programs, an inevitable phenomenon is a transition for interns from consistent oversight to independent call with indirect supervision. It is therefore crucial to reliably assess trainees' ability to perform basic procedures. The objective of the study was to evaluate the utility of a novel Orthopaedic Intern Skills Assessment (OISA) to assess skill level.

DESIGN

In a cohort study, participants were evaluated on their ability to complete eleven skills in a simulated environment. Using a standardized patient and/or cadaveric specimen, we assessed skeletal traction, joint aspiration, joint injection, laceration repair, ankle brachial index measurement, compartment pressure monitoring, upper and lower extremity splinting, informed consent, spine trauma exam, and cervical spine clearance abilities.

SETTING

The assessment took place in a medical simulation lab at the Oregon Health & Science University in Portland, Oregon.

PARTICIPANTS

Third- or fourth-year medical students interested in orthopedics, incoming interns (preinterns), and residents within 1 month of completing their intern year (postinterns) were invited to participate in the study. All interested individuals were included. Of the 20 individuals contacted, 14 (70%) consented: 4 medical students (40%), 5 preinterns (100%), and 5 postinterns (100%). All consenting individuals finished their participation in the research.

RESULTS

Postintern skill completion rate was significantly higher than preinterns (p = 0.006) and medical students (p < 0.001). Completion rates for preinterns were also significantly higher rate than medical students (p = 0.035).

CONCLUSIONS

Our OISA found that postinterns had reached a basic orthopedic skill level expected of a junior resident without in-house supervision. Our OISA also highlighted areas of training that needed further attention, which will help orthopedic training programs verify an appropriate level of skill as trainees' progress from a supervised intern year to taking indirectly supervised junior resident call, and help identify areas where increased training is needed.

Identifying and Monitoring Deficiencies in Physical Examination of the Foot and Ankle With Diagnostic Ultrasound: Experience From a Physical Medicine and Rehabilitation Residency Training Program

Despite the high incidence of foot and ankle injuries and their biomechanical importance to more proximal joints, the foot and ankle are some of the most daunting and underemphasized musculoskeletal structures in medical training. This study used musculoskeletal ultrasound to identify a knowledge gap in physical medicine and rehabilitation residents in foot and ankle surface anatomy palpation and to determine whether senior residents had higher examination performance compared with more junior residents. Physical medicine and rehabilitation residents at different levels of training were tested cross-sectionally, and palpation accuracy was compared by class year. There was a trend of improvement across class years, with significant class differences in accuracy for the talonavicular joint, calcaneocuboidal joint, and posterior tibialis and peroneal tendons (P < 0.05). Despite this trend, the accuracy was not consistently higher among the senior residents considering the training they received. For all 30 residents assessed, accuracy within 1 cm was highest for the tibiotalar joint (93.3%), peroneal tendons (83.3%), posterior tibialis tendon (63.3%), and talonavicular joint (50%). It was lower for the calcaneocuboidal joint (26.7%) and the second (13.3%) and fourth for the tarsometatarsal joints (20%). Anatomical knowledge and palpation skills of the foot and ankle, particularly at the midfoot and forefoot, may be an area of improvement for physical medicine and rehabilitation resident training.

Design and Implementation of a Musculoskeletal Ultrasound Curriculum for Physical Medicine and Rehabilitation Residents: Pilot Data on Improvement of Palpation Accuracy in Physical Examination

Studies have shown that physical medicine and rehabilitation residents have poor surface anatomy palpation accuracy, suggesting that new methods of teaching musculoskeletal (MSK) examination need to be found. This study describes the design of a novel MSK ultrasound course that integrated ultrasonography skills with palpation skills. Ultrasound was used to teach, validate, and refine physical medicine and rehabilitation residents' palpation of MSK structures. Surface anatomy palpation is intimately related to ultrasonography as clinicians should use palpation to guide their ultrasound examination rather than purely follow an algorithm. This study assessed whether the ultrasound course improved physical medicine and rehabilitation resident palpation accuracy at 12 upper limb structures. Palpation accuracy was tested at the beginning of their residency training and retested several weeks after completion of the ultrasound course's upper limb component, to assess retention of skill. There was significant improvement (P < 0.05) in 9 of 12 sites from pretesting to posttesting. Mean postcourse palpation accuracy was within 1 cm for 8 of 12 structures. This study demonstrates that an integrated MSK ultrasound and palpation curriculum improves palpation accuracy at multiple MSK structures and this improvement is retained. Physical medicine and rehabilitation residencies should consider integrating palpation skills into their ultrasound curriculum to improve the caliber of their trainees.

Developing Physical Exam Skills in Residency: Comparing the Perspectives of Residents and Faculty About Values, Barriers, and Teaching Methods

BACKGROUND

The physical examination (PE) skills of residents are often not improved since medical school. Unfortunately, how residents learn PE is not well understood. There is a paucity of research on the factors involved and the differences between resident and faculty perspectives. The authors sought to determine resident and faculty perceptions about the value of PE, the major barriers to learning PE, and the most effective teaching methods.

METHODS

Based on a rigorous process of literature review and semi-structured interviews, the authors developed an online survey which was sent to 406 internal medicine residents and 93 faculty at 3 institutions. Residents and faculty answered questions about both their own opinions and about their perception of the other group's opinions.

RESULTS

About 283 residents (70%) and 61 faculty (66%) completed the survey. Both residents and faculty rated the importance of PE similarly. Residents rated being too busy, followed by a lack of feedback, as the most significant barriers to learning PE. Faculty rated a lack of feedback, followed by a lack of resident accountability, as the most significant barriers. Both groups rated the availability of abnormal findings as the least significant barrier. Both groups agreed that faculty demonstration at the bedside was the most effective teaching method.

CONCLUSION

This survey can serve as a needs assessment for educational interventions to improve the PE skills of residents by focusing on areas of agreement between residents and faculty, specifically faculty demonstration at the bedside combined with feedback about residents' skills.

Brief Ultrasound-Aided Teaching to Improve the Accuracy and Confidence of Resident Musculoskeletal Palpation

BACKGROUND

Multiple studies demonstrate poor musculoskeletal palpation accuracy of physiatry residents. With the growing use of ultrasound clinically, it could serve as a powerful educational tool. However, there are no published studies examining the efficacy of ultrasound-aided education at the bedside, where much learning takes place during postgraduate training.

OBJECTIVE

To determine if brief ultrasound-aided teaching improves residents' accuracy and confidence of musculoskeletal palpation.

DESIGN

Before/After Trial.

SETTING

Academic Institution.

PARTICIPANTS

Ten physical medicine and rehabilitation residents were voluntary participants.

INTERVENTION

Each resident was given a survey to assess confidence in palpating the hook of the hamate and medial calcaneal tubercle. They then attempted to palpate and place a marker over these two structures in a model patient. Marker placement accuracy was verified by ultrasound. Faculty spent less than 1 minute per landmark, sonographically teaching its correct localization. The resident, after moving to a new model patient, was then re-tested on accurate marker placement for both landmarks. A repeat survey to assess confidence was administered.

MAIN OUTCOME MEASUREMENTS

Preintervention and postintervention accuracy and confidence of correct localization of both landmarks.

RESULTS

We used McNemar's and Wilcoxon's tests to determine whether the intervention improved the location accuracy and confidence of successful palpation, respectively. Confidence level of correct localization of two landmarks improved on average from 4.3 to 8.15 on a scale of 10 after intervention. Of 20 palpation attempts, 11 correctly placed the marker postintervention after an incorrect placement, 8 made no change, and one changed from correct to incorrect placement. The odds of improvement in accuracy was 11 (95% confidence interval [CI] 1.60-473.47, P < .01). Both tests showed significant improvements after the intervention at the significance level of .05.

CONCLUSIONS

Brief, ultrasound-aided teaching increases accuracy and confidence of residents' musculoskeletal palpation.

Student perceived impact of a physical, kinetic and interactive model

Current instructional tools for anatomy education are insufficient scaffolds for learning abstract visual concepts such as basic biomechanics. Diagrams, illustrations and even computer-generated models may be adequate for identification purposes, but are typically not effective when it comes to demonstrating dynamic functions. Evidence from educational concepts, such as the active learning principle in constructivism, indicate that current tools are ineffective due to a lack of opportunity for hands-on or interactive, learning. To address this, our interdisciplinary team designed an instructional model of the canine thoracic limb which is physical, kinetic and interactive. We hypothesised that the unique combination of these three crucial elements would enhance the student learning experience. In order to test this hypothesis, we asked 126 undergraduate students in a biomedical anatomy course to interact with the model. Students were then invited to complete a survey evaluating their experience using the thoracic limb model. Results from completed surveys showed that students perceived the model as easy to use and helpful with understanding basic biomechanical concepts. These results indicate that there is potential for the model to positively impact the students' learning. Future studies will include quantitative evaluation of student performance and cognitive impact in the biomedical anatomy course.

Resident Accuracy of Musculoskeletal Palpation With Ultrasound Verification

OBJECTIVES

The purpose of this observational study was to determine the accuracy of musculoskeletal palpation of the medial joint line of the knee, medial patellar tendon, and posterior tibialis tendon verified by ultrasound imaging among physical medicine and rehabilitation residents.

METHODS

Eighteen physical medicine and rehabilitation resident physicians at a single specialized institution were asked to identify the medial joint line of the knee, medial patellar tendon, and posterior tibialis tendon on 2 separate standardized patient models during a single data collection. They were asked to place a paper clip flat on the surface of the skin parallel to the specified anatomic structure. A high-frequency linear array transducer was used to identify whether the paper clip was correctly placed over the structures and to measure the distance from the intended structure.

RESULTS

The accuracy rates for palpation of the medial joint line, medial patellar tendon, and posterior tibialis tendon in both models were 14%, 36%, and 28%, respectively, for all levels of residents. Accuracy rates for all of the structures by level of education were 19%, 29%, and 31% for postgraduate years 2, 3, and 4. Median confidence scores were 3.75, 3.5, and 2 for the medial joint line, medial patellar tendon, and posterior tibialis tendon.

CONCLUSIONS

This study highlights the level of inaccuracy of musculoskeletal palpation skills and draws further attention to an area of much-needed improvement in our musculoskeletal residency training programs. Ultrasound imaging is an effective noninvasive method for providing swift feedback to medical students and residents and thereby reduce the instances of inaccurate musculoskeletal palpation.

Improving diagnosis in healthcare: Local versus national adoption of recommended guidelines for the clinical breast examination

BACKGROUND

This study explores the long-term effectiveness of a newly developed clinical skills curriculum.

METHODS

Students (N = 40) were exposed to a newly developed, simulation-based, clinical breast exam (CBE) curriculum. The same students returned one year later to perform the CBE and were compared to a convenience sample of medical students (N = 15) attending a national conferences. All students were given a clinical vignette and performed the CBE. CBE techniques were video recorded. Chi-squared tests were used to assess differences in CBE technique.

RESULTS

Students exposed to a structured curriculum performed physical examination techniques more consistent with national guidelines than the random, national student sample. Structured curriculum students were more organized, likely to use two hands, a linear search pattern, and include the nipple-areolar complex during the CBE compared to national sample (p < 0.01).

CONCLUSIONS

Students exposed to a structured skills curriculum more consistently performed the CBE according to national guidelines. The variability in technique compared with the national sample of students calls for major improvements in adoption and implementation of structured skills curricula.

Does Ultrasound-Enhanced Instruction of Musculoskeletal Anatomy Improve Physical Examination Skills of First-Year Medical Students?

OBJECTIVES

Ultrasound imaging is commonly used to teach basic anatomy to medical students. The purpose of this study was to determine whether learning musculoskeletal anatomy with ultrasound improved performance on medical students' musculoskeletal physical examination skills.

METHODS

Twenty-seven first-year medical students were randomly assigned to 1 of 2 instructional groups: either shoulder or knee. Both groups received a lecture followed by hands-on ultrasound scanning on live human models of the assigned joint. After instruction, students were assessed on their ability to accurately palpate 4 anatomic landmarks: the acromioclavicular joint, the proximal long-head biceps tendon, and the medial and lateral joint lines of the knee. Performance scores were based on both accuracy and time. A total physical examination performance score was derived for each joint. Scores for instructional groups were compared by a 2-way analysis of variance with 1 repeated measure. Significant findings were further analyzed with post hoc tests.

RESULTS

All students performed significantly better on the knee examination, irrespective of instructional group (F = 14.9; df = 1.25; P = .001). Moreover, the shoulder instruction group performed significantly better than the knee group on the overall assessment (t = -3.0; df = 25; P < .01). Post hoc analyses revealed that differences in group performance were due to the shoulder group's higher scores on palpation of the biceps tendon (t = -2.8; df = 25; P = .01), a soft tissue landmark. Both groups performed similarly on palpation of all other anatomic structures.

CONCLUSIONS

The use of ultrasound appears to provide an educational advantage when learning musculoskeletal physical examination of soft tissue landmarks.

Examination to assess the clinical examination and documentation of spine pathology among orthopedic residents

BACKGROUND CONTEXT

The Accreditation Council for Graduate Medical Education (ACGME) guidelines requires residency programs to teach and evaluate residents in six overarching "core competencies" and document progress through educational milestones. To assess the progress of orthopedic interns' skills in performing a history, physical examination, and documentation of the encounter for a standardized patient with spinal stenosis, an objective structured clinical examination (OSCE) was conducted for 13 orthopedic intern residents, following a 1-month boot camp that included communications skills and curriculum in history and physical examination. Interns were objectively scored based on their performance of the physical examination, communication skills, completeness and accuracy of their electronic medical record (EMR), and their diagnostic conclusions gleaned from the patient encounter.

PURPOSE

The purpose of this study was to meaningfully assess the clinical skills of orthopedic post-graduate year (PGY)-1 interns. The findings can be used to develop a standardized curriculum for documenting patient encounters and highlight common areas of weakness among orthopedic interns with regard to the spine history and physical examination and conducting complete and accurate clinical documentation.

STUDY SETTING

A major orthopedic specialty hospital and academic medical center.

METHODS

Thirteen PGY-1 orthopedic residents participated in the OSCE with the same standardized patient presenting with symptoms and radiographs consistent with spinal stenosis. Videos of the encounters were independently viewed and objectively evaluated by one investigator in the study. This evaluation focused on the completeness of the history and the performance and completion of the physical examination. The standardized patient evaluated the communication skills of each intern with a separate objective evaluation. Interns completed these same scoring guides to evaluate their own performance in history, physical examination, and communications skills. The interns' documentation in the EMR was then scored for completeness, internal consistency, and inaccuracies.

RESULTS

The independent review revealed objective deficits in both the orthopedic interns' history and the physical examination, as well as highlighted trends of inaccurate and incomplete documentation in the corresponding medical record. Communication skills with the patient did not meet expectations. Further, interns tended to overscore themselves, especially with regard to their performance on the physical examination (p<.0005). Inconsistencies, omissions, and inaccuracies were common in the corresponding medical notes when compared with the events of the patient encounter. Nine of the 13 interns (69.2%) documented at least one finding that was not assessed or tested in the clinical encounter, and four of the 13 interns (30.8%) included inaccuracies in the medical record, which contradicted the information collected at the time of the encounter.

CONCLUSIONS

The results of this study highlighted significant shortcomings in the completeness of the interns' spine history and physical examination, and the accuracy and completeness oftheir EMR note. The study provides a valuable exercise for evaluating residents in a multifaceted, multi-milestone manner that more accurately documents residents' clinical strengths and weaknesses. The study demonstrates that orthopedic residents require further instruction on the complexities of the spinal examination. It validates a need for increased systemic support for improving resident documentation through comprehensive education and evaluation modules.

Competency based clinical shoulder examination training improves physical exam, confidence, and knowledge in common shoulder conditions

BACKGROUND

Deficiencies in musculoskeletal knowledge are reported at every stage of learning. Medical programs are looking for effective ways to incorporate competency-based training into musculoskeletal education.

AIM

To evaluate the impact of bedside feedback on learner's shoulder examination skills, confidence, and knowledge of common shoulder conditions.

SETTING

Four-week musculoskeletal clinic rotation.

PARTICIPANTS

UCSD third year medical students and internal medicine residents.

PROGRAM DESCRIPTION

Learners completed three baseline evaluations: videotaped shoulder examination, attitude survey, and knowledge test. During the 4-week intervention learners received bedside observation and feedback from musculoskeletal experts while evaluating patients with shoulder conditions. Post-intervention learners repeated the three assessments.

PROGRAM EVALUATION

Eighty-nine learners participated. In the primary outcome measure evaluating the pre/post videotaped shoulder examination, significant improvement was seen in 21 of 23 shoulder examination maneuvers. Secondary outcomes include changes in learner confidence and knowledge. Greatest gains in learner confidence were seen in performing the shoulder examination (61.5% improvement) and performing injections (97.1% improvement). Knowledge improved significantly in all categories including anatomy/examination interpretation, diagnosis, and procedures.

DISCUSSION

Direct observation and feedback during clinical evaluation of patients with shoulder pain improves shoulder examination competency, provider confidence, and knowledge of common shoulder conditions.

A systematic review of assessments for procedural skills in physiotherapy education / Assessment von prozeduralen Fähigkeiten in der physiotherapeutischen Ausbildung: Ein systematischer Review

Introduction

Learning of procedural skills is important in the education of physiotherapists. It is the aim of physiotherapy degree programmes that graduates are able to practice selected procedures safely and efficiently. Procedural competency is threatened by an increasing and diverse amount of procedures that are incorporated in university curricula. As a consequence, less time is available for the learning of each specific procedure. Incorrectly performed procedures in physiotherapy might be ineffective and may result in injuries to patients and physiotherapists. The aim of this review was to synthesise relevant literature systematically to appraise current knowledge relating to assessments for procedural skills in physiotherapy education.

Method

A systematic search strategy was developed to screen five relevant databases (CINAHL, Cochrane Central, SportDISCUS, ERIC and MEDLINE) for eligible studies. The included assessments were evaluated for evidence of their reliability and validity.

Results

The search of electronic databases identified 560 potential records. Seven studies were included into this systematic review. The studies reported eight assessments of procedural skills. Six of the assessments were designed for a specific procedure and two assessments were considered for the evaluation of more than one procedure. Evidence to support the measurement properties of the assessment was not available for all categories.

Discussion

It was not possible to recommend a single assessment of procedural skills in physiotherapy education following this systematic review. There is a need for further development of new assessments to allow valid and reliable assessments of the broad spectrum of physiotherapeutic practice

Assessing musculoskeletal examination skills and diagnostic reasoning of 4th year medical students using a novel objective structured clinical exam

BACKGROUND

Medical students have difficulty performing and interpreting musculoskeletal physical examinations and interpreting the findings. Research has focused on students' knowledge deficits, but there are few direct assessments of students' ability to perform a hypothesis-driven physical examination (HDPE). We developed a novel musculoskeletal Objective Structured Clinical Exam (OSCE) focusing on HDPE skills for disorders of the shoulder, back and knee, and used it to explore medical student diagnostic reasoning.

METHODS

A multidisciplinary group of musculoskeletal specialists developed and gathered validity evidence for a three station OSCE focusing on the HDPE of the shoulder, back and knee, emphasizing the ability to anticipate (identify pre-encounter) expected physical exam findings, and subsequently perform discriminatory physical examination maneuvers. The OSCE was administered to 45 final year medical students. Trained faculty observed and scored students' ability to anticipate exam findings and perform diagnostic examination maneuvers on simulated patients. Encounters were digitally recorded and scored again by another trained faculty member. Inter-rater reliability for each maneuver was estimated using type-2 intra-class correlations (ICC). Percentages of perfect scores for anticipation and performance were calculated. Pearson's correlation between anticipation and performance scores was computed for each maneuver and their relationship to diagnostic accuracy was tested with logistic regression.

RESULTS

Inter-rater reliability was good (ICC between .69 and .87) for six exam maneuvers. Maneuver performance was overall poor, with no discriminatory maneuver performed correctly by more than two thirds of students, and one maneuver only performed correctly by 4 % of students. For the shoulder and knee stations, students were able to anticipate necessary discriminatory exam findings better than they could actually perform relevant exam maneuvers. The ability to anticipate a discriminatory finding correlated with the ability to perform the associated maneuver correctly, with the exception of the ability to perform maneuvers needed to diagnose a torn anterior cruciate ligament of the knee. Neither the ability to anticipate or perform was predictive of identifying correct diagnoses for the different cases.

CONCLUSIONS

A novel musculoskeletal OSCE, based on principles of the hypothesis-driven physical examination, was able to identify significant deficiencies in examination skills needed to diagnose common disorders of the shoulder, back and knee amongst graduating medical students. In addition, the OSCE demonstrated that accurate anticipation of discriminatory examination findings correlates with ability to perform the associated maneuver; however, the ability to anticipate exceeds the ability to perform. Students do not appear to be using the physical exam to inform their diagnostic reasoning. The findings of this study have implications for both assessment and teaching of the musculoskeletal exam.

Four Successive Years of Trauma-Based Objective Structured Clinical Evaluations: What Have We Learned?

OBJECTIVE

We studied 4 years of data from our objective structured clinical examination (OSCE) to determine whether residents improved skills in the trauma physical examination (PE). Our hypothesis was that residents would improve with each year of training, and that resident scores would also improve over time, with each year of OSCE testing.

DESIGN

We developed 2 polytrauma scenarios and alternated yearly. Residents were graded on PE, history taking, and professionalism. Scenarios simulated trauma cases residents could encounter during training. We compared each year for any significant (p < 0.05) changes overall and between postgraduate years.

SETTING

The Ohio State University Wexner Medical Center.

PARTICIPANTS

Orthopedic faculty and residents.

RESULTS

Across years 2010 to 2013, we saw no significant improvement in PE skills. History-taking skills trended upwards, but this was not significant, and communication skills significantly improved.

CONCLUSIONS

We expected after instituting a trauma OSCE that we would see an improvement in residents' PE skills, which we did not. We observed an overall improvement in ability to interact and communicate with patients and ask appropriate questions.

The effects of knee joint kinematics on anterior cruciate ligament injury and articular cartilage damage

This study determined which knee joint motions lead to anterior cruciate ligament (ACL) rupture with the knee at 25° of flexion. The knee was subjected to internal and external rotations, as well as varus and valgus motions. A failure locus representing the relationship between these motions and ACL rupture was established using finite element simulations. This study also considered possible concomitant injuries to the tibial articular cartilage prior to ACL injury. The posterolateral bundle of the ACL demonstrated higher rupture susceptibility than the anteromedial bundle. The average varus angular displacement required for ACL failure was 46.6% lower compared to the average valgus angular displacement. Femoral external rotation decreased the frontal plane angle required for ACL failure by 27.5% compared to internal rotation. Tibial articular cartilage damage initiated prior to ACL failure in all valgus simulations. The results from this investigation agreed well with other experimental and analytical investigations. This study provides a greater understanding of the various knee joint motion combinations leading to ACL injury and articular cartilage damage.

Anatomy integration blueprint: A fourth-year musculoskeletal anatomy elective model

Current undergraduate medical school curricular trends focus on both vertical integration of clinical knowledge into the traditionally basic science-dedicated curricula and increasing basic science education in the clinical years. This latter type of integration is more difficult and less reported on than the former. Here, we present an outline of a course wherein the primary learning and teaching objective is to integrate basic science anatomy knowledge with clinical education. The course was developed through collaboration by a multi-specialist course development team (composed of both basic scientists and physicians) and was founded in current adult learning theories. The course was designed to be widely applicable to multiple future specialties, using current published reports regarding the topics and clinical care areas relying heavily on anatomical knowledge regardless of specialist focus. To this end, the course focuses on the role of anatomy in the diagnosis and treatment of frequently encountered musculoskeletal conditions. Our iterative implementation and action research approach to this course development has yielded a curricular template for anatomy integration into clinical years. Key components for successful implementation of these types of courses, including content topic sequence, the faculty development team, learning approaches, and hidden curricula, were developed. We also report preliminary feedback from course stakeholders and lessons learned through the process. The purpose of this report is to enhance the current literature regarding basic science integration in the clinical years of medical school.

One week with the experts: a short course improves musculoskeletal undergraduate medical education

BACKGROUND

Musculoskeletal problems constitute a considerable workload across all medical and surgical disciplines. There is a mismatch between the burden of musculoskeletal medicine seen by non-orthopaedists clinically and the amount of time afforded it in undergraduate training. Recent initiatives to address this include the United States Bone and Joint Decade and curricular innovations that demonstrate a benefit from improved instruction. Such curricular interventions are usually situated within a wider program reform and last a short time. Gaining institutional support and securing curricular time are challenging. This article shows the positive evaluation of a brief, intense course on musculoskeletal medicine.

METHODS

A one-week course was offered to 154 medical students. The study took place in Ireland, where the student body comprises a mix of graduate students and undergraduate students, who enter medical school directly from second-level education. This course comprised brief didactic talks, case-based small group work, and physical examination skills demonstration. Attitudes toward musculoskeletal medicine prior to the course were elicited. The course was evaluated using pre-course and post-course standardized cognitive tests. Long-term retention was evaluated by end-of-year extended matching questions and an objective standardized clinical examination station. The test results between undergraduate and graduate students and student rating of musculoskeletal medicine as important or less important were compared.

RESULTS

Complete data were available for 125 students (81%). Seventy-four percent of students rated musculoskeletal medicine to be of major or critical importance to their career. There was a significant difference (p &lt; 0.001, r = 0.678) in the mean score of the standardized cognitive test between the pre-course test and the post-course test; the mean performance score (and standard deviation) was 48.2% ± 14.2% (range, 17% to 79%), with a pass rate of 3.3%, for the pre-course test and 75.3% ± 15.02% (range, 32% to 100%), with a pass rate of 61%, for the post-course test. At the end of the year, 69.9% of students passed the extended matching questions and 96.7% passed an objective standardized clinical examination station. Graduate students performed better on the post-course standardized cognitive test score (p &lt; 0.001) and objective standardized clinical examination (p &lt; 0.05). Students who rated musculoskeletal medicine as important did not perform better than those who rated it as less important (p = 0.334).

CONCLUSIONS

We report a favorable evaluation of a short, intense course on musculoskeletal medicine and suggest that the introduction of basic concepts of musculoskeletal medicine is feasible within established curricula.

The case for orthopaedic medicine in Israel

BACKGROUND

Musculoskeletal complaints are probably the most frequent reasons for visiting a doctor. They comprise more than a quarter of the complaints to primary practitioners and are also the most common reason for referral to secondary or tertiary medicine. The clinicians most frequently consulted on musculoskeletal problems, and probably perceived to know most on the topic are orthopaedic surgeons. But in Israel, there is significant ambivalence with various aspects of the consultations provided by orthopaedic surgeons, both among the public and among various groups of clinicians, particularly family practitioners and physiotherapists.

METHODS

In order to understand this problem we integrate new data we have collected with previously published data. New data include the rates of visits to orthopaedic surgeons per annum in one of Israel's large non-profit HMO's, and the domains of the visits to an orthopaedic surgeon.

RESULTS

Orthopaedic surgeons are the third most frequently contracted secondary specialists in one of the Israeli HMO's. Between 2009 and 2012 there was a 1.7% increase in visits to orthopaedists per annum (P < 0.0001, after correction for population growth). Almost 80% of the domains of the problems presented to an orthopaedic surgeon were in fields orthopaedic surgeons have limited formal training.

DISCUSSION

While orthopaedic surgeons are clearly the authority on surgical problems of the musculoskeletal system, most musculoskeletal problems are not surgical, and the orthopaedic surgeon often lacks training in these areas which might be termed orthopaedic medicine. Furthermore, in Israel and in many other developed countries there is no accessible medical specialty that studies these problems, trains medical students in the subject and focuses on treating these problems. The neglect of this area which can be called the "Orthopaedic Medicine Lacuna" is responsible for inadequate treatment of non-surgical problems of the musculoskeletal system with immense financial implications. We present a preliminary probe into possible solutions which could be relevant to many developed countries.

Objective Structured Clinical Examinations: a guide to development and implementation in orthopaedic residency

Objective Structured Clinical Examinations (OSCEs) have been used extensively in medical schools and residency programs to evaluate various skills, including the six core competencies outlined by the Accreditation Council for Graduate Medical Education (ACGME). Orthopaedic surgery residency programs will be required by the ACGME to assess residents on core competencies in the Milestone Project. Thus, it is important that evaluations be made in a consistent, objective manner. Orthopaedic residency programs can also use simulation models in the examination to accurately and objectively assess residents' skills as they progress through training. The use of these models will become essential as resident work hours are decreased and opportunities to observe skills become more limited. In addition to providing a method to assess competency, OSCEs are a valuable tool for residents to develop and practice important clinical skills. Here, we describe a method for developing a successful OSCE for use in orthopaedic surgical resident training.

Survey of inspection and palpation rates among spine providers: evaluation of physician performance of the physical examination for patients with low back pain

STUDY DESIGN

Survey from July 2011 to April 2012 of adult patients with primary complaint of low back pain (LBP).

OBJECTIVE

To determine the frequency of physical examination being performed by various providers, as measured by frequency of inspection and palpation, of patients with LBP and to describe patient ratings of these examinations.

SUMMARY OF BACKGROUND DATA

The physical examination is a cornerstone of any evaluation of patients with LBP. With increasing reliance on diagnostic imaging, there is concern that patients are not being examined comprehensively, but to our knowledge, no studies have ever investigated how often the physical examination is performed in patients with LBP.

METHODS

Survey participants were asked to list the types of physicians that they had seen for LBP within the past 1 year and for each physician encounter to answer 2 "yes/no" questions: (1) whether they had removed their clothes or put on a gown or shorts during the examination (our proxy for inspection) and (2) whether the provider had placed his or her hands on the patient (our proxy for palpation). Subjects also provided quality ratings for each provider's physical examination. Main outcome measures included frequency of inspection and palpation and subjects' ratings of each physical examination.

RESULTS

A total of 295 surveys were collected reflecting 696 prior physician encounters. Inspection was done in 57% of physician encounters. Across specialties, orthopedic surgeons had the highest reported rate of inspection at 72%. The worst was among chiropractors at 40%. Palpation occurred in 80% of physician encounters. Chiropractors had the highest rate of palpation at 94%. The lowest rate was among neurosurgeons at 58%.

CONCLUSION

Our data suggest that approximately 43% of patient visits for LBP involved no inspection and nearly 20% without palpation. These numbers reflect a need for improvement among providers who treat patients with LBP.

LEVEL OF EVIDENCE

N/A.

Development and validation of a musculoskeletal physical examination decision-making test for medical students

OBJECTIVE

Despite a renewed emphasis among educators, musculoskeletal education is still lacking in medical school and residency training programs. We created a musculoskeletal multiple-choice physical examination decision-making test to assess competency and physical examination knowledge of our trainees.

DESIGN

We developed a 20-question test in musculoskeletal physical examination decision-making test with content that most medical students and orthopedic residents should know. All questions were reviewed by ratings of US orthopedic chairmen. It was administered to postgraduate year 2 to 5 orthopedic residents and 2 groups of medical students: 1 group immediately after their 3-week musculoskeletal course and the other 1 year after the musculoskeletal course completion. We hypothesized that residents would score highest, medical students 1 year post-musculoskeletal training lowest, and students immediately post-musculoskeletal training midrange. We administered an established cognitive knowledge test to compare student knowledge base as we expected the scores to correlate.

SETTING

Academic medical center in the Midwestern United States.

PARTICIPANTS

Orthopedic residents, chairmen, and medical students.

RESULTS

Fifty-four orthopedic chairmen (54 of 110 or 49%) responded to our survey, rating a mean overall question importance of 7.12 (0 = Not Important; 5 = Important; 10 = Very Important). Mean physical examination decision-making scores were 89% for residents, 77% for immediate post-musculoskeletal trained medical students, and 59% 1 year post-musculoskeletal trained medical students (F = 42.07, p<0.001). The physical examination decision-making test was found to be internally consistent (Kuder-Richardson Formula 20 = 0.69). The musculoskeletal cognitive knowledge test was 78% for immediate post-musculoskeletal trained students and 71% for the 1 year post-musculoskeletal trained students. The student physical examination and cognitive knowledge scores were correlated (r = 0.54, p<0.001), but were not significantly different for either class.

CONCLUSIONS

The physical examination decision-making test was found to be internally consistent in exposing the deficiencies of musculoskeletal education skills of our medical students and differentiated between ability levels in musculoskeletal physical examination decision-making (residents vs recently instructed musculoskeletal students vs 1 year post-musculoskeletal instruction).

Surgery or consultation: a population-based cohort study of use of orthopaedic surgeon services

BACKGROUND

This population-based cohort study has the objective to understand the sociodemographic characteristics and health conditions of patients who do not receive surgery within 18 months following an ambulatory visit to an orthopaedic surgeon.

METHODS

Administrative healthcare databases in Ontario, Canada were linked to identify all patients making an initial ambulatory visit to orthopaedic surgeons between October 1(st), 2004 and September 30(th), 2005. Logistic regression was used to examine predictors of not receiving surgery within 18 months.

RESULTS

Of the 477,945 patients in the cohort 49% visited orthopaedic surgeons for injury, and 24% for arthritis. Overall, 79.3% did not receive surgery within 18 months of the initial visit, which varied somewhat by diagnosis at first visit (84.5% for injury and 73.0% for arthritis) with highest proportions in the 0-24 and 25-44 age groups. The distribution by income quintile of patients visiting was skewed towards higher incomes. Regression analysis for each diagnostic group showed that younger patients were significantly more likely to be non-surgical than those aged 65+ years (age 0-24: OR 3.45 95%CI 3.33-3.57; age 25-44: OR 1.30 95%CI 1.27-1.33). The odds of not getting surgery were significantly higher for women than men for injury and other conditions; the opposite was true for arthritis and bone conditions.

CONCLUSION

A substantial proportion of referrals were for expert diagnosis or advice on management and treatment. The findings also suggest socioeconomic inequalities in access to orthopaedic care. Further research is needed to investigate whether the high caseload of non-surgical cases affects waiting times to see a surgeon. This paper contributes to the development of evidence-based strategies to streamline access to surgery, and to develop models of care for non-surgical patients to optimize the use of scarce orthopaedic surgeon resources and to enhance the management of musculoskeletal disorders across the care continuum.