Orthopedic In-Training Examination: A Performance Review Based on Program- and Resident-Specific Characteristics

Analysis of Questions in Sections of the Orthopaedic In-Training Examination: A Scoping Review

PURPOSE

The purpose of this review was to assess all available studies that analyzed the types of questions in individual sections of the Orthopaedic In-Training Examination, which may be used as a reference for residents studying for their examination.

METHODS

Following the Providing Innovative Service Models and Assessment extension for Scoping Reviews guidelines, a systematic review was conducted on studies that report on sections or question categories of the Orthopaedic In-Training Examination using PubMed, MEDLINE, and Web of Science databases. Two reviewers and an arbitrator reviewed and extracted relevant data from 20 included studies which made up the systematic review.

RESULTS

All 20 studies in the review reported the mean number of questions per section, with the highest coming from musculoskeletal trauma (18.9% to 19.0%). 18 studies reported the Buckwalter taxonomic classification; 42.0% of questions were T1, 18.2% were T2, and 39.5% were T3 with a wide range from section to section. Primary sources were nearly three times more likely to be cited when compared with textbook sources. There were 12 journals that were commonly cited with the most being the Journal of Bone and Joint Surgery: American Volume (17/18).

DISCUSSION

This study accurately portrays the characteristics of each section of the Orthopaedic In-Training Examination over the past 10 years. These data suggest that orthopaedic residents may be inclined to focus on musculoskeletal trauma, topics related to clinical management, and primary journal sources for studying. In addition, residency programs may choose to focus on higher yield sources or material to prepare their residents for the examination.

Recent Trends in Spine Topics on the Orthopaedic In-Training Examination

INTRODUCTION

The Orthopaedic In-Training Examination (OITE) is an important metric for orthopaedic residents and residency programs to gauge a resident's orthopaedic knowledge. Because the OITE is correlated with the likelihood of passing part I of the American Board of Orthopaedic Surgery, greater emphasis is being placed on the examination. However, a detailed look at the questions most likely to appear on the spine subsection of the OITE has not been done in the past decade.

METHODS

Digital copies of the OITEs during the years 2017 through 2021 were obtained online through the "ResStudy" program within the American Academy of Orthopaedic Surgeons Online Learning Platform. All spine-related questions were categorized into five different categories including type of spine question (knowledge-based, diagnosis, or evaluation/management), anatomical region, imaging modality provided, subject matter, and referenced journal or textbook. The total number and likelihood of each question type to appear on the OITE were defined as mean and percentage of the total number of spine questions, respectively.

RESULTS

A total of 139 spine questions were identified on the OITE during the years 2017 to 2021. The most common type of spine questions were evaluation/management (N = 65) and knowledge-based questions. We identified lumbar (N = 45), cervical (N = 42), thoracolumbar (N = 13), and thoracic (N = 12) as the most commonly tested anatomical regions. Spinal trauma (N = 26), disk disease/disk herniation (N = 16), postoperative complications (N = 15), and scoliosis/sagittal balance (N = 15) were the most commonly tested material. Spine (N = 54) was almost two times more likely to be referenced as the source for the tested material compared with other journals or textbooks.

CONCLUSIONS

Understanding the spine topics most likely to appear on the OITE may allow orthopaedic residents and residency programs to supplement educational objectives toward the highest yield spine topics and journals.

Analysis of the OITE Oncology Section: An Updated Review of Years 2013 to 2019

OBJECTIVES

The importance of the Orthopaedic In-Training Examination (OITE) is well documented. The purpose of this study is to provide an updated analysis of the oncology section compared to the review by Frassica et al. from 2002 to 2006, as a means to provide insight into more focused resident study.

DESIGN

This study is a retrospective database review using published OITE exams from years 2013 to 2019. Methods were based off a previous review by Frassica et al. where oncology-related questions were analyzed for underlying diagnosis, benign versus malignant condition, imaging and histology provided, and genes/translocations tested. Questions were classified by category and taxonomy.

RESULTS

Oncology-related questions per exam ranged from 19 (7%) to 23 (8.4%) of total questions, which is fewer than years 2002 to 2006. Twenty malignant and 27 benign entities were tested with malignant conditions tested at a higher rate of 1.3:1 versus benign. Eighteen combinations of imaging modalities were provided for analysis versus 11 from 2002 to 2006. With regard to taxonomy, the average number of questions per classification ranged from 2.4 to 5.4. The least common classification tested was treatment modality and the most commonly tested classification was treatment from diagnosis (taxonomy 3). Previously, tumor knowledge (taxonomy 1) was most tested with an average of 8.8 questions per exam. 12 questions were directly related to genes and translocations across all years.

CONCLUSIONS

Oncology questions made up a smaller percentage of the OITE exam than previous years, although more conditions were tested using more imaging combinations, necessitating a wider range of knowledge. However, malignant conditions continue to be tested more commonly. There has been a shift toward Taxonomy 3 level questions, indicating a higher level of thought processing required from residents as opposed to recall. Additionally, genes and translocations became more commonly tested throughout the most recent analysis, indicating a focus for future years of study.

Orthopaedic In-Training Examination: History, Perspective, and Tips for Residents

Introduced in 1963, the orthopaedic in-training examination (OITE) is a standardized, national test administered annually to orthopaedic residents by the American Academy of Orthopaedic Surgeons. The examination consists of 275 multiple-choice questions that cover 11 domains of orthopaedic knowledge, including basic science, foot and ankle, hand, hip and knee, oncology, pediatrics, shoulder and elbow, spine, sports medicine, trauma, and practice management. The OITE has been validated and is considered predictive of success in both orthopaedic surgery residency and on the American Board of Orthopaedic Surgery part I examination. This article provides a historical overview of the OITE, details its current structure and scoring system, and reviews currently available study materials. For examination preparation, the residents are encouraged to (1) start the examination preparation early, (2) practice on old OITE or self-assessment examination questions, (3) focus on the questions answered incorrectly, (4) focus on comprehension over memorization, and (5) recognize and avoid burnout. Finally, the residents should have a systemic way of approaching each multiple-choice question, both during practice and on the actual examination.

Orthopaedic Resident Burnout Is Associated with Poor In-Training Examination Performance

BACKGROUND

Resident burnout-the state of exhaustion, maladaptive detachment, and low sense of accomplishment-is a widely documented phenomenon that affects between 27% and 75% of residents in the United States. To our knowledge, no previous study has examined the relationship between resident burnout and performance on the Orthopaedic In-Training Examination (OITE). The current investigation sought to evaluate whether an association exists between indices of orthopaedic surgery resident burnout as assessed by the Maslach Burnout Inventory (MBI) and performance on the OITE.

METHODS

In a cross-sectional study of the orthopaedic surgery residents at a single large academic institution, the MBI was completed by all trainees in May 2016. The results of the 2016 OITE were documented for each resident, including the percentage of correctly answered questions and OITE percentile ranking. To control for individual test-taking skills, United States Medical Licensing Examination (USMLE) Step-1 and Step-2 scores also were documented for each resident. The relationship between the MBI subscale scores and OITE performance was evaluated.

RESULTS

The analysis included 100% of the 62 orthopaedic surgery residents in training at our institution. Sixteen (25.8%) of the residents experienced at least moderate emotional exhaustion, while 32 (51.6%) of the residents experienced at least moderate depersonalization and 8 (12.9%) of the residents experienced a moderate sense of impaired personal accomplishment. Postgraduate year (PGY)-2 residents had the highest emotional exhaustion and depersonalization scores compared with residents in other years of training. Each of the 3 MBI indices of burnout was associated with worse OITE performance when controlling for general test-taking ability.

CONCLUSIONS

In this study of orthopaedic surgery residents at a large academic training program, burnout was present among residents in all PGYs of training; it was most prevalent during the second year of training. Increased levels of the 3 components of burnout were associated with worse performance on the OITE. While there is a lack of consensus in the existing literature, this study provides additional evidence that burnout is negatively associated with 1 aspect of overall resident performance.

CLINICAL RELEVANCE

Orthopaedic surgery residency training is challenging; residents are tasked to acquire a considerable amount of knowledge, develop complex surgical skills, and hone critical clinical thinking in a relatively short period of time. Identifying modifiable contributors to resident burnout and the development of strategies to promote resident wellness during training are important as we strive toward developing the next generation of capable, competent, and well-balanced orthopaedic surgeons.

Generational Differences in Grit, Self-Control, and Conscientiousness Among Orthopaedic Surgeons: From Millennials to Baby Boomers

BACKGROUND

The training process and practice of orthopaedic surgery is demanding and arduous. Accordingly, grit, self-control, and conscientiousness are desirable qualities in orthopaedic surgeons. Some established orthopaedists have expressed concern that the future generation of surgeons may not possess the same level of grit as their predecessors. The purpose of this study was to evaluate levels of grit among attending orthopaedic surgeons, identify predictors of grit in orthopaedic surgeons, and compare grit scores between attending surgeons and orthopaedic residency applicants. We hypothesized that applicants would demonstrate lower grit and self-control scores but greater conscientiousness scores than attending surgeons.

METHODS

A total of 2,342 attending orthopaedic surgeons and 895 orthopaedic residency applicants from the 2016-2017 National Resident Matching Program (NRMP) were given surveys that quantified their grit, self-control, and conscientiousness. Demographic and career information also was collected.

RESULTS

Assessments were completed by 655 (28%) of 2,342 practicing orthopaedic surgeons and 455 (50.8%) of 895 orthopaedic residency applicants. The residency applicants demonstrated higher mean grit scores (4.12 of 5.0) than the attending orthopaedic surgeons (4.03) (p < 0.01). These average scores placed applicants and attending surgeons at the 70th and 65th percentile, respectively, when compared with the general population. There were no differences in self-control (p = 0.68) or conscientiousness (p = 0.93) between the 2 groups. Attending surgeons with more publications had increased grit (p < 0.01), self-control (p = 0.04), and conscientiousness (p = 0.01) scores. Attending surgeons who had been inducted into the Alpha Omega Alpha honor society as medical students demonstrated greater conscientiousness scores than those who were not members (p = 0.04).

CONCLUSIONS

Orthopaedic residency applicants were at least as gritty, consistent in their interest, persevering in their efforts, and ambitious as currently practicing orthopaedic surgeons. Although these results may be encouraging and diverge from some preconceived perceptions of "millennials," it is unclear if they will be predictive of career success in the next generation of orthopaedists.