Evaluating Coding Accuracy in General Surgery Residents' Accreditation Council for Graduate Medical Education Procedural Case Logs

The state of affairs: Assessing the scope of endocrine surgery exposure in general surgery residencies across the United States

BACKGROUND

Endocrine surgery is a core component of general surgery training. The landscape of endocrine surgery education in surgical residency and association with entrance into endocrine surgery fellowships is unknown.

METHODS

In total, 353 Accreditation Council for Graduate Medical Education-accredited general surgery program websites were identified and categorized by US region, program type and size, and endocrine surgery educational experience type. Self-identified endocrine surgeons were defined as American Association of Endocrine Surgeons members or fellowship graduates (American Association of Endocrine Surgeons surgeons) or having a thyroid/parathyroid/adrenal practice. Programs that graduated an American Association of Endocrine Surgeons fellow from 2012 onwards were identified, and characteristics associated with endocrine surgery-experience type, self-identified endocrine or American Association of Endocrine Surgeons faculty, and entrance into endocrine surgery fellowship were assessed.

RESULTS

In total, 353 programs were studied. The median number of general surgery residents per program was 25, with 165 (46.7%) small programs (<25 residents) and 188 (53.3%) large (≥25) programs. There were 122 (34.6%) university-based programs, 82 (23.2%) community-based, 139 (39.4%) community-based/university-affiliated, and 10 (2.8%) military. A total 665 self-identified endocrine surgeons were identified at 303 (85.8%) programs; 15 (14.2%) programs had no self-identified endocrine surgeon. There were 361 American Association of Endocrine Surgeons surgeons located at 163 (46.2%) residency programs. In total, 323 (91.5%) programs had information on curriculum/rotations available, 58 (17.9%) with dedicated endocrine surgery educational experiences, 226 (70%) with rotations mixed with other subspecialties, and 39 (12.1%) with none reported. A total 113 (35%) general surgery programs produced a future endocrine surgery fellow and were most likely to be large (81%, P < .001), university-based (64%, P < .001) programs and were more likely to have a self-identified endocrine (102, 90.3%, P = .016) or an American Association of Endocrine Surgeons surgeon (82, 72.6%, P = .004).

CONCLUSION

Program size and type were strongly associated with endocrine surgery exposure, presence of a self-identified endocrine surgeon, and same-site American Association of Endocrine Surgeons fellowship. Endocrine surgery educational experiences are inconsistent across residencies, and efforts are needed to ensure that surgical residents receive comprehensive, equitable endocrine surgery education.

Enhancing Hospital Reimbursement Through a Pediatric Surgery Resident Orientation Program: A Focus on Accurate Diagnosis Code Documentation for Acute Appendicitis

BACKGROUND

The usage of specific ICD-10 diagnosis codes significantly influences hospital reimbursement compared to non-specific codes. This study hypothesized that a formal orientation program for pediatric surgery residents would enhance the selection of accurate and specific diagnosis codes for acute appendicitis such as K35.30 for "Acute appendicitis with localized peritonitis" rather than K35.80 for "Unspecified acute appendicitis," thereby improving hospital reimbursement.

METHODS

We implemented a comprehensive orientation for pediatric surgery residents at our institution in late 2020, a component of which emphasized the importance of having specific ICD-10 diagnosis codes. We conducted a retrospective analysis of laparoscopic appendectomy billing data for pediatric patients, comparing the use of specific versus unspecified diagnosis codes and associated hospital reimbursement rates before (2020) and after (2022) the program's initiation. Patients without payment were excluded. Statistical significance was determined by a two-tailed p-value of ≤0.05.

RESULTS

Analysis of 267 patient records showed a significant increase in the use of the specific diagnosis code (K35.30) from 3.6% in 2020 to 87.5% in 2022 (p < 0.0001). Adjusted for inflation and billing changes, mean hospital reimbursement per case increased by $661 (from $4414 to $5,075, p = 0.027), totaling an additional $84,616 in 2022, just for a single subset of appendicitis patients.

CONCLUSIONS

A targeted resident orientation program significantly improves the use of specific ICD-10 codes for acute appendicitis, leading to increased hospital reimbursement. Such programs represent a valuable approach for enhancing the financial outcomes of pediatric surgical care while reinforcing the importance of accurate medical documentation.

STUDY DESIGN

Retrospective.

LEVEL OF EVIDENCE

III.

Effect of IWATE laparoscopic difficulty score on postoperative outcomes and costs for robotic hepatectomy: Are complex resections more expensive?

BACKGROUND

The IWATE criteria, a four-level classification system for laparoscopic hepatectomy, measures technical complexity but lacks studies on its impact on outcomes and costs, especially in robotic surgeries. This study evaluated the effects of technical complexity on perioperative outcomes and costs in robotic hepatectomy.

METHODS

Since 2013, we prospectively followed 500 patients who underwent robotic hepatectomy. Patients were classified into four levels of IWATE scores; (low [0-3], intermediate [4-6], advanced [7-9], and expert [10-12]) determined by tumor characteristics, liver function and resection extent. Perioperative variables were analyzed with significance accepted at a p-value ≤.05.

RESULTS

Among 500 patients, 337 (67%) underwent advanced to expert-level operations. Median operative duration was 213 min (range: 16-817 min; mean ± SD: 240 ± 116.1 min; p < .001) and estimated blood loss (EBL) was 95 mL (range: 0-3500 mL; mean ± SD:142 ± 171.1 mL; p < .001). Both operative duration and EBL showed positive correlations with increasing IWATE scores. Median length of stay (LOS) of 3 days (range: 0-34; mean ± SD:4 ± 3.0 days; p < .001) significantly correlated with IWATE score. Total cost of $25 388 (range: $84-354 407; mean ± SD: 29752 ± 20106.8; p < .001) also significantly correlated with operative complexity, however hospital reimbursement did not. No correlation was found between IWATE score and postoperative complications or mortality.

CONCLUSIONS

Clinical variables such as operative duration, EBL, and LOS correlate with IWATE difficulty scores in robotic hepatectomy. Financial metrics such as costs but not reimbursement received by the hospital correlate with IWATE scores.

Current Procedural Terminology Code Selection, Attitudes, and Practices of the Orthopaedic Surgery Resident Case Log: A Survey of Residents and Program Directors

Introduction

The Accreditation Council for Graduate Medical Education Resident Case Log is one of the primary tools used to track surgical experience. Owing to the self-reported nature of case logging, there is uncertainty in the consistency and accuracy of case logging. The aims of this study are two-fold: to assess current resident case log Current Procedural Terminology (CPT) code selection and practices across orthopaedic surgery residencies and to understand current attitudes of both program directors (PD) and residents surrounding case logging.

Methods

Residents and PDs from 18 residency programs received standardized, consensus-built surveys distributed through the Collaborative Orthopaedic Educational Research Group. Resident surveys additionally contained clinical orthopaedic subspecialties vignettes on sports, trauma, and spine. Each subspecialty section contained 4 clinical vignettes with stepwise increases in complexity/CPT coding procedures.

Results

One hundred sixteen residents (response rate: 28.4%) and 16 PDs (response rate: 88.9%) participated. Formal case log training was reported by 53.0% of residents and 56.3% of PDs. A total of 7.8% of residents rated themselves "excellent" at applying CPT codes for the case log, while 0.0% PDs rated their residents' ability as "excellent." In total, 40.9% of residents and 81.3% of PDs responded that it was "extremely important" or "very important" to code accurately (p = 0.006). Agreement between resident CPT code selection and number of cases and procedures logged for each clinical vignette was conducted using Fleiss' kappa. As the clinical vignettes increased in complexity, there was a decreasing trend in kappa values from the first (least complex) to the last (most complex) clinical vignette.

Conclusions

The inconsistent case logging practices, dubious outlook on case log accuracy and resident case logging ability and attitude, and lack of formal training signals a need for formal, standardized case log training. Enhanced case logging instruction and formalized educational training for PDs and residents would be a meaningful step toward capturing true operative experience, which would have a substantial impact on orthopaedic surgery resident education and assessment.

Comparing Graduating Plastic Surgery Residents' Case Logs With Accreditation Council for Graduate Medical Education Requirements, Content at National Meetings, and In-Service Examination Test Items

BACKGROUND

The importance of adaptable and up-to-date plastic surgery graduate medical education (GME) has taken on new meaning amidst accelerating surgical innovation and increasing calls for competency-based training standards. We aimed to examine the extent to which the procedures plastic surgery residents perform, as represented in case log data, align with 2 core standardized components of plastic surgery GME: ACGME (Accreditation Council for Graduate Medical Education) minimum procedure count requirements and the PSITE (Plastic Surgery In-Service Training Examination). We also examined their alignment with procedural representation at 2 major plastic surgery meetings.

METHODS

Nine categories of reconstructive and aesthetic procedures were identified. Three-year averages for the number of procedures completed in each category by residents graduating in 2019-2021 were calculated from ACGME national case log data reports. The ACGME procedure count minimum requirements were also ascertained. The titles and durations of medical programming sessions scheduled for Plastic Surgery The Meeting (PSTM) 2022 and the Plastic Surgery Research Council (PSRC) Annual Meeting 2022 were retrieved from online data. Finally, test items from the 2020 to 2022 administrations of the PSITE were retrieved. Conference sessions and test items were assigned to a single procedure category when possible. Percent differences were calculated for comparison.

RESULTS

The distribution of procedures on plastic surgery resident case logs differs from those of the major mechanisms of standardization in plastic surgery GME, in-service examination content more so than ACGME requirements. Meeting content at PSTM and PSRC had the largest percent differences with case log data, with PSTM being skewed toward aesthetics and PSRC toward reconstructive head and neck surgery.

DISCUSSION

The criteria and standards by which plastic surgery residents are evaluated and content at national meetings differ from the procedures they actually complete during their training. Although largely reflecting heterogeneity of the specialty, following these comparisons will likely prove useful in the continual evaluation of plastic surgery residency training, especially in the preparation of residents for the variety of training and practice settings they pursue.

Concerning Trends in Vascular Surgery Trainee Operative Experience in Venous Disease

BACKGROUND

Comprehensive vascular care includes both arterial and venous disease management. However, operative training in venous disease is often significantly overshadowed by arterial procedures, despite the public health burden of acute and chronic venous disease. The purpose of this study is to evaluate the case-mix and volume of venous procedures performed by graduating integrated vascular surgery residents and fellows in the United States.

METHODS

Accreditation Council for Graduate Medical Education national operative log reports were compiled for graduating integrated VSR (vascular surgery residency) and traditional vascular surgery fellowship (VSF) trainees from academic years 2013 to 2022. Only cases categorized as "surgeon fellow", "surgeon chief", or "surgeon junior" were included. Linear regression analysis was utilized to evaluate trends in case-mix and volume.

RESULTS

Over the 10-year study period, total vascular cases increased for both VSR (mean 870.5 ± 9.3 cases, annual change +9.5 cases/year, R2 = 0.77, P < 0.001) and VSF (mean 682.1 ± 6.9 cases, annual change +6.7 cases/year, R2 = 0.85, P < 0.001) trainees. Concurrently, the proportion of venous cases in the VSR group decreased from 12.5% to 7.3% (annual change -3.7 cases/year, R2 = 0.72, P < 0.001). VSR trainees experienced an annual decrease in 4 of the top 5 venous case types performed, including venous angioplasty/stenting (-1.6 cases/year, P = 0.002), vena cava filter placement (-0.9 cases/year, P = 0.002), endoluminal ablation (-0.2 cases/year, P = 0.47), diagnostic venography (-1.7 cases/year, P < 0.001), and varicose vein treatment (-1.0 cases/year, P < 0.001). Venous cases proportions also decreased in the VSF group from 8.4% to 6.2% (annual change -2.2 cases/year, R2 = 0.54, P = 0.002). VSF trainees experienced an annual decrease in 4 of the top 5 venous case types, including venous angioplasty/stenting (-1.5 cases/year, P = 0.003), diagnostic venography (-1.2 cases/year, P < 0.001), vena cava filter placement (-0.2 cases/year, P = 0.44), endoluminal ablation (-0.6 cases/year, P < 0.001), and varicose vein treatment (-0.1 cases/year, P = 0.04). Both VSR and VSF trainee groups graduated with fewer than 5 cases for each of the following venous procedures-percutaneous mechanical thrombectomy, venous thrombolysis, open venous reconstruction, sclerotherapy, venous embolectomy, portal-systemic shunting, venous ulceration treatment, and arteriovenous malformation treatment.

CONCLUSIONS

Current vascular residents and fellows have limited exposure to venous procedures, in part due to a proportional decline in venous cases. More robust venous operative experience is needed during surgical training. Further studies are needed to understand whether this discrepancy in venous and arterial training impacts career progression and patient outcomes.

Gender-based Disparity Exists in the Surgical Experience of Female and Male Urology Residents

OBJECTIVE

To determine if a discrepancy exists in the number and type of cases logged between female and male urology residents.

MATERIALS AND METHODS

ACGME case log data from 13 urology residency programs was collected from 2007 to 2020. The number and type of cases for each resident were recorded and correlated with resident gender and year of graduation. The median, 25th and 75th percentiles number of cases were calculated by gender, and then compared between female and male residents using Wilcoxon rank sum test.

RESULTS

A total of 473 residents were included in the study, 100 (21%) were female. Female residents completed significantly fewer cases, 2174, compared to male residents, 2273 (P = .038). Analysis by case type revealed male residents completed significantly more general urology (526 vs 571, P = .011) and oncology cases (261 vs 280, P = .026). Additionally, female residents had a 1.3-fold increased odds of logging a case in the assistant role than male residents (95% confidence interval: 1.27-1.34, P < .001).

CONCLUSION

Gender-based disparity exists within the urology training of female and male residents. Male residents logged nearly 100 more cases than female residents over 4years, with significant differences in certain case subtypes and resident roles. The ACGME works to provide an equal training environment for all residents. Addressing this finding within individual training programs is critical.

Application of Failure Mode and Effects Analysis to Improve the Quality of the Front Page of Electronic Medical Records in China: Cross-Sectional Data Mapping Analysis

BACKGROUND

The completeness and accuracy of the front pages of electronic medical records (EMRs) are crucial for evaluating hospital performance and for health insurance payments to inpatients. However, the quality of the first page of EMRs in China's medical system is not satisfactory, which can be partly attributed to deficiencies in the EMR system. Failure mode and effects analysis (FMEA) is a proactive risk management tool that can be used to investigate the potential failure modes in an EMR system and analyze the possible consequences.

OBJECTIVE

The purpose of this study was to preemptively identify the potential failures of the EMR system in China and their causes and effects in order to prevent such failures from recurring. Further, we aimed to implement corresponding improvements to minimize system failure modes.

METHODS

From January 1, 2020, to May 31, 2022, 10 experts, including clinicians, engineers, administrators, and medical record coders, in Zhejiang People's Hospital conducted FMEA to improve the quality of the front page of the EMR. The completeness and accuracy of the front page and the risk priority numbers were compared before and after the implementation of specific improvement measures.

RESULTS

We identified 2 main processes and 6 subprocesses for improving the EMR system. We found that there were 13 potential failure modes, including data messaging errors, data completion errors, incomplete quality control, and coding errors. A questionnaire survey administered to random physicians and coders showed 7 major causes for these failure modes. Therefore, we established quality control rules for medical records and embedded them in the system. We also integrated the medical insurance system and the front page of the EMR on the same interface and established a set of intelligent front pages in the EMR management system. Further, we revamped the quality management systems such as communicating with physicians regularly and conducting special training seminars. The overall accuracy and integrity rate of the front page (P<.001) of the EMR increased significantly after implementation of the improvement measures, while the risk priority number decreased.

CONCLUSIONS

In this study, we were able to identify the potential failure modes in the front page of the EMR system by using the FMEA method and implement corresponding improvement measures in order to minimize recurring errors in the health care services in China.

Are ICD codes reliable for observational studies? Assessing coding consistency for data quality

Objective

International Classification of Diseases (ICD) codes recorded in electronic health records (EHRs) are frequently used to create patient cohorts or define phenotypes. Inconsistent assignment of codes may reduce the utility of such cohorts. We assessed the reliability across time and location of the assignment of ICD codes in a US health system at the time of the transition from ICD-9-CM (ICD, 9th Revision, Clinical Modification) to ICD-10-CM (ICD, 10th Revision, Clinical Modification).

Materials and methods

Using clusters of equivalent codes derived from the US Centers for Disease Control and Prevention General Equivalence Mapping (GEM) tables, ICD assignments occurring during the ICD-9-CM to ICD-10-CM transition were investigated in EHR data from the US Veterans Administration Central Data Warehouse using deep learning and statistical models. These models were then used to detect abrupt changes across the transition; additionally, changes at each VA station were examined.

Results

Many of the 687 most-used code clusters had ICD-10-CM assignments differing greatly from that predicted from the codes used in ICD-9-CM. Manual reviews of a random sample found that 66% of the clusters showed problematic changes, with 37% having no apparent explanations. Notably, the observed pattern of changes varied widely across care locations.

Discussion and conclusion

The observed coding variability across time and across location suggests that ICD codes in EHRs are insufficient to establish a semantically reliable cohort or phenotype. While some variations might be expected with a changing in coding structure, the inconsistency across locations suggests other difficulties. Researchers should consider carefully how cohorts and phenotypes of interest are selected and defined.

A national analysis of vascular surgery resident operative experience in peripheral artery disease

BACKGROUND

Endovascular and hybrid interventions have played an increasingly prominent role in the treatment of peripheral arterial disease (PAD) in the past decade. This shift has prompted concerns about the adequacy of open surgical training for current surgical residents. Moreover, the recent Best Surgical Therapy in Patients With Critical Limb Ischemia trial has further emphasized the importance of open surgical techniques in the treatment of peripheral arterial disease. The purpose of this study was to examine national temporal trends in peripheral operative volume among integrated vascular surgery residents.

METHODS

Data was obtained from the Accreditation Council for Graduate Medical Education national data reports for integrated vascular surgery residents. Case volumes for surgeon chief or surgeon junior cases were collected from academic years 2012 to 2013 and 2021 to 2022. Trends in case-mix and volume were evaluated using linear regression analysis.

RESULTS

The mean total vascular operative volume increased from 851.2 to 914.3 cases among graduating chief residents, with an annual growth of 8.5 ± 1.7 cases/year (R2 = 0.77; P < .0001). Major vascular case volume also increased at a rate of 5.7 ± 1.2 cases/year (R2 = 0.74; P < .001). Among operative categories, peripheral cases were the most frequent (n = 232.2 [26.6%]) and demonstrated the greatest annual growth (+8.0 ± 0.8 cases/year, R2 = 0.93; P < .001). No changes were seen in volume of open peripheral cases, including suprainguinal bypass (+0.1 ± 0.2 cases/year; R2 = 0.08; P = .40) or femoropopliteal bypass procedures (-0.1 ± 0.2 cases/year; R2 = 0.17; P = .20). Infrapopliteal bypass (+0.4 ± 0.1 cases/year; R2 = 0.48; P = .006), iliac/femoral endarterectomy (+1.3 ± 0.2 cases/year; R2 = 0.82; P < .001), and leg thromboembolectomy (+0.4 ± 0.1 cases/year; R2 = 0.64; P < .001) all demonstrated annual growth. For endovascular peripheral cases, aortoiliac revascularization (+3.4 ± 0.3 cases/year; R2 = 0.94; P < .001), femoropopliteal revascularization (+5.4 ± 0.2 cases/year; R2 = 0.98; P < .001), and tibioperoneal revascularization (+2.0 ± 0.2 cases/year; R2 = 0.92; P < .001) all increased in volume. Lower extremity amputations, including above-knee amputation (+0.6 ± 0.2 cases/year; R2 = 0.65; P < .001) and below-knee amputation (+0.9 ± 0.2 cases/year; R2 = 0.72; P < .001) also demonstrated an increase in volume.

CONCLUSIONS

Current graduating residents have higher open and endovascular case volumes for peripheral artery disease on a national level, despite the increasing popularity of endovascular techniques. Further studies are needed to identify how these trends may impact current vascular surgery milestones. These trends may also influence the rising interest in competency-based training programs.

Trends in Comprehensive Thoracic Case Experience Among General Surgery Residents in the Modern Integrated Cardiothoracic Residency Era: Review of Twenty Years of Resident Case Logs

BACKGROUND

Thoracic surgery training among general surgery residents in the United States is regulated by the Accreditation Council for Graduate Medical Education (ACGME) to ensure exposure to subspecialty fields during residency. Thoracic surgery training has changed over time with the placement of work hour restrictions, the emphasis on minimally invasive surgery, and increased subspecialization of training like integrated six-year cardiothoracic surgery programs. We aim to investigate how these changes over the past twenty years have affected thoracic surgery training among general surgery residents.

METHODS

ACGME general surgery resident case logs from 1999 to 2019 were reviewed. Data included exposure to the thorax via thoracic, cardiac, vascular, pediatric, trauma, and alimentary tract procedures. Cases from the above categories were consolidated to determine the comprehensive experience. Descriptive statistics were performed over four 5-year Eras (Era 1:1999-2004, Era 2: 2004-2009, Era 3: 2009-2014, Era 4: 2014-2019).

RESULTS

Between Era 1 and Era 4, there was an increase in thoracic surgery experience (37.6 ± 1.03 vs 39.3 ± .64; P = .006). The mean total thoracic experience for thoracoscopic, open, and cardiac procedures was 12.89 ± 3.76, 20.09 ± 2.33, and 4.98 ± 1.28, respectively. There was a difference between Era 1 and Era 4 in thoracoscopic (8.78 ± .961 vs 17.18 ± .75; P < .001) and open thoracic experience (22 ± .97 vs 17.06 ± .88; P < .001), and a decrease in thoracic trauma procedures (3.7 ± .06 vs 3.2 ± .32; P = .03).

DISCUSSION

Over twenty years there has been a similar, to slight increase in thoracic surgery exposure among general surgery residents. The changes seen in thoracic surgery training reflect the overall movement of surgery towards minimally invasive surgery.

Uses of Electronic Health Record Data to Measure the Clinical Learning Environment of Graduate Medical Education Trainees: A Systematic Review

PURPOSE

This study systematically reviews the uses of electronic health record (EHR) data to measure graduate medical education (GME) trainee competencies.

METHOD

In January 2022, the authors conducted a systematic review of original research in MEDLINE from database start to December 31, 2021. The authors searched for articles that used the EHR as their data source and in which the individual GME trainee was the unit of observation and/or unit of analysis. The database query was intentionally broad because an initial survey of pertinent articles identified no unifying Medical Subject Heading terms. Articles were coded and clustered by theme and Accreditation Council for Graduate Medical Education (ACGME) core competency.

RESULTS

The database search yielded 3,540 articles, of which 86 met the study inclusion criteria. Articles clustered into 16 themes, the largest of which were trainee condition experience (17 articles), work patterns (16 articles), and continuity of care (12 articles). Five of the ACGME core competencies were represented (patient care and procedural skills, practice-based learning and improvement, systems-based practice, medical knowledge, and professionalism). In addition, 25 articles assessed the clinical learning environment.

CONCLUSIONS

This review identified 86 articles that used EHR data to measure individual GME trainee competencies, spanning 16 themes and 6 competencies and revealing marked between-trainee variation. The authors propose a digital learning cycle framework that arranges sequentially the uses of EHR data within the cycle of clinical experiential learning central to GME. Three technical components necessary to unlock the potential of EHR data to improve GME are described: measures, attribution, and visualization. Partnerships between GME programs and informatics departments will be pivotal in realizing this opportunity.

Longitudinal trends in volume of oculoplastic procedures without ACGME minimum requirements among United States ophthalmology residents: an ACGME case log analysis

PURPOSE

To our knowledge, there have been no previous reports that investigate trends in ophthalmology residents' exposure to oculoplastic procedures without Accreditation Council for Graduate Medical Education (ACGME) minimum requirements. To fill this knowledge gap, we investigated publicly available ACGME ophthalmology residency case logs from 2009 to 2021.

METHODS

National resident averages and standard deviations were collected for the following oculoplastic procedures without minimum ACGME requirements: eye removal and implant, lacrimal surgery, other orbital surgery (e.g. orbitotomy), tarsorrhaphy, entropion/ectropion repair, temporal artery biopsy, and other oculoplastic surgery. We also collated average yearly surgical volumes of all oculoplastic procedures, "Total Oculoplastic Surgery," which includes procedures with minimum requirements and procedures without requirements. Finally, we collected the average yearly volumes of all ophthalmic procedures. Linear regressions were used to characterize trends in resident oculoplastic surgical volume.

RESULTS

We provide evidence that the average yearly volumes of all but one oculoplastic procedure without ACGME minimum requirements have been decreasing. The decreases in volume for these procedures are driven by residents having fewer cases both as primary surgeon and as assistant. In addition, while the total number of ophthalmic procedures logged by residents on average increased (β = 7.519, p = 0.0163), the average volume of total oculoplastic procedures did not demonstrate any statistically significant trends.

CONCLUSIONS

Volumes of oculoplastic procedures without ACGME minimum requirements between 2009 and 2021 have been decreasing among ophthalmology residents.

Assessing the reliability of pediatric emergency medicine billing code assignment for future consideration as a proxy workload measure

OBJECTIVES

Prediction of pediatric emergency department (PED) workload can allow for optimized allocation of resources to improve patient care and reduce physician burnout. A measure of PED workload is thus required, but to date no variable has been consistently used or could be validated against for this purpose. Billing codes, a variable assigned by physicians to reflect the complexity of medical decision making, have the potential to be a proxy measure of PED workload but must be assessed for reliability. In this study, we investigated how reliably billing codes are assigned by PED physicians, and factors that affect the inter-rater reliability of billing code assignment.

METHODS

A retrospective cross-sectional study was completed to determine the reliability of billing code assigned by physicians (n = 150) at a quaternary-level PED between January 2018 and December 2018. Clinical visit information was extracted from health records and presented to a billing auditor, who independently assigned a billing code-considered as the criterion standard. Inter-rater reliability was calculated to assess agreement between the physician-assigned versus billing auditor-assigned billing codes. Unadjusted and adjusted logistic regression models were used to assess the association between covariables of interest and inter-rater reliability.

RESULTS

Overall, we found substantial inter-rater reliability (AC2 0.72 [95% CI 0.64-0.8]) between the billing codes assigned by physicians compared to those assigned by the billing auditor. Adjusted logistic regression models controlling for Pediatric Canadian Triage and Acuity scores, disposition, and time of day suggest that clinical trainee involvement is significantly associated with increased inter-rater reliability.

CONCLUSIONS

Our work identified that there is substantial agreement between PED physician and a billing auditor assigned billing codes, and thus are reliably assigned by PED physicians. This is a crucial step in validating billing codes as a potential proxy measure of pediatric emergency physician workload.

Can a Computer-based Force Feedback Hip Fracture Skills Simulator Improve Clinical Task Performance? A Cadaveric Validation Study

BACKGROUND

This cadaveric study seeks to determine whether skills acquired on the simulator translate to improved performance of the clinical task. We hypothesized that completion of simulator training modules would improve performance of percutaneous hip pinning.

METHODS

Eighteen right-handed medical students from two academic institutions were randomized: trained (n = 9) and untrained (n = 9). The trained group completed nine simulator-based modules of increasing difficulty, designed to teach techniques of placing wires in an inverted triangle construct in a valgus-impacted femoral neck fracture. The untrained group had a brief simulator introduction but did not complete the modules. Both groups received a hip fracture lecture, an explanation and pictorial reference of an inverted triangle construct, and instruction on using the wire driver. Participants then placed three 3.2 mm guidewires in cadaveric hips in an inverted triangle construct under fluoroscopy. Wire placement was evaluated with CT at 0.5 mm sections.

RESULTS

The trained group significantly outperformed the untrained group in most parameters (P ≤ 0.05).

CONCLUSIONS

The results suggest that a force feedback simulation platform with simulated fluoroscopic imaging using an established, increasingly difficult series of motor skills training modules has potential to improve clinical performance and might offer an important adjunct to traditional orthopaedic training.

Experience of surgical subspecialty residents on general surgery rotations

BACKGROUND

Surgical subspecialty residents complete 5-6 years of training which includes general surgery rotations. A lack of data exists evaluating these rotations. This study aims to identify discrepancies in subspecialty training and improve the quality of surgical education.

METHODS

Case logs for surgical subspecialty residents and general surgery residents at our institution were analyzed and queried for cases performed on general surgery rotations. A survey was distributed to subspecialty residents regarding their perceptions of these rotations.

RESULTS

50 residents were included in the study and the majority were male (n = 27, 54%). Subspecialty residents perform fewer cases per month compared to general surgery residents (13 vs 21, p < 0.001). 75% of subspecialty residents were satisfied with their experience on general surgery rotations.

CONCLUSIONS

Subspecialty residents perform fewer operations on general surgery rotations. Despite this, most are satisfied with off-service rotations and believe they are an important part of their education.

COVID-19 Did Not Stop the Rising Tide: Trends in Case Volume Logged by Surgical Residents

INTRODUCTION

The coronavirus pandemic has profoundly impacted all facets of surgical care, including surgical residency training. The objective of this study was to assess the operative experience and overall case volume of surgery residents before and during the pandemic.

METHODS

Using data from the Accreditation Council for Graduate Medical Education annual operative log reports, operative volume for 2015 to 2021 graduates of Accreditation Council for Graduate Medical Education -accredited general, orthopedic, neuro- and plastic surgery residency programs was analyzed using nonparametric Kendall-tau correlation analysis. The period before the pandemic was defined as AY14-15 to AY18-19, and the pandemic period was defined as AY19-20 to AY20-21.

RESULTS

Operative data for 8556 general, 5113 orthopedic, 736 plastic, and 1278 neurosurgery residency graduates were included. Between 2015 and 2021, total case volume increased significantly for general surgery graduates (Kendall's tau-b: 0.905, p = 0.007), orthopedic surgery graduates (Kendall's tau-b: 1.000, p = 0.003), neurosurgery graduates (Kendall's tau-b: 0.905, p = 0.007), and plastic surgery graduates (Kendall's tau-b: 0.810, p = 0.016). Across all specialties, the mean total number of cases performed by residents graduating during the pandemic was higher than among residents graduating before the pandemic, though no formal significance testing was performed. Among general surgery residents, the number of cases performed as surgeon chief among residents graduating in AY19-20 decreased for the first time in 5 years, though the overall volume remained higher than the prior year, and returned to prepandemic trends in AY20-21.

CONCLUSIONS

Over the past 7 years, the case volume of surgical residents steadily increased. Surgical trainees who graduated during the coronavirus pandemic have equal or greater total operative experience compared to trainees who graduated prior to the pandemic.

Resident Vitreoretinal Procedure Volume: Effect of Intravitreal Injections, Region, Program Size, and Vitreoretinal Fellowship and Veterans Affairs Affiliation

Purpose  To analyze resident vitreoretinal procedure volume across Accreditation Council of Graduate Medical Education (ACGME) accredited ophthalmology residency programs. We assessed the effect of the increase in intravitreal injections (IVI), geographic region, program size, and Veterans Affairs (VA) and vitreoretinal fellowship affiliation on vitreoretinal procedures. Methods  A request was sent to all residency programs in 2018 for their graduating residents' ACGME case logs. Vitreoretinal procedures were defined by ACGME case log categories and included vitreoretinal surgery, peripheral retinal lasers, and IVI. Procedures were categorized by Current Procedural Terminology (CPT) code. Programs were studied by geographic region, program size, and by VA and vitreoretinal fellowship affiliation. Results  A total of 38 of 115 (33.0%) programs responded, and 167 residents logged 32,860 vitreoretinal procedures. The median number of retina procedures per resident was 146 (range 36-729). Programs with a vitreoretinal fellowship had a higher average number of vitreoretinal procedures per resident (208.3 vs. 125.0; p  = 0.002), but there was no difference between the average number of non-IVI vitreoretinal procedures (60.0 vs. 64.2; p  = 0.32). For IVI, VA affiliation (146.6 vs. 71.1; p  = 0.02) and vitreoretinal fellowship (149.4 vs. 60.8; p  < 0.001) were associated with a greater number. More IVI strongly correlated with a larger total volume of retinal procedures ( r  = 0.98), and there was no difference across programs for total retinal procedures when IVI was removed. Conclusions  The presence of a vitreoretinal fellowship at a residency program had a positive effect on resident total vitreoretinal case volume, but their residents performed more IVI. Programs without vitreoretinal fellowships completed on average more non-IVI procedures.

Methodology paper for the General Medicine Inpatient Initiative Medical Education Database (GEMINI MedED): a retrospective cohort study of internal medicine resident case-mix, clinical care and patient outcomes

INTRODUCTION

Unwarranted variation in patient care among physicians is associated with negative patient outcomes and increased healthcare costs. Care variation likely also exists for resident physicians. Despite the global movement towards outcomes-based and competency-based medical education, current assessment strategies in residency do not routinely incorporate clinical outcomes. The widespread use of electronic health records (EHRs) may enable the implementation of in-training assessments that incorporate clinical care and patient outcomes.

METHODS AND ANALYSIS

The General Medicine Inpatient Initiative Medical Education Database (GEMINI MedED) is a retrospective cohort study of senior residents (postgraduate year 2/3) enrolled in the University of Toronto Internal Medicine (IM) programme between 1 April 2010 and 31 December 2020. This study focuses on senior IM residents and patients they admit overnight to four academic hospitals. Senior IM residents are responsible for overseeing all overnight admissions; thus, care processes and outcomes for these clinical encounters can be at least partially attributed to the care they provide. Call schedules from each hospital, which list the date, location and senior resident on-call, will be used to link senior residents to EHR data of patients admitted during their on-call shifts. Patient data will be derived from the GEMINI database, which contains administrative (eg, demographic and disposition) and clinical data (eg, laboratory and radiological investigation results) for patients admitted to IM at the four academic hospitals. Overall, this study will examine three domains of resident practice: (1) case-mix variation across residents, hospitals and academic year, (2) resident-sensitive quality measures (EHR-derived metrics that are partially attributable to resident care) and (3) variations in patient outcomes across residents and factors that contribute to such variation.

ETHICS AND DISSEMINATION

GEMINI MedED was approved by the University of Toronto Ethics Board (RIS#39339). Results from this study will be presented in academic conferences and peer-reviewed journals.

Implementation and Evaluation of Integrating an Electronic Health Record With the ACGME Case Log System

BACKGROUND

It is essential to log resident-performed procedures to assess training programs and fulfill specialty requirements, but resident case numbers are often underreported. Current systems require inefficient data entry steps, and residents and fellows report that user interfaces and administrative burden contribute to logging inaccuracy.

OBJECTIVE

To determine the accuracy, feasibility, and acceptability of a single logging approach for resident case logging.

METHODS

In 2018, we implemented a case logging system integrated with the institutional electronic health record (EHR) and the Accreditation Council for Graduate Medical Education (ACGME) case log system to record procedures performed by ophthalmology residents. We compared the proportion of resident-performed cataract extractions in the EHR that were reported to ACGME for 3 periods: before the deployment of the new system (6 months), during the transition (6 months), and after the change (2 years). Resident satisfaction with the new system was evaluated using surveys.

RESULTS

An analysis of resident cataract surgeries showed that the percentage of resident cases logged increased from 85% prior to implementation to 91% after implementation. The integrated system became the preferred case logging method, with 100% of all logged cases being entered using the new platform. Surveys showed that the percentage of trainees who were moderately or very satisfied with the case log process increased from 55% before implementation to 100% after implementation.

CONCLUSIONS

A resident case log system integrated with an EHR more accurately reflects resident operative volume and increases trainee satisfaction with the logging process.

Exposure of Ophthalmology Residents to Cornea and Keratorefractive Surgeries in the United States

Purpose To describe the cornea and keratorefractive surgeries experience of U.S. ophthalmology residents.

Methods Deidentified case logs of residents graduating in 2018 were collected from ophthalmology residency program directors in the United States. Using Current Procedure Terminology codes, case logs were reviewed in the categories of cornea and keratorefractive surgeries. Accreditation Council for Graduate Medical Education national graduating resident surgical case logs on cornea procedures published from 2010 to 2020 were also analyzed.

Results Case logs were received for 152/488 (31.1%) residents from 36/115 (31.3%) ophthalmology residency programs. The most common procedures logged by residents as primary surgeons were pterygium removal (4.3 ± 4.2) and keratorefractive surgeries (3.6 ± 6.2). Residents logged an average of 2.4 keratoplasties as primary surgeon, performing an average of 1.4 penetrating keratoplasties (PKs) and 0.8 endothelial keratoplasties (EKs). As assistants, the most common procedures logged were keratorefractive surgeries (6.1 ± 4.9), EKs (3.8 ± 3.3), and PKs (3.5 ± 2.3). Medium or large residency class size was associated with higher cornea procedural volumes (odds ratio: 8.9; 95% confidence interval: 1.1–75.6; p < 0.05).

Conclusion The most common cornea surgeries performed by residents include keratoplasty, keratorefractive, and pterygium procedures. Larger program size was associated with greater relative cornea surgery volume. More specific guidelines for logging of procedures could provide a more accurate assessment of resident exposure to critical techniques such as suturing as well as reflect trends in current practice such as the overall increase in EKs.

Standardized Medical Coding Curriculum in Surgical Graduate Medical Education

INTRODUCTION

Despite the increasing importance of coding and billing in healthcare as a whole and calls from the Accreditation Council for Graduate Medical Education (ACGME) to emphasize systems-based practice, many surgical training programs have not prioritized coding and billing within their curricula. We aim to evaluate the performance of surgical residents and early career surgeons in coding and billing and to appraise interventions to improve coding and billing abilities within this group.

METHODS

A literature search from conception to March 15th, 2022 utilizing PubMed, Google Scholar, and EMBASE was conducted to search for studies that evaluate surgical resident coding practices and interventions to improve practice management and financial competency.

RESULTS

Discrepancies in coding and billing ability are prominent between residents, surgeons, and professional coders. One study demonstrated coding accuracy of 76.5% for professional coders, 62.1% for surgical attendings, and 54.1% for surgical residents, whereas another study reported a 52.82% coding accuracy and residents. Resident performance in coding and billing was inferior to their more experienced surgical attending counterparts and professional coders. Surgical residents and fellows demonstrated significantly improved knowledge and confidence in coding following the administration of either individual or longitudinal educational interventions.

CONCLUSION

Coding and billing discrepancies among students, residents, and surgeons persist due to a lack of formalized training. Integration of standardized and mandated medical coding curricula and interventions within residency programs has great potential to improve surgical coding practices and should be a mandatory component of graduate medical education.

Impact of Coding Curriculum on Dermatology Resident Billing

Background

Competent medical coding is key to maintaining a successful dermatology practice. Resident billing performance can have significant financial implications for the academic institutions employing them. During their residency training, dermatology residents commonly find themselves responsible for the billing of patient encounters. However, despite the importance of adequate knowledge and skill in medical coding, recent data show inadequacies in this aspect of resident education. The goal of this study is to evaluate the impact of an interventional coding curriculum on dermatology residents’ billing accuracy at our institution.

Methodology

Billing data, including evaluation and management (E/M) level of service, procedural codes, and current procedural terminology modifiers (if applicable) were queried from the electronic medical records (EMR) at a resident clinic seeing patients on three half-days each week. Billing codes were gathered from patient visits occurring in two separate time periods, before and after the intervention. The intervention consisted of monthly resident lectures on E/M and procedural billing in outpatient dermatology with associated quizzes. Billing accuracy was verified by three attending dermatologists through chart review and compared between the two time periods.

Results

Overall, billing data from 532 patient visits, 267 from the pre-intervention period and 265 from the post-intervention period, were checked for accuracy. The accuracy of resident-billed E/M levels of service was similar between the pre- and post-intervention periods (44.3% vs. 44.8%). Similar rates of undercoding and overcoding were noted between the pre- and post-intervention periods (35.2% undercoded and 8% overcoded vs. 35.7% and 8.9%, respectively). However, substantial improvements were noted in the rate of errors with procedural codes and modifiers in the post-intervention period. Overall, 21.9% of procedural codes were incorrectly billed pre-intervention compared to 3.7% post-intervention (p < 0.05). Moreover, 55.2% of modifiers were incorrectly billed pre-intervention versus 27.3% post-intervention (p < 0.05).

Conclusions

Our analysis suggests that billing lectures yielded a clear improvement in resident billing accuracy at our institution. While there was no improvement in E/M coding, there was a significant improvement in the usage of procedural codes and modifiers. Similar analyses can be used by other residency programs to monitor resident billing performance and the efficacy of educational programs on medical billing.

Resident Endoscopy Experience Correlates Poorly with Performance on a Virtual Reality Simulator

Background  Endoscopy training has become increasingly emphasized during general surgery residency as reflected by introduction of the Fundamentals of Endoscopic Surgery (FES) examination, which includes testing of skills on virtual reality (VR) simulators. Although studies exist to assess the ability of the simulator to differentiate between novices and experienced endoscopists, it is not well understood how simulators can differentiate skills among resident cohort.

Objective  To assess the utility of the VR simulator, we evaluated the correlation between resident endoscopy experience and performance on two VR simulator colonoscopy modules on the GI-BRONCH Mentor (Simbionix Ltd, Airport City, Israel).

Methods  Postgraduate years 2 to 5 residents completed “easy” and “difficult” VR colonoscopies, and performance metrics were recorded from October 2017 to February 2018 at Rutgers' two general surgery residency programs. Resident endoscopy experience was obtained through Accreditation Council for Graduate Medical Education case logs. Correlations between resident endoscopy experience and VR colonoscopy performance metrics were assessed using Spearman's rho (ρ) correlation statistic and bivariate logistic regression.

Results  Fifty-five residents out of 65 (84.6%) eligible participants completed the study. There were limited correlations found between resident endoscopy experience and FES performance metrics and no correlations were found between resident endoscopy experience and binary metrics of colonoscopy—ability to complete colonoscopy, ability to retroflex, and withdrawal time of less than 6 minutes.

Conclusion  The VR simulator may have a limited ability to discriminate between experience levels among resident cohort. Future studies are needed to further understand how well the VR simulator metrics correlate with resident endoscopy experience.

Association of Surrogate Objective Measures With Work Relative Value Units

Background: The determination of accurate measures of evaluating surgeon work for reimbursement is poorly characterized. This study defines the correlation of surgical work relative value units (work RVUs) with several surrogate objective measures for otolaryngologic work. The defined surrogate objective measures evaluated in this study are length of hospital stay (LOS), operative time, 30-day mortality, 30-day unplanned readmission, 30-day reoperation, and 30-day morbidity.

Methods: We collected data on otolaryngologic cases from 2016 to 2018 from the American College of Surgeons National Surgical Quality Improvement Program. Pearson correlation coefficient was used to associate work RVUs with objective measures of surgeon work. Linear regressions were used to identify predictors of work RVUs from the surrogate objective measures. Studentized residuals were used to identify outlying procedures.

Results: Work RVUs correlated strongly with operative time (R=0.6775), 30-day readmission (R=0.6100), and LOS (R=0.6083); moderately with 30-day reoperation (R=0.5257) and 30-day morbidity (R=0.4842); and very weakly with 30-day mortality (R=0.1383). The best predictors for work RVUs based on multivariable linear regression analysis were morbidity, reoperation, and operative time. Analysis revealed that the projected work RVU is 12.23 units higher than the current value for excision of bone, mandible (Current Procedural Terminology [CPT] code 21025) and 19.48 units lower than the current value for resection/excision of lesion infratemporal fossa space apex extradural (CPT code 61605).

Conclusion: Using objective surrogate measures for time and intensity of physician work in head and neck cases may improve work RVU assignment accuracy compared to the current system of physician survey. Future investigation with additional objective parameters may be beneficial to make work RVU assignments less subjective.

Cataract Surgery Numbers in U.S. Ophthalmology Residency Programs: An ACGME Case Log Analysis

PURPOSE

To describe and assess the cataract experience of ophthalmology residents throughout the United States (U.S.).

METHODS

Cataract procedures logged by graduating ophthalmology residents nationwide and published by the Accreditation Council for Graduate Medical Education (ACGME) from 2009 to 2020 were analyzed using linear regression on log-transformed response variables with robust variance.

RESULTS

As primary surgeon, average numbers logged for phacoemulsification increased yearly by an average of 4.1% prior to 2019 and then decreased by 22.1% in 2019 for an overall average yearly increase of 2.9% (95% CI: 0.5, 5.4%, p = .03), non-phacoemulsification extracapsular extraction decreased yearly by an average of 4.6% (95% CI: -7.7, -1.5%, p = .01), other cataract/intraocular lens surgeries decreased yearly by an average of 8.4% (95% CI: -10.1, -6.6%, p < .001), anterior vitrectomies decreased yearly by an average of 12.5% (95% CI: -14.9, -10.1%, p < .001), and laser capsulotomies increased yearly by an average of 6.0% prior to 2019 and then decreased by 3.0% for an overall average yearly increase of 5.3% (95% CI: 4.5, 6.2%, p < .001). As assistant, average numbers logged in all ACGME minimum categories showed decreasing trends.

CONCLUSIONS

Over the last decade, the average numbers of phacoemulsification and laser capsulotomies logged by residents as primary surgeon increased while other ACGME cataract minimum procedures decreased. Surgical volume in 2019-20 was lower due to the coronavirus disease-19 pandemic but higher than from 2009 to 2013.

Correlation of Supervised Independence and Performance with Procedure Difficulty amongst Surgical Residents Stratified by Post Graduate Year

PURPOSE

This study investigates the role of procedure difficulty on attending ratings of supervised levels of independence and procedural performance amongst general surgery residents, while accounting for case complexity.

METHODS

Attending ratings for residents were obtained from System for Improving and Measuring Procedural Learning (SIMPL) database. Current procedural terminology (CPT) codes were used to match procedures to a corresponding work relative value unit (wRVU) as a surrogate for procedure difficulty. Three categories of wRVU (<13.07, 13.07-22, >22) were identified using recursive partitioning. Procedures were also divided into 'Core' or 'Advanced' as defined by the American Board of Surgery Surgical Council on Resident Education (SCORE). Temporal advancement in resident skill was accounted for through academic quarterly analysis. A generalized estimating equations (GEE) approach was used to form separate multivariable logistic regression models for meaningful autonomy (MA) and satisfactory performance (SP) adjusted for potential clustering by program, subject, and rater. Models were further adjusted for core/advanced procedures, attending rated complexity, and academic quarter.

RESULTS

A total of 33,281 ratings were analyzed. Overall, 51.6% were rated as MA and 44.4% as SP. For core procedures, surgical residents rated as MA (53.5%) and SP (45.7%), which was twice as high as those for advance procedures (MA-29.2%, SP-29.0%). MA and SP both decreased with increasing wRVU (Figure 2 &3). Using a wRVU<13.07 as a reference, the adjusted odds ratios of MA and SP were significantly lower with increasing procedure difficulty, 0.44 for wRVU 13.07-22.0 and 0.24 for wRVU >22.00 (Table 3). Post graduate year (PGY) 5 residents in the final quarter of training obtain MA in 95.5% and SP 92.9% for core procedures with wRVU <13.07 (Table 4).

CONCLUSION

Increasing procedural difficulty is independently associated with decreases in meaningful autonomy and satisfactory performance. As residents approach graduation the level of meaningful autonomy and satisfactory performance both reach high levels for common core procedures but decrease as procedural difficulty increases.

Decoding Billing Practices in Cochlear Implant Programs

OBJECTIVES

The purpose of this study was to examine current cochlear implant (CI) billing practices across CI audiologists in the United States, to determine if CI audiologists are following the National Correct Coding Initiative (NCCI) edits, and to assess the CI audiologist's exposure to billing education.

DESIGN

A 48-question survey was electronically distributed to and completed by audiologists who bill for CI services. Demographic data including work setting, population served, years of experience, number of CI patients managed per week, and exposure to billing education were collected. Data were analyzed to identify codes and modifiers used to bill for commonly performed CI procedures such as unilateral and bilateral CI programming, preoperative and postoperative testing, and objective measures.

RESULTS

Data were obtained from 96 audiologists. The majority (86.3%, n = 82) of respondents agreed or strongly agreed they understand billing and coding practices for cochlear implants and 94.7% (n = 89) rated themselves as somewhat to highly efficient when performing these practices. Only 16.8% (n = 16) of respondents reported receiving formal training for practice management, and half of the respondents (51.1%, n = 48) reported unfamiliarity with national billing guidelines. Those who received formal training reported higher billing efficiency. Wide variability was seen for various billing scenarios. Billing questions were presented, and answers were coded as correct or incorrect based on the NCCI edits. Respondents who reported higher agreement with understanding billing and who received formal training scored better on common billing questions related to the NCCI edits.

CONCLUSIONS

Most CI audiologists rated themselves as efficient in billing; however, wide variance in billing practices was observed. Incorporating practice management and current billing education into daily practice and into audiology training programs is essential to clinic efficiency, practice management, and CI program viability. CI audiologists should be knowledgeable about appropriate billing practices to ensure long-term sustainability of programs.

Coding Practices in Hand Surgery and Their Relationship to Surgeon Compensation Structure

Purpose

To evaluate the coding practices of hand surgeons in the American Society for Surgery of the Hand with respect to practice compensation structure using common, representative hand surgery cases.

Methods

We developed a survey of demographic factors and 4 commonly encountered hypothetical hand surgery cases. This survey was emailed to the members of the American Society for Surgery of the Hand. Respondents were asked to code these cases using prepopulated applicable Current Procedural Terminology codes or any other codes of their choosing. The membership responses were then compared with those of 3 independent orthopedic coders.

Results

Of the 4,477 invitations sent, a total of 421 (9.4%) respondents completed the survey. There was notable heterogeneity in the Current Procedural Terminology code choices for the trapeziectomy and distal radius fracture cases. Physicians with a collections-based model coded for significantly higher work-related value units on average compared with the fixed salary– and relative value unit–based physicians for the trapeziectomy case (14.41 vs 13.65 and 13.67, respectively; P < .05). The 3 independent coders all chose a single Current Procedural Terminology code for the carpal tunnel release, distal radius fracture, and scaphoid nonunion cases. The percentages of physician responses that selected only these codes were 84.6% (carpal tunnel release), 61.0% (distal radius fracture), and 73.6% (scaphoid nonunion). Physicians were less likely to code in line with the independent coders for the distal radius fracture case compared with other cases, particularly those physicians with a collections-based model.

Conclusions

The compensation model may be associated with coding practices for more complicated hand cases. The additional work-related value units potentially billed can quickly accumulate for frequently performed procedures. This wide variation supports a need for more frequent and accessible communication and education on coding practices in hand surgery.

Clinical relevance

Improved communication and education regarding appropriate coding practices as well as easily accessible reference material may assist in minimizing coding discrepancies for surgical hand procedures.

Finding the Balance: General Surgery Resident Versus Fellow Training and Exposure in Hepatobiliary and Pancreatic Surgery

BACKGROUND

Institutions training both General Surgery (GS) residents and Hepato-Pancreatico-Biliary (HPB) fellows must strive for adequate case volumes for each trainee cohort.

METHODS

Six academic years of graduating ACGME Residency and HPB Fellowship Council case logs (July 2011-June 2017) and institutional administrative faculty billing data were examined at a single high-volume center with a formal HPB Surgical Division with both GS Residency and HPB Surgery Fellowship trainees.

RESULTS

During the 6-year period, 7482 operations were performed by HPB faculty (5.5 total full-time equivalent (FTE)) and included 2419 major liver, 375 major biliary, and 1591 major pancreas cases. Residents/fellows performed 1102 (50%)/1101 (50%) of all major liver operations, 165 (49.7%)/163 (50.3%) major biliary operations, and 843 (59.2%)/581 (40.8%) major pancreas operations, with significantly different case mix of pancreas for resident versus fellow, p < 0.0001. The overall relative proportion of total HPB cases performed by residents versus fellows was 53%/47%, respectively, and this was stable over time, with no significant decrease in resident exposure/cases with dedicated HPB fellowship.

CONCLUSIONS

Our experience in training both GS residents and HPB fellows with a formal HPB Surgical Division suggests that a high volume HPB Division allows for more than adequate exposure for both groups of trainees.

Quantifying the Financial Impact of Delayed Adoption of CPT Code Changes in Radiology

PURPOSE

To quantify the financial effect of delayed reporting of new moderate sedation (MS) Current Procedural Terminology (CPT) codes at an academic radiology practice, and to identify barriers to timely reporting.

MATERIALS AND METHODS

Billing and reimbursement data was collected for a 28-month period (January 1, 2017-April 30, 2019). Reporting of new MS codes was identified and compared to the number of procedures performed by radiology over the study period. Using the number of procedures performed and payment data, losses were estimated. A root cause analysis was then performed to further understand delayed reporting.

RESULTS

MS was reported with 2.5% of cases in 2017, 47.8% of cases in 2018 and 69.1% of cases in 2019. Appropriate coding was not achieved until June 2018, equating to a 17-month lag in implementation. Lost revenue from inaccurate reporting of MS alone was $21,357 ± $3,945 per month. Primary barriers to an efficient transition included (1) updating billing systems, (2-5) coder, nursing, technologist, and operator education and coordination, and (6) drafting and vetting new procedural report templates.

CONCLUSIONS

Delayed reporting of the new moderate sedation codes resulted in a $363,069 ± $67,065 loss of procedural revenue at an academic radiology practice. Primary drivers of the delay were lags in education and coordination at multiple points in the reporting chain. As healthcare policy shifts and changes to coding become more frequent and significant, timely adoption becomes more salient for radiologists.

Automated Procedure Logs for Cardiology Fellows: A New Training Paradigm in the Era of Electronic Health Records

BACKGROUND

Procedural experience for residents and fellows is critical for achieving competence, and documentation of procedures performed is required. Procedure logs serve as the record of this experience, but are commonly generated manually, require substantial administrative effort, and cannot be corroborated for accuracy.

OBJECTIVE

We developed and implemented a structured clinical-educational report template (CERT), which automatically generates procedure logs directly from the clinical record.

METHODS

Our CERT aimed to replace the post-procedure note template for our cardiac catheterization laboratory and was incorporated into the electronic health record system. Numbers of documented procedures in automated CERT-derived procedure logs over a 1-year post-intervention period (2018-2019) were compared to manual logs and corrected for clinical volume changes. The CERT's impact on fellowship experience was also assessed.

RESULTS

Automated CERT procedure logs increased weekly procedural documentation over manual procedure logs for total procedures (24.2 ± 6.1 vs 17.1 ± 6.8, P = .007), left heart catheterizations (14.5 ± 3.6 vs 10.8 ± 4.2, P = .039), total procedural elements (40.2 ± 11.4 versus 20.9 ± 12.5, P < .001), and captured procedural details not previously documented. The CERT also reduced self-reported administrative time and improved fellowship experience.

CONCLUSIONS

A novel CERT allows procedure logs to be automatically derived from the clinical record and increased the number of documented procedures, compared to manual logging. This innovation ensures an accurate record of procedural experience and reduces self-reported non-educational administrative time for cardiology fellows.

Coding Education in Residency and in Practice Improves Accuracy of Coding in Orthopedic Surgery

The goal of training in orthopedic residency is to produce surgeons who are proficient in all aspects of the practice of orthopedic surgery; however, most residents receive either inadequate or no training in medical coding. The purpose of this study was to determine how well orthopedic residents code when compared with practicing surgeons and to identify whether coding education improves accuracy in medical coding. A mock coding survey was developed using commonly encountered orthopedic clinical scenarios. The survey was distributed to orthopedic trainees post-graduate years (PGY) 1 to 6 at 2 training programs and to attending surgeons. Results were analyzed in 3 groups: junior residents (PGY 1-3), senior residents (PGY 4-6), and attending surgeons. Overall and subcategory scores of (1) type of visit, (2) modifiers, (3) Evaluation and Management (E/M), and (4) Current Procedural Terminology code identification were recorded. Participants were also asked if they had ever received various forms of coding education. Sixty-seven total participants were enrolled, including 28 junior residents, 24 senior residents, and 15 attendings. Practicing surgeons performed significantly better than both senior (P<.027) and junior (P<.001) residents in all categories, with a mean overall correct response rate of 72.8%, 51.0%, and 47.4%, respectively. Any form of coding education was associated with a significantly improved overall score for residents (P=.013) and a nonsignificant increase for attending surgeons (P=.390). This study demonstrates that residents performed poorly when identifying proper billing codes for common procedures and encounters in orthopedic surgery. Further, those participants who received coding education did better than those who did not. [Orthopedics. 2020;43(6):380-383.].

New endocrine fellowship programs do not decrease the endocrine surgery experience of residents in co-located general surgery programs

BACKGROUND

New pediatric and vascular surgical fellowship programs decrease resident operative experience in those subspecialties in co-located general surgery programs.After 2 decades of increases, the mean number of endocrine surgery cases performed by general surgery residents nationally has decreased since 2010 to 2011. We hypothesized that new endocrine surgery fellowship programs lead to a decrease in the number of endocrine surgery cases performed by co-located general surgery residents and may be a contributing factor in the recent national decline in endocrine surgery cases performed by general surgery residents.

METHODS

Endocrine surgery fellowship programs associated with a single, Accreditation Council of Graduate Medical Education-accredited general surgery program that have completed training of 1 fellow by the 2014-2015 academic year were identified. Endocrine surgery cases performed by general surgery residents who completed co-located general surgery programs from 2002 to 2003 through 2017 to 2018 were recorded. Descriptive statistics are shown as mean ± standard deviation. Statistical significance was calculated using the Mann-Whitney U Test.

RESULTS

In the 13 general surgery programs with 5 years of case log data after the matriculation of the first fellow, the mean number of total endocrine surgery cases/resident increased from 47 ± 23 in year 0 to 57 ± 25 in year 5 (z-score = 2.53; P < .05).

CONCLUSION

New endocrine surgery fellowship programs do not decrease the endocrine surgery cases performed by general surgery residents and have not contributed to the national decline in endocrine surgery cases by general surgery residents.

What is the Value of a Burn Surgery Rotation in Surgical Residency?

Declining case volumes on trauma rotations and early specialization of traditional surgical rotations have limited the service lines on which general surgery residents can obtain critical operative and management experience. Meanwhile, a significant portion of residents have no exposure to a burn rotation during their training. A burn rotation may address both of these issues in a meaningful way. Surgical case volumes and burn ICU patient volume were queried for an urban regional verified burn referral center. General surgery program resident case logs were queried for procedures performed during a burn rotation during that same time period. Over a four-year time period, three burn surgeons performed a total of 2374 procedures on burn and wound service patients. In the burn ICU over that same time period, 419 individual critical care patients were managed. Twenty-seven general surgery program residents logged 632 major operations and 67 critical care patients; more than 50 per cent of cases performed were not captured by the Accreditation Council for Graduate Medical Education case log system. A high volume burn service can adequately provide surgical and critical care exposure to junior surgical residents. Accreditation Council for Graduate Medical Education surgical case logs may not fully represent the full scope of exposure sustained on a high-volume burn service.

The Experiential Benefit of an Orthopedic Trauma Fellowship: An Analysis of ACGME Case Log Data From 2006 to 2017

OBJECTIVE

The Accreditation Council for Graduate Medical Education (ACGME) has published orthopedic case log data since the 2006/2007 academic year. Here, we use this data to analyze the variability in orthopedic trauma case experience reported by orthopedic trainees and to better understand the impact of an orthopedic trauma fellowship on orthopedic surgical training.

DESIGN, SETTING, AND PARTICIPANTS

Data were gathered from ACGME case log reports for orthopedic residents (reporting the cumulative case experience of graduating residents) and orthopedic trauma fellows (reporting the case experience of their fellowship year only) for all available years.

RESULTS

The average orthopedic trauma fellow reported significantly more trauma cases in multiple body regions ("Pelvis/Hip", "Femur/Knee", and "Foot/Toes") and "Open Complex" reductions (as defined by the ACGME) in their 1 year of fellowship than the average resident reported in their 5 years of residency.

CONCLUSION

On average, orthopedic trauma fellowships substantially increase the trauma case volumes of orthopedic trainees, especially with respect to lower extremity trauma.

"What program directors think IV": Results of the 2017 Annual Survey of the Association of Program Directors in Radiology

RATIONALE AND OBJECTIVES

The Association of Program Directors in Radiology (APDR) regularly surveys its members to gather information regarding a broad range of topics related to radiology residency. The survey results provide insight into the opinions of residency program leadership across the country.

MATERIALS AND METHODS

This is an observational cross-sectional study using a web-based survey posed to the APDR membership in the fall of 2017. The final survey consisted of 53 items, 48 multiple choice questions and five write-in comments. An invitation to complete the survey was sent to all 319 active APDR members.

RESULTS

Deidentified responses were collected electronically, tallied utilizing Qualtrics software, and aggregated for the purposes of analysis and reporting at the 66th annual meeting of the Association of University Radiologists. The response rate was 36%.

CONCLUSION

Over the past 16 years, more PDs have assistant and APDs to administer growing residency programs, but the time allocation for these APDs has come from the PD's protected time. An overwhelming majority of PDs consider independent call beneficial to residents and most think a call assistant is desirable. The vast majority of PDs support a unified fellowship match and allow resident moonlighting. Most fourth year residents are actively or moderately involved in clinical work and teaching. The majority of PDs have lost or expect to lose DR training positions to the new IR/DR programs. In a competitive match, PDs do not rely on residency interviews in their selection process.

Evaluation of a surgical task sharing training programme's logbook system in Sierra Leone

BACKGROUND

Personal logbooks are universally applied for monitoring and evaluation of surgical trainees; however, the quality and accuracy of such logbooks in low income countries (LICs) are poorly examined. Logbooks are kept by the individual trainee and detail every surgical procedure they perform and their role during the procedure. The aim of this study was to evaluate the quality of such a logbook system in Sierra Leone and to identify areas of improvement.

METHODS

The last 100 logbook entries for students and graduates participating in a surgical task sharing training programme were compared with hospital records (HRs). The logbook entries were categorized as matching, close matching or over-reported. Moreover, HRs were checked for under-reported procedures. Semi-structured interviews were conducted with the study participants on logbook recording routines. The results were analysed using mixed effects logistic regression models.

RESULTS

Three thousand one hundred sixty-nine database entries from 35 participants were analysed. Of that amount, 62.2% of the entries matched the HRs, 10.4% were close matches and 26.9% were over-reported. 20.7% of the investigated HRs were under-reported.

CONCLUSIONS

Information gathered from surgical logbook systems must be applied with care, and great efforts must be made to ensure that the logbook systems used provide reliable data. Based on analysis of the logbook data and interviews, focus areas are suggested to ensure reliable logbook data in LICs. Clear instructions and proper training should be provided when introducing the logbook system to the users. The importance of logging all procedures, including minor ones, should be emphasized. The logbook system should be user friendly and only as extensive as necessary. Lastly, keeping the logbooks exclusively digital is recommended, combined with sufficient IT equipment and training.

Quantitative Analysis of Surgical Residency Reform: Using Case-Logs to Evaluate Resident Experience

BACKGROUND

Curricular changes at a mid-sized surgical training program were developed to rebalance clinical rotations, optimize education over service, decrease the size of service teams, and integrate apprenticeship-type experiences. This study quantifies the operative experience before and after implementation as part of a mixed-methods program evaluation.

STUDY DESIGN

Retrospective review of case-log data and data from the Accreditation Council for Graduate Medical Education (ACGME) and the American College of Surgeons National Surgical Quality Improvement Program: quality in-training initiative to evaluate case volume pre- and postintervention.

RESULTS

11,365 cases, excluding "first-assistant" and "endoscopic" cases, were logged for an average of 291 and 263 cases/resident pre- and postintervention, respectively. Average case volume increased significantly for postgraduate year (PGY) 3 residents and decreased significantly for PGY 4 residents between the two time periods. Variability was observed among residents at the same PGY level both pre- and postintervention, with coefficients of variation of 6.0% to 34.1% in 2014 to 2015 and 11.2% to 66.8% in 2015 to 2016. Inter-resident variability persisted when comparing a specific procedure between ACGME case-log and quality in-training initiative data sets.

CONCLUSION

The data suggest that inter-resident variability in case load is not an artifact of case logging behavior alone, but may reflect personal preferences and choices in case selection that are not impacted by curriculum change. Logging behavior and accuracy of case-logs may contribute to variability. The shift in case load from PGY 4 to PGY 3 after curriculum implementation requires validation by ongoing analysis of ACGME case-log data.

Differentiating abdominal procedures in pediatric surgery: The inadequacy of current procedural terminology codes

INTRODUCTION

The ability to use detailed, accurate current procedural terminology (CPT) codes is a key component of effective research. We examined the effectiveness of CPT codes to accurately reflect care in patients undergoing surgery for necrotizing enterocolitis (NEC).

METHODS

A multicenter retrospective analysis of operations on patients with NEC was conducted across 4 institutions between 2011 and 2016. Correlation between operative dictation and CPT coding was analyzed.

RESULTS

A total of 124 patients with NEC diagnosis undergoing exploratory abdominal operations were identified. NEC was improperly diagnosed in 25 patients, who were excluded from further analysis. Of the 99 patients reviewed, the initial exploratory abdominal operation was coded inaccurately in 58 cases (59%). Within these, 15 (26%) had multiple coding errors such that the nature of the original operation was not discernable from the applied codes. Inaccurate codes often did not describe the presence of a mucous fistula (n=27, 44%), ostomy (n=24, 39%), or extra segments of bowel resected (n=9, 16%). The length of bowel resected is not currently described by any CPT codes.

CONCLUSION

CPT coding for abdominal operations does not sufficiently reflect complexity of pediatric surgeries. This study highlights the significance of this inadequacy and its implications in future database studies in the era of electronic medical records.

LEVEL OF EVIDENCE

Level IV.

TYPE OF STUDY

Clinical research study.

Minimally invasive surgical exposure among US and Canadian pediatric surgery trainees, 2004-2016

BACKGROUND

Minimally invasive pediatric surgery has increased in breadth and complexity over the past several decades, with little data on minimally invasive surgery (MIS) training in US and Canadian pediatric surgery fellowship programs.

METHODS

We performed a time series analysis of Accreditation Council for Graduate Medical Education pediatric surgery fellow case logs from 2003 to 2016. Proportions of cases performed in an MIS fashion as well as per-fellow MIS case averages were recorded over time.

RESULTS

There was a 30.9% increase in average number of MIS cases per fellow over the study time period. Twenty-three recorded procedures included MIS and open options (17 abdominal, three thoracic, and three genitourinary). The proportion of cases performed using a minimally invasive approach increased by an average of 29.0%, 14.6%, and 47.0% for each of these categories, respectively. Significant variability was observed in specific cases such as laparoscopic and open inguinal hernias, ranging from 0 to 85 and nine to 152 per trainee, respectively, in the final year of data collection. When examining pyloromyotomy, a high-volume procedure with a known increase in the MIS approach, the proportion of cases performed MIS increased by 83.3%. The minimum and maximum number of cases per fellow recorded ranged from 0 to 114 during the eight years in which MIS pyloromyotomy was recorded.

CONCLUSIONS

MIS case exposure among graduating US and Canadian pediatric survey fellows increased substantially during the study period. More granular data, however, are needed to better define the current operative experience and criteria for determination of competency in advanced MIS.