Is it cost-beneficial to society? Measuring the economic worth of dental residency training

Evaluative criteria in practice: Findings from an analysis of evaluations published in Evaluation and Program Planning

BACKGROUND

Evaluative criteria represent values about characteristics that define a successful evaluand. Criteria direct evaluators' lines of inquiry, including how aims are framed, which questions are asked, and what conclusions are reached. Yet, criteria often remain unstated, and little is known about criteria employed in practice.

METHODS

We analyzed 141 evaluations published in Evaluation and Program Planning over four years (2016-2019). Applying a model of criteria domains, we utilized collaborative, interpretive coding to surface and examine the criteria embedded in evaluation aims, questions, and conclusions. We also identified methods used to gather evaluation data.

FINDINGS

Analysis illuminated eight criteria domains evident in the sample and revealed how multiple domains were combined within individual evaluations. We found overlap among data collection methods used to investigate different domains.

CONCLUSIONS

Findings reveal the variety of criteria employed in practice and how evaluators combine criteria to examine multifaceted evaluands. Findings also highlight the need for evaluators to understand how to adapt methods to investigate different criteria domains. This article contributes to the empirical knowledge base about evaluative criteria and identifies revisions to the criteria model.

Expansion of Surgical Graduate Medical Education Training Programs: A Return on Investment Analysis

BACKGROUND

The productivity of surgical departments is limited by the staffing of attending surgeons as well as surgical residents. Despite ongoing surgeon shortages, many health care organizations have been reluctant to expand training programs because of concerns about cost. We sought to determine the return on investment for the expansion of surgical training programs within our health system.

METHODS

This study was completed as a retrospective review comparing two independent surgical departments at separate hospitals within a single integrated health system, including complete fiscal information from 2012 to 2019. Hospital A is a 594-bed hospital with large growth in its graduate surgical training programs over the study's period, whereas Hospital B is a 320-bed hospital where there was no expansion in surgical education initiatives. Case volumes, the number of full-time employees (FTE), and revenue data were obtained from our health systems business office. The number of surgical trainees, including general surgery residents and vascular surgery fellows, was provided by our office of Graduate Medical Education. The average yearly net revenue per surgeon was calculated for each training program and hospital location.

RESULTS

Our results indicate a positive association between the number of surgical trainees and departmental net revenue, as well as the annual revenue generated per physician FTE. Each additional ancillary provider per physician FTE resulted in a positive impact of $112,552-$264,003 (R² of 0.69 to 0.051).

CONCLUSIONS

Regardless of hospital location or surgical specialty, our results demonstrate a positive association between the average net revenue generated per surgeon and the number of surgical trainees supporting the department. These findings are novel and provide evidence of a positive return on investment when surgical training programs are expanded.