The development of physician confidence during surgical and medical internship

BACKGROUND

While much research has addressed physician competency, the development of confidence has not been studied. We sought to identify which elements of internship residents feel most contributed to building their confidence.

METHODS

By anonymous survey, University of Pennsylvania residents rated 104 internship elements for contribution to building physician confidence and reported their subjective confidence during and since internship.

RESULTS

Two hundred ten residents in 18 specialties participated. Detailed ratings for all 104 elements are provided. Generally, independent decision-making items and good back-up support were equally highly valued, as was developing work efficiency. Poorly valued items included high patient loads, long hours, and abusive interactions. Surgical and medical residents agreed. Mean confidence increased during internship from 12 to 32 (1-100 scale) but remained in the 50s during residency for most specialties.

CONCLUSIONS

Faculty should make informed, deliberate attempts to provide those elements identified as most fostering the development of physician confidence.

Development and Face and Content Validity of an Eye Surgical Skills Assessment Test for Ophthalmology Residents

PURPOSE

The Accreditation Council for Graduate Medical Education has called for the development of new tools for teaching and assessment in core residency competencies. Aims of this study were to respond to this mandate by developing an objective method of evaluating the surgical skills of ophthalmology residents in a microsurgery laboratory environment that could become a part of the ophthalmic surgical curriculum and competency determination, and to evaluate the face and content validity of this assessment by surveying experts in the field.

DESIGN

Survey.

PARTICIPANTS

Twenty-two content experts (residency program directors and faculty members involved with resident surgical training).

METHODS

We have developed a 3-station (skin suturing, muscle recession, phacoemulsification/wound construction and suturing technique) wet laboratory surgical skills obstacle course for ophthalmology residents. Each station includes instructions to the resident for completing the task as well as assessment forms, a station-specific checklist, and a global rating scale of performance, for expert surgeons to complete while reviewing the resident's videotaped performance. To establish face and content validity, content experts were sent a detailed explanation of the assessment along with a survey to facilitate constructive feedback.

MAIN OUTCOME MEASURES

Survey responses.

RESULTS

Experts felt that the Eye Surgical Skills Assessment Test (ESSAT) is a useful and representative tool for assessing surgical skills of residents. Suggestions were incorporated, thus establishing the face and content validity.

CONCLUSIONS

The ESSAT has face and content validity. This tool will be useful for assessing residents' surgical skills in a laboratory environment and the impact of various teaching methods on performance. Further studies to establish the interrater reliability and construct validity of the ESSAT are underway.

Ophthalmology resident surgical competency: a national survey

PURPOSE

To describe the prevalence, management, and career outcomes of ophthalmology residents who struggle with surgical competency and to explore related educational issues.

DESIGN

Fourteen-question written survey.

PARTICIPANTS

Fifty-eight program directors at Accreditation Council on Graduate Medical Education-accredited, United States ophthalmology residency programs, representing a total of 2179 resident graduates, between 1991 and 2000.

METHODS

Study participants completed a mailed, anonymous survey whose format combined multiple choice and free comment questions.

MAIN OUTCOME MEASURES

Number of surgically challenged residents, types of problems identified, types of remediation, final departmental decision at the end of residency, known career outcomes, and residency program use of microsurgical skills laboratories and applicant screening tests.

RESULTS

One hundred ninety-nine residents (9% overall; 10% mean per program) were labeled as having trouble mastering surgical skills. All of the programs except 2 had encountered such residents. The most frequently cited problems were poor hand-eye coordination (24%) and poor intraoperative judgment (22%). Most programs were supportive and used educational rather than punitive measures, the most common being extra practice-laboratory time (32%), scheduling cases with the best teaching surgeon (23%), and counseling (21%). Nearly one third (31%) of residents were believed to have overcome their difficulties before graduation. Other residents were encouraged to pursue medical ophthalmology (22%) or to obtain further surgical training through a fellowship (21%) or a supervised practice setting (12%); these residents were granted a departmental statement of satisfactory completion of residency for Board eligibility. Twelve percent were asked to leave residency. Of reported career outcomes, 92% of residents were practicing ophthalmology, 65% as surgical and 27% as medical ophthalmologists. Ninety-eight percent of residency programs had microsurgical practice facilities, 64% had a formal teaching course, and 36% had mandatory practice time. Most programs (76%) did not perform applicant vision or dexterity screening tests; questions existed about the legality and validity of such tests.

CONCLUSIONS

The issue of ophthalmology residents who struggle to develop surgical competency appears common. Although many problems appear to be remediable with time, practice, and dedicated, patient teachers, more specific guidelines for a statement of surgical competency are likely necessary to standardize the Board certification process.

Classification of intertrochanteric fractures with computed tomography: a study of intraobserver and interobserver variability and prognostic value

The purpose of this prospective study was to determine the level of interobserver and intraobserver agreement among orthopedic surgeons and radiologists when computed tomography (CT) scans are used with plain radiographs to evaluate intertrochanteric fractures. In addition, the prognostic value of current classifications systems concerning quality of life was evaluated. Sixty-one patients who presented with intertrochanteric fractures received open reduction and internal fixation with compression hip screw. Three orthopedic surgeons and 2 radiologists independently classified the fractures according to 2 systems: Evans-Jensen and AO (Arbeitsgemeinschaft für Osteo-synthesefragen). Fractures were initially graded with plain radiographs and then again in conjunction with CT. Results were analyzed using the (kappa) kappa coefficient. The 36-item Short-Form Health Survey was administered at baseline, 3 months, and 1 year, and results were correlated with fracture grade. Mean kappa coefficients when comparing radiography alone with radiography and CT scan were 0.63 for the AO system and 0.59 for the Evans-Jensen system. Both represent "fair" agreements. Mean overall interobserver kappa coefficients were 0.67 for radiologists and 0.57 for orthopedic surgeons. Radiologists also had higher intraobserver kappa coefficients. No significant relationships were found between follow-up Short Form Health Survey results and intraoperative grading of fractures. When these classification schemes are compared, interobserver agreement does not appear to change dramatically when information from CT scans is added. This may suggest that (1) more data have been provided by CT with greater possibilities for misinterpretation and (2) these classification schemes may not be comprehensive in describing fracture pattern and displacement. Finally, both systems failed to provide any prognostic value.