Wolfson AM, Doctor JN, Burns SP. Clinician judgments of functional outcomes: how bias and perceived accuracy affect rating.
Arch Phys Med Rehabil 2000;
81:1567-74. [PMID:
11128891 DOI:
10.1053/apmr.2000.16345]
[Citation(s) in RCA: 26] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
OBJECTIVE
To evaluate the accuracy of clinician judgments of patient function, the susceptibility of judges to bias, and the relation between a judge's degree of belief in his/her accuracy of classification to observed accuracy when using the FIM instrument.
PARTICIPANTS
Fifty rehabilitation professionals.
SETTING
3 urban medical centers.
DESIGN
Four randomized experiments among subjects to examine the effect of potentially biasing information on FIM ratings of patient vignettes. Participants answered 60 true/false questions regarding patient function and FIM score and indicated confidence in the accuracy of their answers.
INTERVENTIONS
Manipulation of patient information.
MAIN OUTCOME MEASURES
The standard FIM 7-point scale, observed proportion of correct responses to the 60 true/false questions, and a 6-category confidence scale for each of the 60 questions were used as dependent measures.
RESULTS
FIM ratings assigned to others biased participants' FIM ratings of patient vignettes. Functional ability was overestimated when ratings in other domains were high and underestimated when they were low. Participants were overconfident in their ability to answer FIM questions accurately across all professional disciplines.
CONCLUSION
Bias and poor judgment of level accuracy play a significant role in clinician ratings of patient functioning. Blind ratings and training in debiasing are potential solutions to the problem.
Collapse