Zhang M, Zhang Y, Sui M, Wang L, Lin Z, Shen W, Yu J, Yan T. Agreement Between Single Raters and Team Rating When Applying the International Classification of Functioning, Disability and Health's Rehabilitation Set.
J Rehabil Med 2023;
55:jrm14737. [PMID:
38047475 DOI:
10.2340/jrm.v55.14737]
[Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Accepted: 09/26/2023] [Indexed: 12/05/2023] Open
Abstract
OBJECTIVE
To quantify the agreement between functional assessments by a single rater and a team using the Chinese version of the International Classification of Functioning, Disability and Health Rehabilitation Set in a clinical situation.
DESIGN
Inter-rater, multi-centre agreement study.
SUBJECTS
A total of 193 adult inpatients admitted to 5 rehabilitation centres at 5 hospitals in China Methods: The Chinese version of the International Classification of Functioning, Disability and Health Rehabilitation Set was used by either a single rater or a team to assess 193 patients at 5 Chinese hospitals. Percentage of agreement and quadratic-weighted kappa coefficients were computed. Evaluation times were compared with paired t-tests.
RESULTS
The mean team and individual evaluation times were not significantly different. The percentage of agreement ranged from 46.1% to 94.2% depending on the item, and the quadratic-weighted kappas ranged from 0.43 to 0.92. Eight categories (26.6%) showed a weighted kappa exceeding 0.4, 11 others (36.7%) exceeded 0.6, and another 11 (36.7%) produced kappas of more than 0.8.
CONCLUSION
Either a single rater or a team of raters can produce valid and consistent ratings when using the Chinese version of the International Classification of Functioning, Disability and Health Rehabilitation Set to assess patients in a rehabilitation department. The team rating approach is suitable for clinical application.
Collapse