Smart Work Injury Management (SWIM) System: Artificial Intelligence in Work Disability Management

Evaluation of the Accuracy of the Smart Work Injury Management (SWIM) System to Assist Case Managers in Predicting the Work Disability of Injured Workers

PURPOSE

Many countries have developed clinical decision-making support tools, such as the smart work injury management (SWIM) system in Hong Kong, to predict rehabilitation paths and address global issues related to work injury disability. This study aims to evaluate the accuracy of SWIM by comparing its predictions on real work injury cases to those made by human case managers, specifically with regard to the duration of sick leave and the percentage of permanent disability.

METHODS

The study analyzed a total of 442 work injury cases covering the period from 2012 to 2020, dividing them into non-litigated and litigated cases. The Kruskal-Wallis post hoc test with Bonferroni adjustment was used to evaluate the differences between the actual data, the SWIM predictions, and the estimations made by three case managers. The intra-class correlation coefficient was used to assess the inter-rater reliability of the case managers.

RESULTS

The study discovered that the predictions made by the SWIM model and a case manager possessing approximately 4 years of experience in case management exhibited moderate reliability in non-litigated cases. Nevertheless, there was no resemblance between SWIM's predictions regarding the percentage of permanent disability and those made by case managers.

CONCLUSION

The findings indicate that SWIM is capable of replicating the sick leave estimations made by a case manager with an estimated 4 years of case management experience, albeit with limitations in generalizability owing to the small sample size of case managers involved in the study.

IMPLICATIONS

These findings represent a significant advancement in enhancing the accuracy of CDMS for work injury cases in Hong Kong, signaling progress in the field.

Smart Work Injury Management (SWIM) System: A Machine Learning Approach for the Prediction of Sick Leave and Rehabilitation Plan

As occupational rehabilitation services are part of the public medical and health services in Hong Kong, work-injured workers are treated along with other patients and are not considered a high priority for occupational rehabilitation services. The idea of a work trial arrangement in the private market occurred to meet the need for a more coordinated occupational rehabilitation practice. However, there is no clear service standard in private occupational rehabilitation services nor concrete suggestions on how to offer rehabilitation plans to injured workers. Electronic Health Records (EHRs) data can provide a foundation for developing a model to improve this situation. This project aims at using a machine-learning-based approach to enhance the traditional prediction of disability duration and rehabilitation plans for work-related injury and illness. To help patients and therapists to understand the machine learning result, we also developed an interactive dashboard to visualize machine learning results. The outcome is promising. Using the variational autoencoder, our system performed better in predicting disability duration. We have around 30% improvement compared with the human prediction error. We also proposed further development to construct a better system to manage the work injury case.

Machine Learning for Work Disability Prevention: Introduction to the Special Series

Rapid development in computer technology has led to sophisticated methods of analyzing large datasets with the aim of improving human decision making. Artificial Intelligence and Machine Learning (ML) approaches hold tremendous potential for solving complex real-world problems such as those faced by stakeholders attempting to prevent work disability. These techniques are especially appealing in work disability contexts that collect large amounts of data such as workers' compensation settings, insurance companies, large corporations, and health care organizations, among others. However, the approaches require thorough evaluation to determine if they add value to traditional statistical approaches. In this special series of articles, we examine the role and value of ML in the field of work disability prevention and occupational rehabilitation.