Effectiveness of a Web-Based Electronic Prospective Data Collection Tool for Surgical Data in Shoulder Arthroplasty

Background

The purpose of this study was to demonstrate the validity and efficiency of the Outcomes Management and Evaluation (OME) system, a prospectively designed electronic data collection tool, for collecting comprehensive and standardized surgical data in shoulder arthroplasty.

Methods

Surgical data from the first 100 cases of shoulder arthroplasty that were collected into the OME database were analyzed. Surgeons completed a traditional narrative operative note and also an OME case report using an encrypted smartphone. A blinded reviewer extracted data from the operative notes and implant logs in the electronic medical records (EMR) by manual chart review. OME and EMR data were compared with regard to data counts and agreement between 39 variables related to preoperative pathology, including rotator cuff status and glenoid wear, and surgical procedures. Data counts were assessed using both raw percentages and with McNemar's test (with continuity correction). Agreement of nominal variables was analyzed using Cohen's unweighted kappa (κ) and of ordinal variables using the linearly weighted Cohen's test. Efficiency was assessed by calculating the median time needed to complete OME.

Results

Compared to the EMR, the OME database had significantly higher data counts for 56% (22 of 39) of the variables assessed. A high level of proportional and statistical agreement was demonstrated between the data in the two datasets. 10 of 39 variables had 100% agreement but could not be statistically compared because both datasets had the same single response under those variables. Among the 29 variables that were compared, 79% (23 of 29) of variables had >80% raw proportional agreement, and 69% (20 of 29) of variables showed at least substantial agreement (κ > 0.6). The median time for completing OME surgery data entry was 92 seconds (IQR 70 - 126).

Conclusion

The prospectively designed, electronic data entry system (OME) is an efficient and valid tool for collecting comprehensive and standardized surgical data on shoulder arthroplasty.

Level of Evidence

Level IV.

Validity and efficiency of a smartphone-based electronic data collection tool for operative data in rotator cuff repair

BACKGROUND

This study tested validity and efficiency of Orthopaedic Minimal Data Set (OrthoMiDaS) Episode of Care (OME).

METHODS

We analyzed 100 isolated rotator cuff repair cases in the OME database. Surgeons completed a traditional operative note and OME report. A blinded reviewer extracted data from operative notes and implant logs in electronic medical records by manual chart review. OME and electronic medical record data were compared with data counts and agreement between 40 variables of rotator cuff disease and repair procedures. Data counts were assessed using raw percentages and McNemar test (with continuity correction). Agreement of categorical variables was analyzed using Cohen κ (unweighted) and of numerical variables using the concordance correlation coefficient (CCC). Efficiency was assessed by median time to complete.

RESULTS

OME database had significantly higher data counts for 25% (10/40) of variables. A high level of proportional and statistical agreement was demonstrated between the data. Among 35 categorical variables, proportional agreement was perfect for 17%, almost perfect (0.81 ≤ κ ≤ 1.00) for 37%, substantial (0.61 ≤ κ ≤ 0.80) for 20%, moderate (0.41 ≤ κ ≤ 0.60) for 14%, fair (0.21 ≤ κ ≤ 0.40) for 6%, and slight (0.0 ≤ κ ≤ 0.20) for 6%. Of 5 numerical variables, agreement was almost perfect (CCC > 0.99) for 20% and poor (CCC < 0.90) for 80%. Median OME completion time was 161.5 seconds (interquartile range, 116-224.5).

CONCLUSION

OME is an efficient, valid tool for collecting comprehensive, standardized data on rotator cuff repair.

Validation of a Novel Surgical Data Capturing System Following Total Hip Arthroplasty

BACKGROUND

The OrthoMiDaS (Orthopedic Minimal Data Set) Episode of Care (OME) database was developed in an effort to advance orthopedic outcome measurements on a national scale. This study was designed to evaluate if the OME data capture system would increase the quality of data collected in the context of primary and revision total hip arthroplasty (THA) compared to conventional operative notes.

METHODS

This study includes data from the first 100 primary THAs and 100 revision THAs performed by 15 surgeons at a single institution from January through April 2016. Surgeons prospectively entered procedural details into OME following surgery. The OME database and operative notes were compared to evaluate completion rates and agreement. Completion rates were compared using McNemar's test (with continuity correction), while agreement was analyzed using Cohen's kappa (κ) and concordance correlation coefficient.

RESULTS

The OME database had significantly higher completion rates for 41% (39/96) of the variables. Proportion of data points that matched between the operative notes and OME data revealed that 54% (52/96) had a proportion agreement >0.90, and 79% (76/96) had a proportion agreement >0.80. In regard to measured agreement, 25% (24/96) of variables had almost perfect agreement, 29% (28/96) had substantial agreement, and 14% (13/96) had moderate agreement. Only 4% (4/96) had fair agreement, 8% (8/96) had slight agreement, and 6% (6/96) had poor agreement.

CONCLUSION

The OME data capture system is an efficient tool to document procedural details following THA. The system is user-friendly, comprehensive, and accurate. It has the potential to be a valuable tool for future orthopedic research.