Toward universal design in assessing health care experiences

eHealth research from the user's perspective

The application of information technology (IT) to issues of healthcare delivery has had a long and tortuous history in the United States. Within the field of eHealth, vanguard applications of advanced computing techniques, such as applications in artificial intelligence or expert systems, have languished in spite of a track record of scholarly publication and decisional accuracy. The problem is one of purpose, of asking the right questions for the science to solve. Historically, many computer science pioneers have been tempted to ask "what can the computer do?" New advances in eHealth are prompting developers to ask "what can people do?" How can eHealth take part in national goals for healthcare reform to empower relationships between healthcare professionals and patients, healthcare teams and families, and hospitals and communities to improve health equitably throughout the population? To do this, eHealth researchers must combine best evidence from the user sciences (human factors engineering, human-computer interaction, psychology, and usability) with best evidence in medicine to create transformational improvements in the quality of care that medicine offers. These improvements should follow recommendations from the Institute of Medicine to create a healthcare system that is (1) safe, (2) effective (evidence based), (3) patient centered, and (4) timely. Relying on the eHealth researcher's intuitive grasp of systems issues, improvements should be made with considerations of users and beneficiaries at the individual (patient-physician), group (family-staff), community, and broad environmental levels.

The Consumer Quality Index Hip Knee Questionnaire measuring patients' experiences with quality of care after a total hip or knee arthroplasty

Background

The Dutch Consumer Quality Index Hip Knee Questionnaire (CQI Hip Knee) was used to assess patients' experiences with and evaluations of quality of care after a total hip (THA) or total knee arthroplasty (TKA). The aim of this study is to evaluate the construct validity and internal consistency reliability of this new instrument and to assess its ability to measure differences in quality of care between hospitals.

Methods

Survey data of 1,675 subjects who underwent a THA or TKA were used to evaluate the psychometric properties. Exploratory factor analyses were performed and item-total correlations and inter-factor correlations were calculated to assess the construct validity of the instrument. Reliability analyses included tests of internal consistency (Cronbach's alpha coefficients). Finally, multilevel analyses were performed to assess the ability of the instrument to discriminate between hospitals in quality of care.

Results

Exploratory factor analyses indicated that the survey consisted of 21 items measuring five aspects of care (i.e. communication with nurses, communication with doctors, communication with general practitioner, communication about new medication, and pain control). Cronbach's alpha coefficients ranged from 0.76 to 0.90 indicating good internal consistency. The survey's ability to discriminate between hospitals was partly supported by multilevel analysis. Two scales (i.e. communication with nurses and communication with doctors) were able to measure differences between hospitals with respect to patients' experiences with quality of care. Logistic multilevel analyses indicated that hospitals explained part of the variation between patients in receiving information.

Conclusion

These findings suggest that the CQI Hip Knee is reliable and valid for use in Dutch health care. Health care providers or health plans can use this survey to measure patients' experiences with hospital care and to identify variations in care between hospitals.

Psychometric properties of the Dutch version of the Hospital-level Consumer Assessment of Health Plans Survey instrument

OBJECTIVES

To assess the reliability and validity of a translated version of the American Hospital-level Consumer Assessment of Health Plans Survey (H-CAHPS) instrument for use in Dutch health care.

DATA SOURCES/STUDY SETTING

Primary survey data from adults aged 18 years or more who were recently discharged from two multispecialty city hospitals in the Netherlands.

STUDY DESIGN

We used forward and backward translation procedures and a panel of experts to adapt the 66-item pilot H-CAHPS into a 70-item Dutch instrument. Descriptive statistics and standard psychometric methods were then used to test the reliability and validity of the new instrument.

DATA COLLECTION

From late November 2003 to early January 2004, the survey was administered by mail to 1,996 patients discharged within the previous 2 months.

PRINCIPAL FINDINGS

Analyses supported the reliability and validity of the following 7-factor H-CAHPS structure for use in Dutch hospitals: on doctor's communication, nurses' communication, discharge information, communication about medication, pain control, physical environment of hospital, and nursing services. The internal consistency reliability of the scales ranged from 0.60 to 0.88. Items related to "family receiving help when on visit,""hospital staff introducing self," and "admission delays" did not improve the psychometric properties of the new instrument.

CONCLUSIONS

These findings suggest that the H-CAHPS instrument is reliable and valid for use in the Dutch context. However, more research will be needed to support its equivalence to the United States version, and its use for between-hospital comparisons.