An 11-Item Measure of User- and Human-Centered Design for Personal Health Tools (UCD-11): Development and Validation

BACKGROUND

Researchers developing personal health tools employ a range of approaches to involve prospective users in design and development.

OBJECTIVE

The aim of this paper was to develop a validated measure of the human- or user-centeredness of design and development processes for personal health tools.

METHODS

We conducted a psychometric analysis of data from a previous systematic review of the design and development processes of 348 personal health tools. Using a conceptual framework of user-centered design, our team of patients, caregivers, health professionals, tool developers, and researchers analyzed how specific practices in tool design and development might be combined and used as a measure. We prioritized variables according to their importance within the conceptual framework and validated the resultant measure using principal component analysis with Varimax rotation, classical item analysis, and confirmatory factor analysis.

RESULTS

We retained 11 items in a 3-factor structure explaining 68% of the variance in the data. The Cronbach alpha was .72. Confirmatory factor analysis supported our hypothesis of a latent construct of user-centeredness. Items were whether or not: (1) patient, family, caregiver, or surrogate users were involved in the steps that help tool developers understand users or (2) develop a prototype, (3) asked their opinions, (4) observed using the tool or (5) involved in steps intended to evaluate the tool, (6) the process had 3 or more iterative cycles, (7) changes between cycles were explicitly reported, (8) health professionals were asked their opinion and (9) consulted before the first prototype was developed or (10) between initial and final prototypes, and (11) a panel of other experts was involved.

CONCLUSIONS

The User-Centered Design 11-item measure (UCD-11) may be used to quantitatively document the user/human-centeredness of design and development processes of patient-centered tools. By building an evidence base about such processes, we can help ensure that tools are adapted to people who will use them, rather than requiring people to adapt to tools.

User Involvement in the Design and Development of Patient Decision Aids and Other Personal Health Tools: A Systematic Review

BACKGROUND

When designing and developing patient decision aids, guidelines recommend involving patients and stakeholders. There are myriad ways to do this. We aimed to describe how such involvement occurs by synthesizing reports of patient decision aid design and development within a user-centered design framework and to provide context by synthesizing reports of user-centered design applied to other personal health tools.

METHODS

We included articles describing at least one development step of 1) a patient decision aid, 2) user- or human-centered design of another personal health tool, or 3) evaluation of these. We organized data within a user-centered design framework comprising 3 elements in iterative cycles: understanding users, developing/refining prototype, and observing users.

RESULTS

We included 607 articles describing 325 patient decision aid projects and 65 other personal health tool projects. Fifty percent of patient decision aid projects reported involving users in at least 1 step for understanding users, 35% in at least 1 step for developing/refining the prototype, and 84% in at least 1 step for observing users' interaction with the prototype. In comparison, other personal health tool projects reported 91%, 49%, and 92%, respectively. A total of 74% of patient decision aid projects and 92% of other personal health tool projects reported iterative processes, both with a median of 3 iterative cycles. Preliminary evaluations such as usability or feasibility testing were reported in 66% of patient decision aid projects and 89% of other personal health tool projects.

CONCLUSIONS

By synthesizing design and development practices, we offer evidence-based portraits of user involvement. Those wishing to further align patient decision aid design and development with user-centered design methods could involve users earlier, design and develop iteratively, and report processes in greater detail.

Twelve Lessons Learned for Effective Research Partnerships Between Patients, Caregivers, Clinicians, Academic Researchers, and Other Stakeholders

Research increasingly means that patients, caregivers, health professionals, other stakeholders, and academic investigators work in partnership. This requires effective collaboration rooted in mutual respect, involvement of all participants, and good communication. Having conducted such partnered research over multiple projects, and having recently completed a project together funded by the Patient-Centered Outcomes Research Institute, we collaboratively developed a list of 12 lessons we have learned about how to ensure effective research partnerships. To foster a culture of mutual respect, hold early in-person meetings, with introductions focused on motivation, offer appropriate orientation for everyone, and maintain awareness of individual and project goals. To actively involve all team members, it is important to ensure sufficient funding for everyone's participation, to ask for and recognize diverse contributions, and to seek the input of quiet members. To facilitate good communication, teams should carefully consider labels, avoid jargon and acronyms, judiciously use homogeneous and heterogeneous subgroups, and keep progress visible. In offering pragmatic, actionable lessons we have learned through our separate and shared experiences, we hope to help foster more patient-centered research via productive and enjoyable research collaborations.

Involving members of vulnerable populations in the development of patient decision aids: a mixed methods sequential explanatory study

Background

Patient decision aids aim to present evidence relevant to a health decision in understandable ways to support patients through the process of making evidence-informed, values-congruent health decisions. It is recommended that, when developing these tools, teams involve people who may ultimately use them. However, there is little empirical evidence about how best to undertake this involvement, particularly for specific populations of users such as vulnerable populations.

Methods

To describe and compare the development practices of research teams that did and did not specifically involve members of vulnerable populations in the development of patient decision aids, we conducted a secondary analysis of data from a systematic review about the development processes of patient decision aids. Then, to further explain our quantitative results, we conducted semi-structured telephone interviews with 10 teams: 6 that had specifically involved members of vulnerable populations and 4 that had not. Two independent analysts thematically coded transcribed interviews.

Results

Out of a total of 187 decision aid development projects, 30 (16%) specifically involved members of vulnerable populations. The specific involvement of members of vulnerable populations in the development process was associated with conducting informal needs assessment activities (73% vs. 40%, OR 2.96, 95% CI 1.18–7.99, P = .02) and recruiting participants through community-based organizations (40% vs. 11%, OR 3.48, 95% CI 1.23–9.83, P = .02). In interviews, all developers highlighted the importance, value and challenges of involving potential users. Interviews with developers whose projects had involved members of vulnerable populations suggested that informal needs assessment activities served to center the decision aid around users’ needs, to better avoid stigma, and to ensure that the topic truly matters to the community. Partnering with community-based organizations may facilitate relationships of trust and may also provide a non-threatening and accessible location for research activities.

Conclusions

There are a small number of key differences in the development processes for patient decision aids in which members of vulnerable populations were or were not specifically involved. Some of these practices may require additional time or resources. To address health inequities, researchers, communities and funders may need to increase awareness of these approaches and plan accordingly.

Electronic supplementary material

The online version of this article (doi:10.1186/s12911-016-0399-8) contains supplementary material, which is available to authorized users.

User-centered design and the development of patient decision aids: protocol for a systematic review

BACKGROUND

Providing patient-centered care requires that patients partner in their personal health-care decisions to the full extent desired. Patient decision aids facilitate processes of shared decision-making between patients and their clinicians by presenting relevant scientific information in balanced, understandable ways, helping clarify patients' goals, and guiding decision-making processes. Although international standards stipulate that patients and clinicians should be involved in decision aid development, little is known about how such involvement currently occurs, let alone best practices. This systematic review consisting of three interlinked subreviews seeks to describe current practices of user involvement in the development of patient decision aids, compare these to practices of user-centered design, and identify promising strategies.

METHODS/DESIGN

A research team that includes patient and clinician representatives, decision aid developers, and systematic review method experts will guide this review according to the Cochrane Handbook and PRISMA reporting guidelines. A medical librarian will hand search key references and use a peer-reviewed search strategy to search MEDLINE, EMBASE, PubMed, Web of Science, the Cochrane Library, the ACM library, IEEE Xplore, and Google Scholar. We will identify articles across all languages and years describing the development or evaluation of a patient decision aid, or the application of user-centered design or human-centered design to tools intended for patient use. Two independent reviewers will assess article eligibility and extract data into a matrix using a structured pilot-tested form based on a conceptual framework of user-centered design. We will synthesize evidence to describe how research teams have included users in their development process and compare these practices to user-centered design methods. If data permit, we will develop a measure of the user-centeredness of development processes and identify practices that are likely to be optimal.

DISCUSSION

This systematic review will provide evidence of current practices to inform approaches for involving patients and other stakeholders in the development of patient decision aids. We anticipate that the results will help move towards the establishment of best practices for the development of patient-centered tools and, in turn, help improve the experiences of people who face difficult health decisions.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42014013241.

Medicine on the margins: perspectives of abortion operating surgeons in southern New Zealand

AIMS

This research surveys operating surgeon perspectives on their work with a view to providing information relevant to improving access to abortion services.

METHODS

In depth interviews were held with 14 abortion operating surgeons in the southern region. Interviews were transcribed and analysed according to emergent themes.

RESULTS

Operating surgeons reported their work as technically uninteresting but felt an obligation to provide a safe service and derived important satisfaction from helping patients. They valued peer support in the workplace and did not feel isolated from colleagues or lacking professional status. They noted that the introduction of medical abortions would provide opportunities to improve access.

DISCUSSION

Mainstreaming abortions into other gynaecology services might improve the work environment for operating surgeons and training opportunities for doctors. Increased use of medical abortion techniques, may encourage doctors to become operating surgeons and improve access to services in some localities.