Usability evaluation and adaptation of the e-health Personal Patient Profile-Prostate decision aid for Spanish-speaking Latino men

Design of patient-facing immunization visualizations affects task performance: an experimental comparison of 4 electronic visualizations

OBJECTIVE

This study experimentally evaluated how well lay individuals could interpret and use 4 types of electronic health record (EHR) patient-facing immunization visualizations.

MATERIALS AND METHODS

Participants (n = 69) completed the study using a secure online survey platform. Participants viewed the same immunization information in 1 of 4 EHR-based immunization visualizations: 2 different patient portals (Epic MyChart and eClinicWorks), a downloadable EHR record, and a clinic-generated electronic letter (eLetter). Participants completed a common task, created a standard vaccine schedule form, and answered questions about their perceived workload, subjective numeracy and health literacy, demographic variables, and familiarity with the task.

RESULTS

The design of the immunization visualization significantly affected both task performance measures (time taken to complete the task and number of correct dates). In particular, those using Epic MyChart took significantly longer to complete the task than those using eLetter or eClinicWorks. Those using Epic MyChart entered fewer correct dates than those using the eLetter or eClinicWorks. There were no systematic statistically significant differences in task performance measures based on the numeracy, health literacy, demographic, and experience-related questions we asked.

DISCUSSION

The 4 immunization visualizations had unique design elements that likely contributed to these performance differences.

CONCLUSION

Based on our findings, we provide practical guidance for the design of immunization visualizations, and future studies. Future research should focus on understanding the contexts of use and design elements that make tables an effective type of health data visualization.

A multi-site cultural and linguistic adaptation of a hypospadias decision aid for Latinx communities

INTRODUCTION

Latinx, Spanish-speaking (LSS) patients are more likely to experience decisional conflict and regret about healthcare decisions than non-Hispanic, white, English-speaking patients.

OBJECTIVE

To adapt the Hypospadias Hub (Hub), a rigorously developed and tested web-based decision aid (DA), for LSS parents.

METHODS

Guided by the Ecological Validity Model (EVM), a heuristic framework was followed to culturally adapt the Hub (see Extended Summary Figure). In stage 1, recommendations were obtained from a focus group with members of the institution's Latinx Community Review Board (Latinx CRB) and semi-structured interviews with pediatricians with Latinx-focused practices. In stage 2, preliminary cultural modifications were made, the Hub was translated into Spanish, and a second focus group with the Latinx CRB was convened to review the revised Hub. In stage 3, semi-structured interviews with LSS parents of healthy boys (i.e., without hypospadias) ≤ 5 years old were conducted to identify any cultural adaptations and/or usability issues regarding the revised Hub. In stage 4, based on parents' feedback, final revisions to the Hub were made. The focus groups and parent interviews were conducted in Spanish; then, the recordings were professionally transcribed in Spanish and translated into English. Interviews with pediatricians were conducted in English; then, the recordings were professionally transcribed. Three coders conducted a qualitative content analysis to identify areas for revision. Changes were applied iteratively.

RESULTS

Participants included 3 Latinx CRB members (2 women, 1 did not disclose gender; mean age = 48.3, SD = 21.2), 3 non-Latinx pediatricians (2 women, 1 man; mean age = 49.6, SD = 9.1), and 5 Latinx mothers (mean age = 34.0, SD = 1.26). Participants recommended: 1) featuring video testimonials from Latinx families or including Spanish voice-overs/subtitles; 2) diversifying racial/ethnic/geographic representation and including extended families in photographs/illustrations; 3) adding information about health insurance coverage and circumcision, 4) reassuring parents that the condition is not their fault, 5) considering cultural values (e.g., reliance on expert advice), and 6) clarifying medical terminology. Feedback related to seven EVM dimensions: concepts, content, context, goals, language, metaphors, and methods.

DISCUSSION

Participants perceived the Hub to be informative in guiding parents' treatment decisions. Revisions were reasonable and acceptable for a linguistic and cultural adaptation for LSS parents.

CONCLUSIONS

We identified and implemented preliminary cultural modifications to the Hub and applied user-centered design methods to test and revise the website. The product is a culturally appropriate DA for LSS parents. Next, English and Spanish-versions of the Hub will be tested in a randomized controlled trial.

Methodologies for Evaluating the Usability of Rehabilitation Technologies Aimed at Supporting Shared Decision-Making: Scoping Review

BACKGROUND

The field of rehabilitation has seen a recent rise in technologies to support shared decision-making (SDM). Usability testing during the design process of SDM technologies is needed to optimize adoption and realize potential benefits. There is variability in how usability is defined and measured. Given the complexity of usability, a thorough examination of the methodologies used to measure usability to develop the SDM technologies used in rehabilitation care is needed.

OBJECTIVE

This scoping review aims to answer the following research questions: which methods and measures have been used to produce knowledge about the usability of rehabilitation technologies aimed at supporting SDM at the different phases of development and implementation? Which parameters of usability have been measured and reported?

METHODS

This review followed the Arksey and O'Malley framework. An electronic search was performed in the Ovid MEDLINE, Embase, CINAHL, and PsycINFO databases from January 2005 up to November 2020. In total, 2 independent reviewers screened all retrieved titles, abstracts, and full texts according to the inclusion criteria and extracted the data. The International Organization for Standardization framework was used to define the scope of usability (effectiveness, efficiency, and satisfaction). The characteristics of the studies were outlined in a descriptive summary. Findings were categorized based on usability parameters, technology interventions, and measures of usability.

RESULTS

A total of 38 articles were included. The most common SDM technologies were web-based aids (15/33, 46%). The usability of SDM technologies was assessed during development, preimplementation, or implementation, using 14 different methods. The most frequent methods were questionnaires (24/38, 63%) and semistructured interviews (16/38, 42%). Satisfaction (27/38, 71%) was the most common usability parameter mapped to types of SDM technologies and usability evaluation methods. User-centered design (9/15, 60%) was the most frequently used technology design framework.

CONCLUSIONS

The results from this scoping review highlight the importance and the complexity of usability evaluation. Although various methods and measures were shown to be used to evaluate the usability of technologies to support SDM in rehabilitation, very few evaluations used in the included studies were found to adequately span the selected usability domains. This review identified gaps in usability evaluation, as most studies (24/38, 63%) relied solely on questionnaires rather than multiple methods, and most questionnaires simply focused on the usability parameter of satisfaction. The consideration of end users (such as patients and clinicians) is of particular importance for the development of technologies to support SDM, as the process of SDM itself aims to improve patient-centered care and integrate both patient and clinician voices into their rehabilitation care.

A pragmatic randomized trial of home-based testing for COVID-19 in rural Native American and Latino communities: Protocol for the "Protecting our Communities" study

BACKGROUND

Home-based testing for COVID-19 has potential to reduce existing health care disparities among underserved populations in the United States. However, implementation of home-based tests in these communities may face significant barriers. This study evaluates the acceptability, feasibility, and success of home-based testing and the potential added benefit of active support from trusted community health workers for Native Americans and Hispanic/Latino adults living in rural Montana and Washington states.

METHODS/DESIGN

The academic-community research team designed the trial to be responsive to community needs for understanding barriers and supports to home-based COVID-19 testing. The "Protecting Our Community" study is a two-arm pragmatic randomized controlled trial in which a total of 400 participants are randomized to active or passive arms. Participants of both study arms receive a commercially available home collection COVID-19 test kit, which is completed by mailing a self-collected nasal swab to a central laboratory. The primary study outcome is return of the kit to the central lab within 14 days. The cultural, social, behavioral, and economic barriers to home-based COVID-19 testing are also assessed by qualitative research methods. A survey and semi-structured interviews are conducted after the trial to evaluate perceptions and experience of home-based testing.

DISCUSSION

Implementing home-based testing in underserved populations, including among Native American and Hispanic/Latino communities, may require additional support to be successful. The Protecting Our Community trial examines the effect of trusted community health workers on use of home-based testing, which may be adaptable for community-driven models of home-based testing in other underserved populations.

Development and user-testing of a digital patient decision aid to facilitate shared decision-making for people with stable angina

Background

Research shows that people with stable angina need decision support when considering elective treatments. Initial treatment is with medicines but patients may gain further benefit with invasive percutaneous coronary intervention (PCI). Choosing between these treatments can be challenging for patients because both confer similar benefits but have different risks. Patient decision aids (PtDAs) are evidence-based interventions that support shared decision-making (SDM) when making healthcare decisions. This study aimed to develop and user-test a digital patient decision aid (CONNECT) to facilitate SDM for people with stable angina considering invasive treatment with elective PCI.

Methods

A multi-phase study was conducted to develop and test CONNECT (COroNary aNgioplasty dECision Tool) using approaches recommended by the International Patient Decision Aid Standards Collaboration: (i) Steering Group assembled, (ii) review of clinical guidance, (iii) co-design workshops with patients and cardiology health professionals, (iv) first prototype developed and ‘alpha’ tested (semi-structured cognitive interviews and 12-item acceptability questionnaire) with patients, cardiologists and cardiac nurses, recruited from two hospitals in Northern England, and (v) final PtDA refined following iterative user-feedback. Quantitative data were analysed descriptively and qualitative data from the interviews analysed using deductive content analysis.

Results

CONNECT was developed and user-tested with 34 patients and 29 cardiology health professionals. Findings showed that CONNECT was generally acceptable, usable, comprehensible, and desirable. Participants suggested that CONNECT had the potential to improve care quality by personalising consultations and facilitating SDM and informed consent. Patient safety may be improved as CONNECT includes questions about symptom burden which can identify asymptomatic patients unlikely to benefit from PCI, as well as those who may need to be fast tracked because of worsening symptoms.

Conclusions

CONNECT is the first digital PtDA for people with stable angina considering elective PCI, developed in the UK using recommended processes and fulfilling international quality criteria. CONNECT shows promise as an approach to facilitate SDM and should be evaluated in a clinical trial. Further work is required to standardise the provision of probabilistic risk information for people considering elective PCI and to understand how CONNECT can be accessible to underserved communities.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-022-01882-x.

An Adaptation, Extension and Pre-Testing of an Interactive Decision Aid for Men Diagnosed with Localized Prostate Cancer in Iceland: A Mixed-Method Study

In this study an interactive decision aid (DA) for men diagnosed with localized prostate cancer was adapted, extended and pre-tested. The DA's prototype was based on a literature review and other empirically tested DAs. Semi-structured interviews with 12 men (age 65-80) diagnosed with localized prostate cancer were conducted to get feedback on content, usability, and the DA's layout. The interviews were analyzed using thematic analysis and themes were identified using deductive and inductive coding. Participants found the accessibility of the information and the explicit values clarification tool helpful. Four themes were identified: (1) usability and design, (2) content and knowledge, (3) deciding factors of decision-making, and (4) social support. Participants valued receiving extensive and realistic information on surgery/radiation therapy side effects and getting unbiased presentations of treatment options. Following the thematic analysis, the DA was revised and tested in a survey among 11 newly diagnosed prostate cancer patients (age 60-74). The participants valued the DA and found it helpful when making a treatment decision, and all reported that they would recommend it to others making a prostate cancer treatment decision. The DA is currently being tested in a randomized clinical trial (RCT). This is the first DA developed for prostate cancer patients in Iceland and if the results of the RCT show that it is more effective than standard care in assisting newly diagnosed patients with their treatment decision, the DA can be easily translated and adapted to cultures similar to Iceland such as the Nordic countries.

Adaptation of a Mailed-FIT Kit and Patient Navigation Intervention to Increase Colorectal Cancer (CRC) Screening Among Spanish-Speaking Hispanic/Latino Patients

BACKGROUND

Hispanic/Latino populations experience significant barriers to colorectal cancer (CRC) screening. ProCRCScreen is a multicomponent CRC screening program that can help primary care clinics improve CRC screening rates, but it needs adaptation to better meet the health care needs of Spanish-speaking Hispanic/Latino populations.

METHODS

We conducted four focus groups with 22 Spanish-speaking Latino patients and used inductive qualitative content analysis to identify potential program adaptations.

RESULTS

We identified lack of social support for CRC screening and confusion about completing stool-based testing as important barriers to CRC screening. Participants recommended increased specificity of the fecal immunochemical test (FIT) instructions to increase the likelihood of successful test completion, especially for first-time screening. They also endorsed patient navigation for support in completing CRC screening.

DISCUSSION

We adapted the informational materials and workflows for the ProCRCScreen program. Future research to test the adapted program is needed.

Cross-cultural adaptation and content validity of the the patient decision aid "Making Choices: Feeding Options for Patients with Dementia" to Brazilian Portuguese language

PURPOSE

Cross-cultural adaptation to Brazilian Portuguese and evaluation of content validity of a patient decision aid to help in choosing the feeding route for patients with severe dementia entitled "Making Choices: Feeding Options for Patients with Dementia".

METHODS

The cross-cultural adaptation involved two independent translations, synthesis of translations, two independent back-translations, their synthesis, and pretest with 30 caregivers. Content validation was based on analyzes of 35 Brazilian specialists (physicians, speech-language therapists and nurses experienced in caring for patients with severe dementia) through measures of content validity index and concordance between multiple judges by Fleiss' kappa.

RESULTS

The level of comprehension of the instrument by caregivers in the pretest was almost perfect. The specialists committee considered the contents of the instrument valid, in a statistically significant way.

CONCLUSION

The patient decision aid in Brazilian Portuguese entitled "Fazendo escolhas: opções de alimentação para pacientes com demência" obtained evidence of cross-cultural equivalence and content validity for use in the Brazilian population. Further studies are needed to assess its effects on the decision-making process in our population.

Improving Shared Decision Making in Latino Men With Prostate Cancer: A Thematic Analysis

Background. Multiple studies have shown that digitally mediated decision aids help prepare patients for medical decision making with their providers. However, few studies have investigated whether decision-support preferences differ between non-English-speaking and English-speaking Latino men with limited literacy. Objective. To identify and compare health information seeking patterns, preferences for information presentation, and interest in digital decision aids in a sample of Southern Californian underserved Latino men with newly diagnosed prostate cancer at a county hospital. Methods. We conducted semistructured, in-depth telephone interviews with 12 Spanish-speaking and 8 English-speaking Latino men using a purposive sampling technique. Following transcription of taped interviews, Spanish interviews were translated. Using a coding protocol developed by the team, two bilingual members jointly analyzed the transcripts for emerging themes. Coder agreement exceeded 80%. Differences were resolved through discussion. Results. Thematic differences between groups with different preferred languages emerged. Most respondents engaged in online health information seeking using cellphones, perceived a paternalistic patient-provider relationship, and expressed willingness to use hypothetical digital decision aids if recommended by their provider. English speakers reported higher digital technology proficiency for health-related searches. They also more frequently indicated family involvement in digital search related to their condition and preferred self-guided, web-based decision aids. In comparison, Spanish speakers reported lower digital technology proficiency and preferred family-involved, coach-guided, paper and visual decision aids. English speakers reported substantially higher levels of formal education. Conclusion. Preferences regarding the use of digital technology to inform prostate cancer treatment decision making among underserved Latino men varied depending on preferred primary language. Effective preparation of underserved Latino men for shared decision making requires consideration of alternative approaches depending on level of education attainment and preferred primary language.

Decision Aids for Shared Decision-making in Uro-oncology: A Systematic Review

CONTEXT

Decision aids (DAs) aim to support patients in the process of shared decision-making for complex treatment decisions. To improve patient-centered care in uro-oncology, it is essential to evaluate the availability and quality of existing DAs.

OBJECTIVE

To assess the quality of existing DAs for patients across the most prevalent uro-oncological entities.

EVIDENCE ACQUISITION

This study was conducted in accordance with the Preferred Reporting Items for Systematic Review and Meta-analyses (PRISMA) guidelines. A systematic literature search (MedLine, Cochrane Library, Web of Science Core Collection, and CCMed) was conducted to identify DAs for treatment decisions for patients with prostate, renal, or bladder cancer. All studies reporting on the development or evaluation of DAs were included. The DAs were examined based on the International Patient Decision Aid Standards (IPDAS) and the evaluation studies were compared in accordance with Standards for Universal reporting of a patient Decision Aid Evaluations (SUNDAE).

EVIDENCE SYNTHESIS

The literature search identified 1995 potentially relevant publications. Thirty-two studies reporting on 25 DAs met the inclusion criteria. Twenty-two DAs address prostate cancer, two renal tumor, and one bladder cancer. In the majority of DAs (n = 20), patients can enter individual data. A few (n = 6) DAs allow for personalization using a risk-adapted presentation of treatment options. The percentage of IPDAS criteria met in DAs ranged between 50% and 100% (median 87.5%), and the studies' adherence to the SUNDAE checklist was between 62% and 96% (median 86.6%). Evaluation studies suggest that interventions are likely efficacious. However, a preliminary meta-analysis revealed no significant difference between "DA" and "usual care" for decisional conflict or decisional regret.

CONCLUSIONS

This review highlights that a number of well-developed DAs exist in urology. However, there is a need for specific instruments targeting kidney and bladder cancer. Personalization of tools and adherence to international standards of DAs should be further improved.

PATIENT SUMMARY

The majority of uro-oncological decision aids target prostate cancer, whereas fewer address kidney or bladder cancer. The quality of the existing instruments is high, but can be increased further to better address specific needs of individual patients.

Development of a Decision Aid for Patients and Families Considering Hospice

Background: Hospice is underutilized. Miscommunication, decisional complexity, and misunderstanding around engaging hospice may contribute. Shared decision making (SDM), aided by patient decision aids (PtDAs), can improve knowledge and decision quality. Currently, there are no freely available hospice-specific PtDA to facilitate conversions between patients and providers about hospice care. Objective: To develop a theory-based and unbiased hospice specific PtDA. Design: Guided by the Ottawa Decision Support Framework and International Patient Decision Aid Standards, we used a theory-driven, eight-step, iterative, user-centered approach with multistakeholder input to develop a hospice-specific PtDA for anyone facing end-of-life decisions. Subjects: Feedback was obtained from a 10-member Patient Advisory Panel composed of lay patient advisors; focus groups of hospice providers, family caregivers, and patients; and the Palliative Care Research Group at University of Colorado Hospital consisting of palliative care physicians, midlevel providers, nurses, social workers, chaplains, and researchers. Results: There are many challenges in developing an unbiased hospice decision aid, including (1) balancing the provision of education (eligibility, payment) with decisional support, (2) clarifying values and incorporating emotion, (3) ideally representing the potential downsides of hospice, and (4) adequately capturing and describing care alternatives to hospice. Within this context, we developed a 12-page article and 17-minute video PtDAs. The PtDA openly acknowledges the emotional complexity of the decision and incorporates values clarification techniques to help decision makers reflect and evaluate their goals and preferences for end-of-life care. Conclusions: Hospice decision making is complex and emotional, demanding high-quality SDM aided by a formal PtDA. This work resulted in a freely available article and video PtDA for patients considering hospice. The effectiveness and implementation of these tools will be studied in future research. Clinical Trials Registration (NCT03794700 & NCT04458090).

Factors Influencing Pregnant Women's Use of Patient Decision Aids and Decision Making on Prenatal Screening: A Qualitative Study

Objective: We aimed to identify factors influencing pregnant women’s use of patient decision aids (PtDA) and decision making on prenatal screening.

Materials and methods: This qualitative study was conducted between July 2019 and June 2020 in Tehran, Iran. The sample included 26 pregnant women selected by purposive sampling. The participants used a prenatal screening PtDA, then interviewed about factors that would influence their decision making and use of decision aids. The data were analyzed by conventional content analysis.

Results: Three categories were identified for the process of and factors influencing decision making, including the current decision making process, expected decision making process, and factors influencing decision making. Also, five categories were identified as factors affecting the use of PtDAs, including the content of decision aids, the appearance of decision aids, the decision aid platform, the provision of decision aids, and the sub features of decision aids.

Conclusion: To design, develop, and implementation of PtDAs for pregnant women, one should identify the factors affecting pregnant women’s decision making and the use of decision aids. This study helped to the identification of these factors, which is the first step towards the use of PtDAs by pregnant women and their participation in decision making.

Comparing the use of Arabic decision aid to usual care. A multicenter randomized controlled trial for Arabic speaking metastatic colorectal cancer patients in Saudi Arabia

OBJECTIVES

To evaluate the effect of decision aids (DAs) for metastatic colorectal cancer (mCRC) patients in the Arabic language.

METHODS

A multi-centered randomized control trial was used to evaluate the effect of Arabic DA use with usual care for mCRC patients compared to usual care alone. Patients were recruited from 4 main oncology centers in Saudi Arabia: King Fahad Medical City, Riyadh; King Khalid University Hospital, Riyadh; King Saud Medical City, Riyadh; and King Fahd Specialist Hospital, Dammam, Saudi Arabia, between March 2016 and  October 2018. The final follow up was in April 2019. The study measured patient understanding of prognosis, treatment options, and the level of the patient's anxiety.

RESULTS

Ninety-two patients were included in the analysis; 51 in the intervention group. A small proportion of both (DA with usual care and usual care) understood that mCRC was incurable (8% and 5%) of the 2 groups, respectively. There was no significant difference between groups in anxiety level; however, a time effect both initially and after one month was significantly higher than at 6 month.

CONCLUSION

The study shows that a higher level of patient's baseline understanding lowered anxiety levels over time.  Decision aids group presented low levels of anxiety over time than those provided the usual care. We recommend  using Arabic DA in the oncology centers dealing with mCRC patients, aiming to empower patients in decision making.

Translation and cultural adaptation of a prostate cancer screening decision aid: a qualitative study in Portugal

OBJECTIVES

To translate and culturally adapt an English language patient decision aid addressing prostate cancer screening, so it can be used by Portuguese men.

DESIGN

Qualitative study. We followed the European Centre for Disease Prevention and Control's (ECDC) five-step, stakeholder-based approach to adapting health communication materials: (1) selection of materials and process coordinators, (2) early review, (3) translation and back translation, (4) comprehension testing with cognitive semi-structured interviews and (5) proofreading. Content analysis was performed using Ligre software.

SETTING AND PARTICIPANTS

Cognitive interviews with 15 men to refine a decision aid after its translation. Eligible participants were Portuguese native-speaking men aged 55-69 years old recruited from the local community (urban and suburban) of Oporto district through advertisements in social media and senior universities between January and March 2019. A previous diagnosis of prostate cancer was the single exclusion criterion.

RESULTS

Five main themes are presented: informational content, information comprehension, sociocultural appropriateness, feelings and main message and personal perspective concerning prostate cancer screening. Most men found the translated version of the decision aid to be clear, comprehensive and appropriate for its target population, although some suggested that medical terms could be a barrier. The data collected from men's interviews afforded the researchers the opportunity to clarify concepts and expand existing content.

CONCLUSIONS

A decision aid was successfully translated and adapted to the Portuguese cultural setting. Our ECDC based approach can be replicated by other workgroups to translate and culturally adapt decision aids.

The Use of Cancer-Specific Patient-Centered Technologies Among Underserved Populations in the United States: Systematic Review

Background

In the United States, more than 1.6 million new cases of cancer are estimated to be diagnosed each year. However, the burden of cancer among the US population is not shared equally, with racial and ethnic minorities and lower-income populations having a higher cancer burden compared with their counterparts. For example, African Americans have the highest mortality rates and shortest survival rates for most cancers compared with other racial or ethnic groups in the United States. A wide range of technologies (eg, internet-based [electronic health, eHealth] technologies, mobile [mobile health, mHealth] apps, and telemedicine) available to patients are designed to improve their access to care and empower them to participate actively in their care, providing a means to reduce health care disparities; however, little is known of their use among underserved populations.

Objective

The aim of this study was to systematically review the current evidence on the use of cancer-specific patient-centered technologies among various underserved populations.

Methods

Computer-based search was conducted in the following academic databases: (1) PubMed (cancer subset), (2) MEDLINE, (3) PsycINFO, and (4) CINAHL. We included studies that were peer-reviewed, published in the English language, and conducted in the United States. Each study was individually assessed for relevance, with any disagreements being reconciled by consensus. We used a 3-step inclusion process in which we examined study titles, abstracts, and full-text papers for assessment of inclusion criteria. We systematically extracted information from each paper meeting our inclusion criteria.

Results

This review includes 71 papers that use patient-centered technologies that primarily targeted African Americans (n=31), rural populations (n=14), and Hispanics (n=12). A majority of studies used eHealth technologies (n=41) finding them to be leading sources of cancer-related health information and significantly improving outcomes such as screening among nonadherent individuals and increasing knowledge about cancer and cancer screening. Studies on mHealth found that participants reported overall favorable responses to receiving health information via short message service (SMS) text message; however, challenges were experienced with respect to lack of knowledge of how to text among some participants. More complex mobile technologies (eg, a tablet-based risk assessment tool) were also found favorable to use and acceptable among underserved populations; however, they also resulted in more significant barriers, for example, participants expressed concerns regarding security and unfamiliarity with the technology and preferred further instruction and assistance in its use.

Conclusions

There is a growing body of literature exploring patient-centered technology and its influence on care of underserved populations. In this review, we find that these technologies seem to be effective, especially when tailored, in improving patient and care-related outcomes. Despite the potential of patient-centered technologies and the receptivity of underserved populations, challenges still exist with respect to their effective use and usability.

A systematic review of the feasibility, acceptability, and efficacy of online supportive care interventions targeting men with a history of prostate cancer

PURPOSE

To examine the feasibility, acceptability, and efficacy of online supportive care interventions targeting prostate cancer survivors (PCS).

METHODS

Studies were identified through structured searches of PubMed, Embase and PsycINFO databases, and bibliographic review. Inclusion criteria were (1) examined feasibility, acceptability, or efficacy of an online intervention designed to improve supportive care outcomes for PCS; (2) presented outcome data collected from PCS separately (if mixed cancer); and (3) evaluated efficacy outcomes using randomized controlled trial (RCT) design.

RESULTS

Sixteen studies met inclusion criteria; ten were classified as RCTs. Overall, 2446 men (average age 64 years) were included. Studies reported on the following outcomes: feasibility and acceptability of an online intervention (e.g., patient support, online medical record/follow-ups, or decision aids); reducing decisional conflict/distress; improving cancer-related distress and health-related quality of life; and satisfaction with cancer care.

CONCLUSION

We found good preliminary evidence for online supportive care among PCS, but little high level evidence. Generally, the samples were small and unrepresentative. Further, inadequate acceptability measures made it difficult to determine actual PCS acceptability and satisfaction, and lack of control groups precluded strong conclusions regarding efficacy. Translation also appears minimal; few interventions are still publicly available. Larger trials with appropriate control groups and greater emphasis on translation of effective interventions is recommended.

IMPLICATIONS FOR CANCER SURVIVORS

Prostate cancer survivors have a variety of unmet supportive care needs. Using online delivery to improve the reach of high-quality supportive care programs could have a positive impact on health-related quality of life among PCS.

The Genomics ADvISER: development and usability testing of a decision aid for the selection of incidental sequencing results

Guidelines recommend patients be informed of their incidental results (IR) when undergoing genomic sequencing (GS), yet there are limited tools to support patients' decisions about learning IR. The aim of this study is to develop and test the usability of a decision aid (DA) to guide patients' selection of IR, and to describe patients' preferences for learning IR following use of the DA. We developed and evaluated a DA using an iterative, mixed-methods process consisting of (1) prototype development, (2) feasibility testing, (3) cognitive interviews, (4) design and programming, and (5) usability testing. We created an interactive online DA called the Genomics ADvISER, a genomics decision AiD about Incidental SEquencing Results. The Genomics ADvISER begins with an educational whiteboard video, and then engages users in a values clarification exercise, knowledge quiz and final choice step, based on a 'binning' framework. Participants found the DA acceptable and intuitive to use. They were enthusiastic towards GS and IR; all selected multiple categories of IR. The Genomics ADvISER is a new patient-centered tool to support the clinical delivery of incidental GS results. The Genomics ADvISER fills critical care gaps, given the health care system's limited genomics expertise and capacity to convey the large volume of IR and their myriad of implications.

Focus Section Health IT Usability: Applying a Task-Technology Fit Model to Adapt an Electronic Patient Portal for Patient Work

OBJECTIVES

Although electronic patient portals are offered by most health care organizations, poor usability and poor fit to patient needs may pose barriers to adoption. We collaborated with an academic hospital to conduct iterative user evaluation of a newly deployed portal designed to deliver inpatient data upon hospital discharge.

METHODS

Three evaluators applied heuristic usability evaluation and conducted 23 individual user testing sessions with patients with chronic disease or managing the care of family members with chronic disease. Evaluation and development/improvement were conducted iteratively. User testing and analysis of qualitative data were both conducted from the perspective of a task-technology fit framework, to assess the degree of fit between the portal and patient work.

RESULTS

Ability to complete health information management tasks, perceived usability, and positive comments from users improved over the course of the iterative development. However, patients still encountered significant difficulties accomplishing certain tasks such as setting up proxy accounts. The problems were most severe when patients did not start with a clear understanding of tasks that they could accomplish. In exploring the portal, novice users frequently described anecdotes from their own medical history or constructed fictional narratives about a hypothetical patient.

CONCLUSION

Chronic illness imposes a significant workload on patients, and applying a task-technology framework for evaluation of a patient portal helped improve the portal's fit to patient needs. However, it also revealed that patients often lack a clear understanding of tasks that would help them accomplish personal health information management. Portal developers may need to educate patients about types of patient work involving medical centers, in a way that developers of clinical information systems do not need to do. An approach to doing this might be to provide narratives about hypothetical patients.

Cultural adaptation and validation of patient decision aids: a scoping review

In order to promote self-determination, patients have to be actively involved with their care providers in health-care decision making, especially when such decisions involve personal preferences. Decision aids (DAs) are tools that can contribute to patient-centered decision-making processes. To benefit from previous fieldwork and avoid duplicating developmental efforts and producing many similar DAs, the adaptation of existing DAs to new cultural contexts is a resource-saving option. However, there are no guidelines on how to culturally adapt and validate DAs. This study aimed to identify and document existing procedures for the cultural adaptation and validation of patient DAs. A scoping review examined studies conducting cultural adaptation and/or validation of patient DAs. The following databases were searched in February 2016: CINAHL, EMBASE, Medline (Ovid), PASCAL, PsychINFO, and PubMed. From the 13 studies selected, 11 main procedures were identified: appraisal of the original DA, assessment of the new cultural context, translation, linguistic adaptation, cultural adaptation, usability testing, exploration of DA acceptability, test-retest reliability, content validity, construct validity, and criterion validity. A conceptual synthesis of these studies suggests there are four phases in the adaptation/validation process of DAs aimed at: 1) exploring the original DA and the new cultural context, 2) adapting the original DA to the new cultural context, 3) lab testing the preliminary version of the adapted DA, and 4) field testing the adapted DA in a real use context. By facilitating the adaptation and broader implementation of DAs, patients may ultimately be empowered in decision-making processes.

Decision Support with the Personal Patient Profile-Prostate: A Multicenter Randomized Trial

PURPOSE

We evaluated the efficacy of the web based P3P (Personal Patient Profile-Prostate) decision aid vs usual care with regard to decisional conflict in men with localized prostate cancer.

MATERIALS AND METHODS

A randomized (1:1), controlled, parallel group, nonblinded trial was performed in 4 regions of the United States. Eligible men had clinically localized prostate cancer and an upcoming consultation, and they spoke and read English or Spanish. Participants answered questionnaires to report decision making stage, personal characteristics, concerns and preferences plus baseline symptoms and decisional conflict. A randomization algorithm allocated participants to receive tailored education and communication coaching, generic teaching sheets and external websites plus a 1-page summary to clinicians (intervention) or the links plus materials provided in clinic (usual care). Conflict outcomes and the number of consultations were measured at 1 month. Univariate and multivariable models were used to analyze outcomes.

RESULTS

A total of 392 men were randomized, including 198 to intervention and 194 to usual care, of whom 152 and 153, respectively, returned 1-month outcomes. The mean ± SD 1-month decisional conflict scale (score range 0 to 100) was 10.9 ± 16.7 for intervention and 9.9 ± 18.0 for usual care. The multivariable model revealed significantly reduced conflict in the intervention group (-5.00, 95% CI -9.40--0.59). Other predictors of conflict included income, marital or partner status, decision status, number of consultations, clinical site and D'Amico risk classification.

CONCLUSIONS

In this multicenter trial the decision aid significantly reduced decisional conflict. Other variables impacted conflict and modified the effect of the decision aid, notably risk classification, consultations and resources. P3P is an effective adjunct for shared decision making in men with localized prostate cancer.

Usability and Acceptability of a Web-Based Program for Chemotherapy-Induced Peripheral Neuropathy

Chemotherapy-induced neuropathy is a painful and debilitating adverse effect of certain chemotherapy drugs. There have not been any patient-centered, easily accessible Web-based interventions to assist with self-management of chemotherapy-induced neuropathy. The aims of this study were to evaluate usability and acceptability and to estimate an effect size of a Web-based intervention for assessing and managing chemotherapy-induced neuropathy. Participants (N = 14) were instructed to complete the Creativity, Optimism, Planning, and Expert Information for Chemotherapy-Induced Peripheral Neuropathy program and provide verbal responses to the program. Participants completed the Chemotherapy Induced Peripheral Neuropathy Assessment Tool and Post-Study System Usability Questionnaire. Iterative changes were made to the COPE-CIPN. Participants were asked to provide feedback on the revised COPE-CIPN, repeat the Chemotherapy Induced Peripheral Neuropathy Assessment Tool, and evaluate acceptability using the Acceptability e-Scale. The COPE-CIPN demonstrated high usability (mean, 1.98 [SD, 1.12]) and acceptability (mean, 4.40 [SD, 0.52]). Comments indicated that the interface was easy to use, and the information was helpful. While neuropathy symptoms continued to increase in this group of patients receiving neurotoxic chemotherapy, there was a decrease in mean level of interference with activities from 53.71 to 39.29 over 3 to 4 months, which indicated a moderate effect (d = 0.39) size. The COPE-CIPN may be a useful intervention to support self-management of chemotherapy-induced neuropathy.

Usability Testing and Adaptation of the Pediatric Cardiovascular Risk Reduction Clinical Decision Support Tool

BACKGROUND

Cardiovascular disease (CVD) is 1 of the leading causes of death, years of life lost, and disability-adjusted years of life lost worldwide. CVD prevention for children and teens is needed, as CVD risk factors and behaviors beginning in youth contribute to CVD development. In 2012, the National Heart, Lung, and Blood Institute released their "Integrated Guidelines for Cardiovascular Health and Risk Reduction in Children and Adolescents" for clinicians, describing CVD risk factors they should address with patients at primary care preventative visits. However, uptake of new guidelines is slow. Clinical decision support (CDS) tools can improve guideline uptake. In this paper, we describe our process of testing and adapting a CDS tool to help clinicians evaluate patient risk, recommend behaviors to prevent development of risk, and complete complex calculations to determine appropriate interventions as recommended by the guidelines, using a user-centered design approach.

OBJECTIVE

The objective of the study was to assess the usability of a pediatric CVD risk factor tool by clinicians.

METHODS

The tool was tested using one-on-one in-person testing and a "think aloud" approach with 5 clinicians and by using the tool in clinical practice along with formal usability metrics with 14 pediatricians. Thematic analysis of the data from the in-person testing and clinical practice testing identified suggestions for change in 3 major areas: user experience, content refinement, and technical deployment. Descriptive statistical techniques were employed to summarize users' overall experience with the tool.

RESULTS

Data from testers showed that general reactions toward the CDS tool were positive. Clinical practice testers suggested revisions to make the application more user-friendly, especially for clinicians using the application on the iPhone, and called for refining recommendations to be more succinct and better tailored to the patient. Tester feedback was incorporated into the design when feasible, including streamlining data entry during clinical visits, reducing the volume of results displayed, and highlighting critical results.

CONCLUSIONS

This study found support for the usability of our pediatric CVD risk factor tool. Insights shared about this tool may be applicable for designing other mHealth applications and CDS tools. The usability of decision support tools in clinical practice depends critically on receiving (ie, through an accessible device) and adapting the tool to meet the needs of clinicians in the practice setting.

Health figures: an open source JavaScript library for health data visualization

Background

The way we look at data has a great impact on how we can understand it, particularly when the data is related to health and wellness. Due to the increased use of self-tracking devices and the ongoing shift towards preventive medicine, better understanding of our health data is an important part of improving the general welfare of the citizens. Electronic Health Records, self-tracking devices and mobile applications provide a rich variety of data but it often becomes difficult to understand. We implemented the hFigures library inspired on the hGraph visualization with additional improvements. The purpose of the library is to provide a visual representation of the evolution of health measurements in a complete and useful manner.

Results

We researched the usefulness and usability of the library by building an application for health data visualization in a health coaching program. We performed a user evaluation with Heuristic Evaluation, Controlled User Testing and Usability Questionnaires. In the Heuristics Evaluation the average response was 6.3 out of 7 points and the Cognitive Walkthrough done by usability experts indicated no design or mismatch errors. In the CSUQ usability test the system obtained an average score of 6.13 out of 7, and in the ASQ usability test the overall satisfaction score was 6.64 out of 7.

Conclusions

We developed hFigures, an open source library for visualizing a complete, accurate and normalized graphical representation of health data. The idea is based on the concept of the hGraph but it provides additional key features, including a comparison of multiple health measurements over time. We conducted a usability evaluation of the library as a key component of an application for health and wellness monitoring. The results indicate that the data visualization library was helpful in assisting users in understanding health data and its evolution over time.

Electronic supplementary material

The online version of this article (doi:10.1186/s12911-016-0275-6) contains supplementary material, which is available to authorized users.