User-centered design and the development of patient decision aids: protocol for a systematic review

Development of an Online Scenario-Based Tool to Enable Research Participation and Public Engagement in Cystic Fibrosis Newborn Screening: Mixed Methods Study

BACKGROUND

Newborn screening aims to identify babies affected by rare but serious genetic conditions. As technology advances, there is the potential to expand the newborn screening program following evaluation of the likely benefits and drawbacks. To inform these decisions, it is important to consider the family experience of screening and the views of the public. Engaging in public dialogue can be difficult. The conditions, screening processes, and associated moral and ethical considerations are complex.

OBJECTIVE

This study aims to develop a stand-alone online resource to enable a range of stakeholders to understand whether and how next-generation sequencing should be incorporated into the CF screening algorithm.

METHODS

Around 4 development workshops with policymakers, parents, and other stakeholders informed the design of an interactive activity, including the structure, content, and questions posed. Stakeholders were recruited to take part in the development workshops via purposeful and snowball sampling methods to achieve a diversity of views across roles and organizations, with email invitations sent to representative individuals with lived, clinical, and academic experience related to CF and screening. Ten stakeholders informed the development process including those with lived experience of CF (2/10, 20%), clinicians (2/10, 20%), and representatives from relevant government, charity, and research organizations (6/10, 60%). Vignettes constructed using interview data and translated into scripts were recorded to provide short films to represent and provoke consideration of families' experiences. Participants were recruited (n=6, adults older than 18 years) to test the resulting resource. Study advertisements were circulated via physical posters and digital newsletters to recruit participants who self-identified as having a reading difficulty or having English as a second language.

RESULTS

An open access online resource, "Cystic Fibrosis Newborn Screening: You Decide," was developed and usability and acceptability tested to provide the "user" (eg, a parent, the general public, or a health care professional) with an interactive scenario-based presentation of the potential outcomes of extended genetic testing, allowing them to visualize the impact on families. This included a learning workbook that explains key concepts and processes. The resulting tool facilitates public engagement with and understanding of complex genetic and screening concepts.

CONCLUSIONS

Online resources such as the one developed during this work have the potential to help people form considered views and facilitate access to the perspectives of parents and the wider public on genetic testing. These may be otherwise difficult to obtain but are of importance to health care professionals and policymakers.

TRIAL REGISTRATION

ClinicalTrials.gov NCT06299566; https://clinicaltrials.gov/study/NCT06299566.

Combining theory and usability testing to inform optimization and implementation of an online primary care depression management tool

BACKGROUND

The 'Ottawa Depression Algorithm' is an evidence-based online tool developed to support primary care professionals care for adults with depression. Uptake of such tools require provider behaviour change. Identifying issues which may impact use of an innovation in routine practice (i.e. barriers to and enablers of behaviour change) informs the selection of implementation strategies that can be deployed with the tool to support use. However, established theory-informed barriers/enablers assessment methods may be less well suited to identifying issues with tool usability. User testing methods can help to determine whether the tool itself is optimally designed. We aimed to integrate these two methodological approaches to i) identify issues impacting the usability of algorithm; and ii) identify barriers to and enablers of algorithm use in routine practice.

METHODS

We conducted semi-structured interviews with primary care professionals in Ottawa, Canada. To evaluate usability, participants used a written patient scenario to work through the algorithm while verbalizing their thoughts ('Think Aloud'). Participants were then asked about factors influencing algorithm use in routine practice (informed by the Theoretical Domains Framework). We used the codebook approach to thematic analysis to assign statements to pre-specified codes and develop themes pertaining to usability and routine use.

RESULTS

We interviewed 20 professionals from seven practices. Usability issues were summarised within five themes: Optimizing content and flow to align with issues faced in practice, Enhancing the most useful algorithm components, Interactivity of the algorithm and embedded tools, Clarity of presence, purpose, or function of components, and Navigational challenges and functionality of links. Barriers to and enablers of routine use were summarised within five themes: Getting to know the algorithm, Alignment with roles and pathways of influence, Integration with current ways of working, Contexts for use, and Anticipated benefits and concerns about patient communication.

CONCLUSIONS

Whilst the Ottawa Depression Algorithm was viewed as a useful tool, specific usability issues and barriers to use were identified. Supplementing a theory-based barriers/enablers assessment with usability testing provided enhanced insights to inform optimization and implementation of this clinical tool. We have provided a methods guide for others who may wish to apply this approach.

Teacher vaccinations enhance student achievement in Pakistan: The role of role models and theory of mind

We provide experimental evidence that role models can galvanize prosocial actions amid global crises, exemplified by the COVID-19 pandemic. In a randomized control trial comparing role models, cash incentives, and celebrity endorsements, only role models successfully mitigated vaccine reluctance and ameliorated pandemic-induced educational setbacks. Monthly tracking of vaccination status was achieved via QR-code-verified certificates. Theory-of-mind behavioral data on the mentalizing of others shed light on the mechanism underlying the role model effect. This research, from Pakistan, suggests how role models and theory of mind have the potential to play a role in tackling global challenges.

Clinician perspectives and recommendations regarding design of clinical prediction models for deteriorating patients in acute care

BACKGROUND

Successful deployment of clinical prediction models for clinical deterioration relates not only to predictive performance but to integration into the decision making process. Models may demonstrate good discrimination and calibration, but fail to match the needs of practising acute care clinicians who receive, interpret, and act upon model outputs or alerts. We sought to understand how prediction models for clinical deterioration, also known as early warning scores (EWS), influence the decision-making of clinicians who regularly use them and elicit their perspectives on model design to guide future deterioration model development and implementation.

METHODS

Nurses and doctors who regularly receive or respond to EWS alerts in two digital metropolitan hospitals were interviewed for up to one hour between February 2022 and March 2023 using semi-structured formats. We grouped interview data into sub-themes and then into general themes using reflexive thematic analysis. Themes were then mapped to a model of clinical decision making using deductive framework mapping to develop a set of practical recommendations for future deterioration model development and deployment.

RESULTS

Fifteen nurses (n = 8) and doctors (n = 7) were interviewed for a mean duration of 42 min. Participants emphasised the importance of using predictive tools for supporting rather than supplanting critical thinking, avoiding over-protocolising care, incorporating important contextual information and focusing on how clinicians generate, test, and select diagnostic hypotheses when managing deteriorating patients. These themes were incorporated into a conceptual model which informed recommendations that clinical deterioration prediction models demonstrate transparency and interactivity, generate outputs tailored to the tasks and responsibilities of end-users, avoid priming clinicians with potential diagnoses before patients were physically assessed, and support the process of deciding upon subsequent management.

CONCLUSIONS

Prediction models for deteriorating inpatients may be more impactful if they are designed in accordance with the decision-making processes of acute care clinicians. Models should produce actionable outputs that assist with, rather than supplant, critical thinking.

A user-centered approach to the development of a diet education tool for older adults with tooth loss

BACKGROUND

Tooth loss is associated with suboptimal nutrient intake and greater risk of malnutrition.

OBJECTIVE

To develop and field-test a stakeholder-informed diet education tool that addresses the unique needs of older adults with tooth loss who do not wear dentures.

METHODS

An iterative user-centered approach was used. Initial content was developed based on findings from previous research. Stakeholder panels of older adults with 20 or fewer teeth, and dentists, were conducted at two time points to obtain feedback on the tool, which was revised following each panel. The tool was field-tested in a dental school clinic and evaluated using the Patient Education Materials Assessment Tool; it was further revised based on feedback.

RESULTS

A diet education tool entitled "Eating Healthier With Tooth Loss" was developed. Sections for fruits and vegetables, grains, and proteins food groups, and one addressing socioemotional aspects of eating with missing teeth were included. Panel members provided constructive, positive feedback; recommendations for editing text, images, design, and content were integrated. Field-testing in the dental clinic with 27 pairs of student dentists and their patients resulted in scores of 95.7% for understandability and 96.6% for actionability, with over 85% agreement with each item. The tool was revised based on field-testing feedback.

CONCLUSION

A diet education tool for older adults with tooth loss was developed using a user-centered approach, integrating the 'patient voice' and patient experiences with US dietary guidelines. Use of this tool is feasible in a dental clinic setting. Future research should explore usage in larger settings.

Combining user-centered design and behavioral theory to enhance health technologies: A personas-based approach for a primary-care based multifactorial falls risk assessment tool

INTRODUCTION

Multifactorial falls risk assessment tools (FRATs) can be an effective falls prevention method for older adults, but are often underutilized by health care professionals (HCPs). This study aims to enhance the use and implementation of multifactorial FRATs by combining behavioral theory with the user-centered design (UCD) method of personas construction. Specifically, the study aimed to (1) construct personas that are based on external (i.e., needs, preferences) and intrinsic user characteristics (i.e., behavioral determinants); and (2) use these insights to inform requirements for optimizing an existing Dutch multifactorial FRAT (i.e., the 'Valanalyse').

METHODS

Survey data from HCPs (n = 31) was used to construct personas of the 'Valanalyse.' To examine differences between clusters on 68 clustering variables, a multivariate cluster analysis technique with non-parametric analyses and computational methods was used. The aggregated external and intrinsic user characteristics of personas were used to inform key design and implementation requirements for the 'Valanalyse,' respectively, whereby intrinsic user characteristics were matched with appropriate behavior change techniques to guide implementation.

RESULTS

Significant differences between clusters were observed in 20 clustering variables (e.g., behavioral beliefs, situations for use). These variables were used to construct six personas representing users of each cluster. Together, the six personas helped operationalize four key design requirements (e.g., guide treatment-related decision making) and 14 implementation strategies (e.g., planning coping responses) for optimizing the 'Valanalyse' in Dutch geriatric, primary care settings.

CONCLUSION

The findings suggest that theory- and evidence-based personas that encompass both external and intrinsic user characteristics are a useful method for understanding how the use and implementation of multifactorial FRATs can be optimized with and for HCPs, providing important implications for developers and eHealth interventions with regards to encouraging technology adoption.

Bio-Experiential Technology to Support Persons With Dementia and Care Partners at Home (TEND): Protocol for an Intervention Development Study

BACKGROUND

Alzheimer disease and related dementias are debilitating and incurable diseases. Persons with dementia and their informal caregivers (ie, dyads) experience high rates of emotional distress and negative health outcomes. Several barriers prevent dyads from engaging in psychosocial care including cost, transportation, and a lack of treatments that target later stages of dementia and target the dyad together. Technologically informed treatment and serious gaming have been shown to be feasible and effective among persons living with dementia and their care partners. To increase access, there is a need for technologically informed psychosocial interventions which target the dyad, together in the home.

OBJECTIVE

This study aims to develop the toolkit for experiential well-being in dementia, a dyadic, "bio-experiential" intervention for persons with dementia and their caregivers. Per our conceptual model, the toolkit for experiential well-being in dementia platform aims to target sustained attention, positive emotions, and active engagement among dyads. In this paper, we outline the protocol and conceptual model for intervention development and partnership with design and development experts.

METHODS

We followed the National Institutes of Health (NIH) stage model (stage 1A) and supplemented the model with principles of user-centered design. The first step includes understanding user needs, goals, and strengths. We met this step by engaging in methodology and definition synthesis and conducting focus groups with dementia care providers (N=10) and persons with dementia and caregivers (N=11). Step 2 includes developing and refining the prototype. We will meet this step by engaging dyads in up to 20 iterations of platform β testing workshops. Step 3 includes observing user interactions with the prototype. We will meet this step by releasing the platform for feasibility testing.

RESULTS

Key takeaways from the focus groups include balancing individualization and the dyadic relationship and avoiding confusing stimuli. As of September 2023, we have completed focus groups with providers, persons with dementia, and their caregivers. Additionally, we have conducted 4 iterations of β testing workshops with dyads. Feedback from focus groups informed the β testing workshops; data have not yet been formally analyzed and will be reported in future publications.

CONCLUSIONS

Technological interventions, particularly "bio-experiential" technology, can be used in dementia care to support emotional health among persons with a diagnosis and caregivers. Here, we outline a collaborative intervention development process of bio-experiential technology through a research, design, and development partnership. Next, we are planning to test the platform's feasibility as well as its impact on clinical outcomes and mechanisms of action.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/52799.

Design of an interface to communicate artificial intelligence-based prognosis for patients with advanced solid tumors: a user-centered approach

OBJECTIVES

To design an interface to support communication of machine learning (ML)-based prognosis for patients with advanced solid tumors, incorporating oncologists' needs and feedback throughout design.

MATERIALS AND METHODS

Using an interdisciplinary user-centered design approach, we performed 5 rounds of iterative design to refine an interface, involving expert review based on usability heuristics, input from a color-blind adult, and 13 individual semi-structured interviews with oncologists. Individual interviews included patient vignettes and a series of interfaces populated with representative patient data and predicted survival for each treatment decision point when a new line of therapy (LoT) was being considered. Ongoing feedback informed design decisions, and directed qualitative content analysis of interview transcripts was used to evaluate usability and identify enhancement requirements.

RESULTS

Design processes resulted in an interface with 7 sections, each addressing user-focused questions, supporting oncologists to "tell a story" as they discuss prognosis during a clinical encounter. The iteratively enhanced interface both triggered and reflected design decisions relevant when attempting to communicate ML-based prognosis, and exposed misassumptions. Clinicians requested enhancements that emphasized interpretability over explainability. Qualitative findings confirmed that previously identified issues were resolved and clarified necessary enhancements (eg, use months not days) and concerns about usability and trust (eg, address LoT received elsewhere). Appropriate use should be in the context of a conversation with an oncologist.

CONCLUSION

User-centered design, ongoing clinical input, and a visualization to communicate ML-related outcomes are important elements for designing any decision support tool enabled by artificial intelligence, particularly when communicating prognosis risk.

A Novel System for the Device-Based Measurement of Physical Activity, Sedentary Behavior, and Sleep (Motus): Usability Evaluation

BACKGROUND

Device-based measurements of physical behavior, using the current methods, place a large burden on participants. The Motus system could reduce this burden by removing the necessity for in-person meetings, replacing diaries written on paper with digital diaries, and increasing the automation of feedback generation.

OBJECTIVE

This study aims to describe the development of the Motus system and evaluate its potential to reduce participant burden in a two-phase usability evaluation.

METHODS

Motus was developed around (1) a thigh-worn accelerometer with Bluetooth data transfer; (2) a smartphone app containing an attachment guide, a digital diary, and facilitating automated data transfer; (3) a cloud infrastructure for data storage; (4) an analysis software to generate feedback for participants; and (5) a web-based app for administrators. We recruited 19 adults with a mean age of 45 (SD 11; range 27-63) years, of which 11 were female, to assist in the two-phase evaluation of Motus. A total of 7 participants evaluated the usability of mockups for a smartphone app in phase 1. Participants interacted with the app while thinking aloud, and any issues raised were classified as critical, serious, or minor by observers. This information was used to create an improved and functional smartphone app for evaluation in phase 2. A total of 12 participants completed a 7-day free-living measurement with Motus in phase 2. On day 1, participants attempted 20 system-related tasks under observation, including registration on the study web page, reading the information letter, downloading and navigating the smartphone app, attaching an accelerometer on the thigh, and completing a diary entry for both work and sleep hours. Task completion success and any issues encountered were noted by the observer. On completion of the 7-day measurement, participants provided a rating from 0 to 100 on the System Usability Scale and participated in a semistructured interview aimed at understanding their experience in more detail.

RESULTS

The task completion rate for the 20 tasks was 100% for 13 tasks, >80% for 4 tasks, and <50% for 3 tasks. The average rating of system usability was 86 on a 0-100 scale. Thematic analysis indicated that participants perceived the system as easy to use and remember, and subjectively pleasing overall. Participants with shift work reported difficulty with entering sleep hours, and 66% (8/12) of the participants experienced slow data transfer between the app and the cloud infrastructure. Finally, a few participants desired a greater degree of detail in the generated feedback.

CONCLUSIONS

Our two-phase usability evaluation indicated that the overall usability of the Motus system is high in free-living. Issues around the system's slow data transfer, participants with atypical work shifts, and the degree of automation and detail of generated feedback should be addressed in future iterations of the Motus system.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/35697.

Development and usability of a Mobile Interactive Application (VCPW) for Vascular Crisis Prewarning after Skin Flap Transplantation

Background

In microsurgical tissue transfer, skin flap transplantation is frequently used to heal the surface of a wound. Effective microcirculation surveillance of the skin flap is crucial. However, with traditional monitoring methods-that is, clinical observation-vascular crisis can still occur, thereby impairing postoperative recovery. A smartphone application is required to assist health care professionals in the standardized collection of flap perfusion parameters for flap management.

Methods

The Vascular Crisis Prewarning Application was created using a design science research methodology that prioritizes users and problems. The system usability scale was used to assess the application's usability among medical practitioners. The application was used at the clinic from December 2020 to September 2022. The unplanned return to the operating room, time to diagnose vascular crisis, and flap survival rate were compared with and without the application.

Results

The application consisted of 5 modules: patient addition and basic information entry, flap labeling, flap observation, crisis warning, and case archiving. The average rating for the application's usability among medical practitioners was 97.95 score (SD 2.36). With the application, the time to detect vascular crisis reduced from 26.71 to 16.26 h (P < 0.001), the unplanned return to the operation room increased from 8.18% to 10.24% (P = 0.587), and the flap survival rate went from 94.55% to 99.21% (P = 0.083).

Conclusions

An easy-to-use flap perfusion monitoring and prewarning application for medical practitioners was produced using a user-centered development method. The application provided a more standardized and accurate platform for data collection in flap management and reduced the time to detect vascular crisis. Larger cohort studies are required in the future to better assess the full potential of the application.

Advance Care Planning Website for People With Dementia and Their Family Caregivers: Protocol for a Development and Usability Study

BACKGROUND

Web-based tools for people with dementia and their family caregivers have considerably increased over the years and offer promising solutions to several unmet needs such as supporting self-care in daily life, facilitating treatment delivery, or ensuring their ability to communicate. The use of web-based tools in the field of advance care planning (ACP) for people with dementia and their family caregivers has yet to be explored and requires careful consideration, given the sensitive topic and the specific needs of people with dementia and their families.

OBJECTIVE

This paper reports the protocol for a study aiming to develop and simultaneously test the usability of an ACP website designed for, and with, people with dementia and their families.

METHODS

The development of the website is based on a process map for the development of web-based decision support interventions and on the Medical Research Council framework for complex intervention development and evaluation. Additionally, we apply a user-centered approach in combination with patient and public involvement (PPI) throughout the development process. We describe our iterative development approach to the website. Participants and a PPI group give feedback on 4 prototypes of the ACP website. For each iteration, we aim to include 12 participants (3 people with dementia, 3 family caregivers, and 3 dyads) in usability testing. In the first 3 iterations, usability testing includes (1) a think-aloud exercise, (2) researcher observations, and (3) the System Usability Scale questionnaire. The last iteration of usability testing is composed of a semistructured interview assessing the layout, content, face validity, and readability of the website. Qualitative data from the think-aloud exercises and interviews are analyzed using thematic analysis. Mean scores are calculated for the System Usability Scale questionnaire.

RESULTS

This study received approval from the Ethical Review Board of Brussels University Hospital of the Vrije Universiteit Brussel. Recruitment began in October 2021. The target date for paper submission of the results of the development and usability testing will be in 2023.

CONCLUSIONS

The methods in this protocol describe a feasible and inclusive approach to the development of an ACP website together with people with dementia, their family caregivers, and other stakeholders. We provide a clear overview of how to combine PPI input and user-centered development methods, leading to a transparent and reliable development process. This protocol might stimulate the active participation of people with dementia, their caregivers, and regional stakeholders in future studies on web-based technologies. The results of this study will be used to refine the design and create a relevant and user-friendly ACP website that is ready to be tested in a larger evaluation study.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/46935.

DETECT: DEveloping and testing a model to identify preventive vision loss among older paTients in gEneral praCTice - protocol for a complex intervention in Denmark

INTRODUCTION

The number of people living with visual impairment is increasing. Visual impairment causes loss in quality of life and reduce self-care abilities. The burden of disease is heavy for people experiencing visual impairment and their relatives. The severity and progression of age-related eye diseases are dependent on the time of detection and treatment options, making timely access to healthcare critical in reducing visual impairment. General practice plays a key role in public health by managing preventive healthcare, diagnostics and treatment of chronic conditions. General practitioners (GPs) coordinate services from other healthcare professionals. More involvement of the primary sector could potentially be valuable in detecting visual impairment.

METHODS

We apply the Medical Research Council framework for complex interventions to develop a primary care intervention with the GP as a key actor, aimed at identifying and coordinating care for patients with low vision. The development process will engage patients, relatives and relevant health professional stakeholders. We will pilot test the feasibility of the intervention in a real-world general practice setting. The intervention model will be developed through a participatory approach using qualitative and creative methods such as graphical facilitation. We aim to explore the potentials and limitations of general practice in relation to detection of preventable vision loss.

ETHICS AND DISSEMINATION

Ethics approval is obtained from local authority and the study meets the requirements from the Declaration of Helsinki. Dissemination is undertaken through research papers and to the broader public through podcasts and patient organisations.

The co-development of a linguistic and culturally tailored tele-retinopathy screening intervention for immigrants living with diabetes from China and African-Caribbean countries in Ottawa, Canada

BACKGROUND

Diabetic retinopathy is a sight-threatening ocular complication of diabetes. Screening is an effective way to reduce severe complications, but screening attendance rates are often low, particularly for newcomers and immigrants to Canada and people from cultural and linguistic minority groups. Building on previous work, in partnership with patient and health system stakeholders, we co-developed a linguistically and culturally tailored tele-retinopathy screening intervention for people living with diabetes who recently immigrated to Canada from either China or African-Caribbean countries.

METHODS

Following an environmental scan of diabetes eye care pathways in Ottawa, we conducted co-development workshops using a nominal group technique to create and prioritize personas of individuals requiring screening and identify barriers to screening that each persona may face. Next, we used the Theoretical Domains Framework to categorize the barriers/enablers and then mapped these categories to potential evidence-informed behaviour change techniques. Finally with these techniques in mind, participants prioritized strategies and channels of delivery, developed intervention content, and clarified actions required by different actors to overcome anticipated intervention delivery barriers.

RESULTS

We carried out iterative co-development workshops with Mandarin and French-speaking individuals living with diabetes (i.e., patients in the community) who immigrated to Canada from China and African-Caribbean countries (n = 13), patient partners (n = 7), and health system partners (n = 6) recruited from community health centres in Ottawa. Patients in the community co-development workshops were conducted in Mandarin or French. Together, we prioritized five barriers to attending diabetic retinopathy screening: language (TDF Domains: skills, social influences), retinopathy familiarity (knowledge, beliefs about consequences), physician barriers regarding communication for screening (social influences), lack of publicity about screening (knowledge, environmental context and resources), and fitting screening around other activities (environmental context and resources). The resulting intervention included the following behaviour change techniques to address prioritized local barriers: information about health consequence, providing instructions on how to attend screening, prompts/cues, adding objects to the environment, social support, and restructuring the social environment. Operationalized delivery channels incorporated language support, pre-booking screening and sending reminders, social support via social media and community champions, and providing using flyers and videos as delivery channels.

CONCLUSION

Working with intervention users and stakeholders, we co-developed a culturally and linguistically relevant tele-retinopathy intervention to address barriers to attending diabetic retinopathy screening and increase uptake among two under-served groups.

Can youth-engaged research facilitate equitable access to contraception in Canada? The qualitative study protocol for the Ask Us project

INTRODUCTION

There is little to no evidence in Canada on the barriers that youth face when accessing contraception. We seek to identify the contraception access, experiences, beliefs, attitudes, knowledge, and needs of youth in Canada, from the perspectives of youth and youth service providers.

METHODS AND ANALYSIS

This prospective, mixed-methods, integrated knowledge mobilisation study, the Ask Us project, will involve a national sample of youth, healthcare and social service providers, and policy makers recruited via a novel relational mapping and outreach approach led by youth. Phase I will centre the voices of youth and their service providers through in-depth one-on-one interviews. We will explore the factors influencing youth access to contraception, theoretically guided by Levesque's Access to Care framework. Phase II will focus on the cocreation and evaluation of knowledge translation products (youth stories) with youth, service providers, and policy makers.

ETHICS AND DISSEMINATION

Ethical approval was received from the University of British Columbia's Research Ethics Board (H21-01091). Full open-access publication of the work will be sought in an international peer-reviewed journal. Findings will be disseminated to youth and service providers through social media, newsletters, and communities of practice, and to policy makers through invited evidence briefs and face-to-face presentations.

Role of digital health in pulmonary rehabilitation and beyond: shaping the future

Pulmonary rehabilitation (PR) is a cost-effective intervention with well-known benefits to exercise capacity, symptoms and quality of life in patients with chronic respiratory diseases. Despite the compelling evidence of its benefits, PR implementation is still suboptimal, and maintenance of PR benefits is challenging. To overcome these pitfalls, there has been a growing interest in developing novel models for PR delivery. Digital health is a promising solution, as it has the potential to address some of the most reported barriers to PR uptake and adherence (such as accessibility issues), help maintain the positive results following a PR programme and promote patients' adherence to a more active lifestyle through physical activity (tele)coaching. Despite the accelerated use of digital health to deliver PR during the coronavirus disease 2019 pandemic, there are still several factors that contribute to the resistance to the adoption of digital health, such as the lack of evidence on its effectiveness, low acceptability by patients and healthcare professionals, concerns about implementation and maintenance costs, inequalities in access to the internet and technological devices, and data protection issues. Nevertheless, the trend towards reducing technology costs and the higher availability of digital devices, as well as the greater ease and simplicity of use of devices, enhance the opportunities for future development of digitally enabled PR interventions. This narrative review aims to examine the current evidence on the role of digital health in the context of PR, including strengths and weaknesses, and to determine possible threats and opportunities, as well as areas for future work.

The Mobile Patient Information Assistant (PIA) App during the Inpatient Surgical Hospital Stay: Evaluation of Usability and Patient Approval

Mobile eHealth apps are becoming increasingly important tools in healthcare management, capable of providing education and support at any time. There is little knowledge about surgical patients' appreciation and use of these apps. The objective of this study was to develop and evaluate a user-friendly medical app (PIA; Patient Information Assistant) for providing individual patient information before and after inpatient urological surgery. Twenty-two patients aged 35 to 75 years were provided with timely information, push notifications, and personalized agendas (e.g., date of presentation, time of surgery, time of doctor's consultation, imaging appointment) via the PIA app. Of the 22 patients, 19 evaluated the PIA app in terms of usage and usability, benefits, and potential for improvement. Of the study participants, 95% did not need any assistance to use the app, 74% confirmed that the PIA app made them feel better informed and more satisfied with their hospital stay, and 89% stated that they would like to re-use the PIA app and support the general use of medical apps in healthcare. Thus, we created an innovative digital health information tool, allowing targeted support for doctor-nurse-patient communication and offering great potential for patient support before and after surgery. Our study revealed that use of an app during the surgical hospital stay is readily accepted and benefits patients by acting as an additional informative tool.

Preliminary Testing of A Web-Based Lung Cancer Screening Decision Coaching Toolfor Older Chinese American Smokers and Their Providers

OBJECTIVES

To examine the acceptability of a culturally targeted lung cancer screening decision aid developed for older Chinese Americans with a smoking history and primary care providers serving this patient population.

METHODS

Study participants reviewed a web-based decision aid (DA) for lung cancer screening named "Lung Decisions Coaching Tool (LDC-T)." Participants completed a baseline survey and were invited to join an interview. During the interview, participants engaged with the Lung Decisions Coaching Tool and then completed standardized measures of acceptability, usability, and satisfaction.

RESULTS

Chinese American smokers (N =22) and Chinese American physicians (N=10) rated the acceptability and usability of a patient version and provider versions of the LDC-T, respectively. Patient version demonstrated high levels of acceptability, usability and satisfaction. Most participants rated the information provided as good or excellent, the amount of tool information was just right, and they thought the tool would be useful for making a screening decision. The tool was well received by participants for ease of use and well-integrated functions. Furthermore, participants indicated they would like to use the tool to help prepare for lung cancer screening shared decision-making with their provider. Similar results were found for the provider version of the LDC-T.

CONCLUSIONS

Lung cancer screening represents an evidence-based approach to reducing lung cancer morbidity and mortality among chronic high-frequency smokers. Study results suggest the acceptability of a culturally targeted lung cancer screening decision aid for Chinese American smokers and providers. Additional research is needed to determine the effectiveness of the DA in increasing appropriate levels of screening in this underserved population.

IMplementing Predictive Analytics towards efficient COPD Treatments (IMPACT): protocol for a stepped-wedge cluster randomized impact study

INTRODUCTION

Personalized disease management informed by quantitative risk prediction has the potential to improve patient care and outcomes. The integration of risk prediction into clinical workflow should be informed by the experiences and preferences of stakeholders, and the impact of such integration should be evaluated in prospective comparative studies. The objectives of the IMplementing Predictive Analytics towards efficient chronic obstructive pulmonary disease (COPD) treatments (IMPACT) study are to integrate an exacerbation risk prediction tool into routine care and to determine its impact on prescription appropriateness (primary outcome), medication adherence, quality of life, exacerbation rates, and sex and gender disparities in COPD care (secondary outcomes).

METHODS

IMPACT will be conducted in two phases. Phase 1 will include the systematic and user-centered development of two decision support tools: (1) a decision tool for pulmonologists called the ACCEPT decision intervention (ADI), which combines risk prediction from the previously developed Acute COPD Exacerbation Prediction Tool with treatment algorithms recommended by the Canadian Thoracic Society's COPD pharmacotherapy guidelines, and (2) an information pamphlet for COPD patients (patient tool), tailored to their prescribed medication, clinical needs, and lung function. In phase 2, we will conduct a stepped-wedge cluster randomized controlled trial in two outpatient respiratory clinics to evaluate the impact of the decision support tools on quality of care and patient outcomes. Clusters will be practicing pulmonologists (n ≥ 24), who will progressively switch to the intervention over 18 months. At the end of the study, a qualitative process evaluation will be carried out to determine the barriers and enablers of uptake of the tools.

DISCUSSION

The IMPACT study coincides with a planned harmonization of electronic health record systems across tertiary care centers in British Columbia, Canada. The harmonization of these systems combined with IMPACT's implementation-oriented design and partnership with stakeholders will facilitate integration of the tools into routine care, if the results of the proposed study reveal positive association with improvement in the process and outcomes of clinical care. The process evaluation at the end of the trial will inform subsequent design iterations before largescale implementation.

TRIAL REGISTRATION

NCT05309356.

Development of a Patient Decision Aid for Rectal Cancer Patients with Clinical Complete Response after Neo-Adjuvant Treatment

Surgery is the primary component of curative treatment for patients with rectal cancer. However, patients with a clinical complete response (cCR) after neo-adjuvant treatment may avoid the morbidity and mortality of radical surgery. An organ-sparing strategy could be an oncological equivalent alternative. Therefore, shared decision making between the patient and the healthcare professional (HCP) should take place. This can be facilitated by a patient decision aid (PtDA). In this study, we developed a PtDA based on a literature review and the key elements of the Ottawa Decision Support Framework. Additionally, a qualitative study was performed to review and evaluate the PtDA by both HCPs and former rectal cancer patients by a Delphi procedure and semi-structured interviews, respectively. A strong consensus was reached after the first round (I-CVI 0.85-1). Eleven patients were interviewed and most of them indicated that using a PtDA in clinical practice would be of added value in the decision making. Patients indicated that their decisional needs are centered on the impact of side effects on their quality of life and the outcome of the different options. The PtDA was modified taking into account the remarks of patients and HCPs and a second Delphi round was held. The second round again showed a strong consensus (I-CVI 0.87-1).

Development of a video-based evidence synthesis knowledge translation resource: Drawing on a user-centred design approach

Objectives

We aimed to develop a video animation knowledge translation (KT) resource to explain the purpose, use and importance of evidence synthesis to the public regarding healthcare decision-making.

Methods

We drew on a user-centred design approach to develop a spoken animated video (SAV) by conducting two cycles of idea generation, prototyping, user testing, analysis, and refinement. Six researchers identified the initial key messages of the SAV and informed the first draft of the storyboard and script. Seven members of the public provided input on this draft and the key messages through think-aloud interviews, which we used to develop an SAV prototype. Seven additional members of the public participated in think-aloud interviews while watching the video prototype. All members of the public also completed a questionnaire on perceived usefulness, desirability, clarity and credibility. We subsequently synthesised all data to develop the final SAV.

Results

Researchers identified the initial key messages as 1) the importance of evidence synthesis, 2) what an evidence synthesis is and 3) how evidence synthesis can impact healthcare decision-making. Members of the public rated the initial video prototype as 9/10 for usefulness, 8/10 for desirability, 8/10 for clarity and 9/10 for credibility. Using their guidance and feedback, we produced a three-and-a-half-minute video animation. The video was uploaded on YouTube, has since been translated into two languages, and viewed over 12,000 times to date.

Conclusions

Drawing on user-centred design methods provided a structured and transparent approach to the development of our SAV. Involving members of the public enhanced the credibility and usefulness of the resource. Future work could explore involving the public from the outset to identify key messages in developing KT resources explaining methodological topics. This study describes the systematic development of a KT resource with limited resources and provides transferrable learnings for others wishing to do similar.

Dual Protection Messaging for Adolescents and Young Adults in the Setting of Over-the-Counter Hormonal Contraception: A Human-Centered Design Approach

STUDY OBJECTIVE

To use human-centered design approaches to engage adolescents and young adults in the creation of messages focused on dual method use in the setting of over-the-counter hormonal contraception access DESIGN: Baseline survey and self-directed workbooks with human-centered design activities were completed. The workbooks were transcribed and analyzed using qualitative methods to determine elements of the communication model, including sender, receiver, message, media, and environment.

SETTING

Indiana and Georgia PARTICIPANTS: People aged 14-21 years in Indiana and Georgia INTERVENTIONS: Self-directed workbooks MAIN OUTCOME MEASURES: Elements of the communication model, including sender, receiver, message, media, and environment RESULTS: We analyzed 54 workbooks, with approximately half from each state. Stakeholders self-identified as female (60.5%), white (50.9%), Hispanic (10.0%), sexually active (69.8%), and heterosexual (79.2%), with a mean age of 18 years. Most strongly agreed (75.5%) that they knew how to get condoms, but only 30.2% expressed the same sentiment about hormonal contraception. Exploration of the elements of the communication model indicated the importance of crafting tailored messages to intended receivers. Alternative terminology for dual protection, such as "Condom+____," was created.

CONCLUSION

There is a need for multiple and diverse messaging strategies about dual method use in the context of over-the-counter hormonal contraception to address the various pertinent audiences as this discussion transitions outside of traditional clinical encounters. Human-centered design approaches can be used for novel message development.

Using co-design to develop a tool for shared goal-setting with parents in speech and language therapy

BACKGROUND

Despite the compelling case for engaging parents in speech and language therapy, research indicates that speech and language therapists (SLTs) currently have a leading role in the goal-setting process of therapy for children with developmental language disorder (DLD). Therefore, we set out to develop a tool that aims to support the dialogue between SLTs and parents and enhance shared decision-making about children's communicative participation goals. We used co-design techniques with SLT-practitioners to include their perspectives throughout the design process. Although co-design has been used for some years in healthcare research, it is still a relatively new research methodology in the field of speech and language therapy.

AIMS

To provide a detailed description of the co-design process that led to the development of a physical artefact that can support SLTs to engage parents of children with DLD in collaborative goal-setting.

METHODS & PROCEDURES

The Design Council's Double Diamond model was used to develop a tool in co-design, together with eight SLTs, who participated in all stages of the development process. Usability was tested in actual goal-setting conversations between four SLTs and 11 parents of a child with DLD resulting in stepwise improvements. In addition, usability of the first and final prototypes was tested with five usability criteria that were rated on a 10-point scale by 64 SLTs.

OUTCOMES & RESULTS

The co-design process resulted in the development of a physical prototype of the tool called 'ENGAGE', consisting of a metal 'tree trunk' on which parents can stick magnetic 'leaves' containing potential participation goals for their child. The 'tree' shape represents a child's development and opportunities for growth. This first prototype received marks between 7.0 and 8.0 out of 10 on attractiveness, user-friendliness, safety, functionality and affordability. After several iterations, there were significantly higher marks for attractiveness, user-friendliness and safety in favour for the final prototype. Marks for functionality and affordability did not change significantly.

CONCLUSIONS & IMPLICATIONS

As researchers we usually develop pen-and-paper tools, interview protocols, apps or questionnaires to support clinical practice. Including the SLTs' perspectives in the design process resulted in a tree-shaped physical artefact that, according to the SLTs, helps to order information and encourages and guides their dialogue with parents. We strongly advocate the inclusion of end-users in developing innovative user-centred tools for speech and language therapy and we hope that this will become widespread practice.

WHAT THIS PAPER ADDS

What is already known on the subject Collaborative goal-setting is at the heart of family-centred speech and language therapy. However, research indicates that goal-setting processes for children with DLD are currently predominantly therapist-led, instead of family-centred. Reasons for the lack of parental engagement are that effective communication with parents throughout the goal-setting process appears to be complex, and parents are not always invited and supported to engage in this. We used co-design to develop a tool that aims to support SLTs in their dialogue about therapy goals with parents. What this paper adds to existing knowledge This paper provides an example of applying a co-design approach for the development of a shared goal-setting tool for SLTs and parents of young children with DLD. The co-design approach enabled us to incorporate needs, experiences and ideas of SLTs in the design process. We report the four stages in the co-design process from (1) discovering the needs, wants and desires of the people involved, (2) defining the problem that SLTs experience, (3) developing several solutions and selecting the best solution, and (4) developing and testing the prototype. The detailed description of this process can add to an understanding of the advantages and disadvantages of a design process that includes the perspective of end-users. The result is a physical artefact representing a tree, which aims to support the conversation between SLTs and parents about a child's communicative participation. Items describing facets of communicative participation are printed on 'leaves' that can be hung on a tree trunk by parents. The tree shape is a positive metaphor for the growth and development of a child. What are the potential or actual clinical implications of this work? This study describes how SLTs can be meaningfully involved as partners in a co-design research approach. Incorporating experience from clinical practice was highly relevant since our study aimed to create a solution that would support goal-setting and service delivery by SLTs. We want to show that it is inspiring and beneficial for SLTs to partner with researchers in innovation of their own clinical practice and provide examples of co-design activities that illustrate the involvement and influence of end-users in a design process. Including the perspective of SLTs in the development of a new tool to facilitate the dialogue between SLTs and parents of children with DLD regarding therapy goal-setting is expected to add value and enhance its implementation in clinical practice.

Mobile health platform based on user-centered design to promote exercise for patients with peripheral artery disease

BACKGROUND

Peripheral artery disease (PAD) is a cardiovascular disease that can be improved by risk factor modification. Mobile health (mHealth) intervention is an effective method of healthcare delivery to promote behavior changes. An mHealth platform can encourage consistent involvement of participants and healthcare providers for health promotion. This study aimed to develop an mHealth platform consisting of a smartphone application (app) synchronized with a wearable activity tracker and a web-based portal to support exercise intervention in patients with PAD.

METHODS

This study was conducted based on an iterative development process, including analysis, design, and implementation. In the analysis phase, a literature review and needs assessment through semi-structured interviews (n = 15) and a questionnaire-based survey (n = 138) were performed. The initial prototype design and contents were developed based on the users' requirements. In the implementation phase, multidisciplinary experts (n = 4) evaluated the heuristics, following which the mHealth platform was revised. User evaluation of the usability was performed by nurses (n = 4) and patients with PAD (n = 3).

RESULTS

Through the development process, the functional requirements of the platform were represented through visual display, reminder, education, self-monitoring, goal setting, goal attainment, feedback, and recording. In-app videos of exercise and PAD management were produced to provide information and in-app automatic text messages were developed for user motivation. The final version of the platform was rated 67.86 out of 100, which indicated "good" usability.

CONCLUSIONS

The mHealth platform was designed and developed for patients with PAD and their healthcare providers. This platform can be used to educate and promote individualized exercise among patients with PAD.

Cocreation with Dutch patients of decision-relevant information to support shared decision-making about adjuvant treatment in breast cancer care

BACKGROUND

To support patients in shared decision-making about treatment options, patient decision aids (PtDAs) usually provide benefit/harm information and value clarification methods (VCMs). Recently, personalized risk information from prediction models is also being integrated into PtDAs. This study aimed to design decision-relevant information (i.e., personalized survival rates, harm information and VCMs) about adjuvant breast cancer treatment in cocreation with patients, in a way that suits their needs and is easily understandable.

METHODS

Three cocreation sessions with breast cancer patients (N = 7-10; of whom N = 5 low health literate) were performed. Participants completed creative assignments and evaluated prototypes of benefit/harm information and VCMs. Prototypes were further explored through user testing with patients (N = 10) and healthcare providers (N = 10). The researchers interpreted the collected data, for example, creative and homework assignments, and participants' presentations, to identify key themes. User tests were transcribed and analysed using ATLAS.ti to assess the understanding of the prototypes.

RESULTS

Important information needs were: (a) need for overview/structure of information directly after diagnosis and; (b) need for transparent benefit/harm information for all treatment options, including detailed harm information. Regarding VCMs, patients stressed the importance of a summary/conclusion. A bar graph seemed the most appropriate way of displaying personalized survival rates; the impact of most other formats was perceived as too distressful. The concept of 'personalization' was not understood by multiple patients.

CONCLUSIONS

A PtDA about adjuvant breast cancer treatment should provide patients with an overview of the steps and treatment options, with layers for detailed information. Transparent information about the likelihood of benefits and harm should be provided. Given the current lack of information on the likelihood of side effects/late effects, efforts should be made to collect and share these data with patients. Further quantitative studies are needed to validate the results and to investigate how the concept of 'personalization' can be communicated.

PATIENT OR PUBLIC CONTRIBUTION

Ten breast cancer patients participated in three cocreation sessions to develop decision-relevant information. Subsequent user testing included 10 patients. The Dutch Breast Cancer Association (BVN) was involved as an advisor in the general study design.

The Surveillance of Physical Activity, Sedentary Behavior, and Sleep: Protocol for the Development and Feasibility Evaluation of a Novel Measurement System

BACKGROUND

There is increasing recognition of the need for more comprehensive surveillance data, including information on physical activity of all intensities, sedentary behavior, and sleep. However, meeting this need poses significant challenges for current surveillance systems, which are mainly reliant on self-report.

OBJECTIVE

The primary objective of this project is to develop and evaluate the feasibility of a sensor-based system for use in the surveillance of physical activity, sedentary behavior, and sleep (SurPASS) at a national level in Denmark.

METHODS

The SurPASS project involves an international, multidisciplinary team of researchers collaborating with an industrial partner. The SurPASS system consists of (1) a thigh-worn accelerometer with Bluetooth connectivity, (2) a smartphone app, (3) an integrated back end, facilitating the automated upload, analysis, storage, and provision of individualized feedback in a manner compliant with European Union regulations on data privacy, and (4) an administrator web interface (web application) to monitor progress. The system development and evaluation will be performed in 3 phases. These phases will include gathering user input and specifications (phase 1), the iterative development, evaluation, and refinement of the system (phase 2), and the feasibility evaluation (phase 3).

RESULTS

The project started in September 2020 and completed phase 2 in February 2022. Phase 3 began in March 2022 and results will be made available in 2023.

CONCLUSIONS

If feasible, the SurPASS system could be a catalyst toward large-scale, sensor-based surveillance of physical activity, sedentary behavior, and sleep. It could also be adapted for cohort and interventional research, thus contributing to the generation of evidence for both interventions and public health policies and recommendations.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/35697.

Development of a Patient Decision Aid to Help People Living with Inflammatory Bowel Disease

BACKGROUND: Patient decision aid (PDA) is a tool, which helps the improvement of shared decisionmaking and is a part of the paradigm shift from physician-centered decisions to patient-centered shared decision making. In this study, we aimed to describe the process used to develop a PDA for facilitating shared decision-making about treatment in patients with inflammatory bowel disease (IBD) who need medication (corticosteroid, azathioprine, anti-TNF, and infliximab) or surgery. METHODS: The development process of PDA included: 1) The development of a prototype based on literature review and interview 2) 'Alpha' testing with patients and clinicians 3) 'Beta' testing in real conditions and 4) The production of a final version. This process took about 12 months (2019-2020). The participants were adult patients with IBD, gastroenterologists, and nurses. RESULTS: The final PDA contains four important sections: 1) Introduction about IBD disease, the purpose of developing PDA, and emphasis on shared decision-making 2) Benefits and risks of main medicines 3) The success rate as well as the incidence of complications after surgery, and 4) The conclusion about patients' satisfaction with PDA to choose the treatment options. Besides, PDA evaluation in the real world setting showed that 100% of physicians (n=4) and 86% of patients (n=12) were completely satisfied with the content of the PDA and considered it applicable and useful. CONCLUSION: This PDA can help patients participate in the shared decision-making process and select the best medical and surgical treatment methods. The feedback received from clinicians and patients showed their satisfaction with using the PDA.

Toward Food Sovereignty for Coastal Communities of Eastern Québec: Co-designing A Website to Support Consumption of Edible Resources from the St. Lawrence River, Estuary, and Gulf

Background. Despite the abundance and proximity of edible marine resources, coastal communities along the St. Lawrence in Eastern Québec rarely consume these resources. Within a community-based food sovereignty project, Manger notre Saint-Laurent (“Sustenance from our St. Lawrence”), members of participating communities (3 non-Indigenous, 1 Indigenous) identified a need for a web-based decision tool to help make informed consumption choices. Methods. We thus aimed to co-design a prototype website that facilitates informed choices about consuming local edible marine resources based on seasonal and regional availability, food safety, nutrition, and sustainability, with community members, regional stakeholders, and experts in user experience design and web development. We conducted 48 interviews with a variety of people over 3 iterative cycles, assessing the prototype’s ease of use with a validated measure, the System Usability Scale. Results. Community members, regional stakeholders, and other experts identified problematic elements in initial versions of the website (e.g., confusing symbols). We resolved issues and added features people identified as useful. Usability scores reached “best imaginable” for both the second and the third versions and did not differ significantly between sociodemographic groups. The final prototype includes a tool to explore each species and index cards to regroup accurate evidence relevant to each species. Conclusions. Engaging co-designers with different sociodemographic characteristics brought together a variety of perspectives. Several components would not have been included without co-designers’ input; other components were greatly improved thanks to their feedback. Co-design approaches in research and intervention development are preferable to foster the inclusion of a variety of people. Once the prototype is programmed and available online, we hope to evaluate the website to determine its effects on food choices.

A model for building a national, patient-driven database to track contraceptive use in women with rare diseases

Data on the safety and effectiveness of contraception among women with rare diseases are critical and sorely lacking. To fill this gap, we propose a national, patient-driven database that tracks contraceptive safety and effectiveness among women with rare diseases. We built a pilot database focusing on women with cystic fibrosis in 3 phases: (1) database design input from patients and experts, (2) merging of contraceptive survey data with relevant clinical outcomes from the Cystic Fibrosis Foundation Patient Registry (CFFPR), and (3) forming a data guide to facilitate accessible output data. We successfully linked 62 contraceptive survey variables with 362 relevant clinical outcome variables for 150 patients. This pilot represents a breakthrough in linking contraceptive data to disease-specific outcomes and informs how to build a national, patient-driven contraceptive database for women with rare diseases.

Using Mixed Methods With Multiple Stakeholders to Inform Development of a Breast Cancer Screening Decision Aid for Women With Limited Health Literacy

Background. When stakeholders offer divergent input, it can be unclear how to prioritize information for decision aids (DAs) on mammography screening. Objectives. This analysis triangulates perspectives (breast cancer screening experts, primary care providers [PCPs], and patients with limited health literacy [LHL]) to understand areas of divergent and convergent input across stakeholder groups in developing a breast cancer screening DA for younger women with LHL. Design. A modified online Delphi panel of 8 experts rated 57 statements for inclusion in a breast cancer screening DA over three rounds. Individual interviews with 25 patients with LHL and 20 PCPs from a large safety net hospital explored informational needs about mammography decision making. Codes from the qualitative interviews and open-ended responses from the Delphi process were mapped across stakeholders to ascertain areas where stakeholder preferences converged or diverged. Results. Four themes regarding informational needs were identified regarding 1) the benefits and harms of screening, 2) different screening modalities, 3) the experience of mammography, and 4) communication about breast cancer risk. Patients viewed pain as the primary harm, while PCPs and experts emphasized the harm of false positives. Patients, but not PCPs or experts, felt that information about the process of getting a mammogram was important. PCPs believed that mammography was the only evidence-based screening modality, while patients believed breast self-exam was also important for screening. All stakeholders described incorporating personal risk information as important. Limitations. As participants came from one hospital, perceptions may reflect local practices. The Delphi sample size was small. Conclusions. Patients, experts, and PCPs had divergent views on the most important information needed for screening decisions. More evidence is needed to guide integration of multiple stakeholder perspectives into the content of DAs.

Decision aids linked to evidence summaries and clinical practice guidelines: results from user-testing in clinical encounters

Background

Tools for shared decision-making (e.g. decision aids) are intended to support health care professionals and patients engaged in clinical encounters involving shared decision-making. However, decision aids are hard to produce, and onerous to update. Consequently, they often do not reflect best current evidence, and show limited uptake in practice. In response, we initiated the Sharing Evidence to Inform Treatment decisions (SHARE-IT) project. Our goal was to develop and refine a new generation of decision aids that are generically produced along digitally structured guidelines and evidence summaries.

Methods

Applying principles of human-centred design and following the International Patient Decision Aid Standards (IPDAS) and GRADE methods for trustworthy evidence summaries we developed a decision aid prototype in collaboration with the Developing and Evaluating Communication strategies to support Informed Decisions and practice based on Evidence project (DECIDE). We iteratively user-tested the prototype in clinical consultations between clinicians and patients. Semi-structured interviews of participating clinicians and patients were conducted. Qualitative content analysis of both user-testing sessions and interviews was performed and results categorized according to a revised Morville’s framework of user-experience. We made it possible to produce, publish and use these decision aids in an electronic guideline authoring and publication platform (MAGICapp).

Results

Direct observations and analysis of user-testing of 28 clinical consultations between physicians and patients informed four major iterations that addressed readability, understandability, usability and ways to cope with information overload. Participants reported that the tool supported natural flow of the conversation and induced a positive shift in consultation habits towards shared decision-making. We integrated the functionality of SHARE-IT decision aids in MAGICapp, which has since generated numerous decision aids.

Conclusion

Our study provides a proof of concept that encounter decision aids can be generically produced from GRADE evidence summaries and clinical guidelines. Online authoring and publication platforms can help scale up production including continuous updating of electronic encounter decision aids, fully integrated with evidence summaries and clinical practice guidelines.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-021-01541-7.

Why Are Digital Health Care Systems Still Poorly Designed, and Why Is Health Care Practice Not Asking for More? Three Paths Toward a Sustainable Digital Work Environment

Knowledge of how to design digital systems that are ergonomically sound, high in usability, and optimized for the user, context, and task has existed for some time. Despite this, there are still too many examples of new digital health care systems that are poorly designed and that could negatively affect both the work environment of health care staff and patient safety. This could be because of a gap between the theoretical knowledge of design and ergonomics and the practical implementation of this knowledge in procuring and developing digital health care systems. Furthermore, discussions of digitalization are often at a general level and risk neglecting the nature of direct interaction with the digital system. This is problematic since it is at this detailed level that work environment and patient safety issues materialize in practice. In this paper, we illustrate such issues with two scenarios concerned with contemporary electronic health care records, based on field studies in two health care settings. We argue that current methods and tools for designing and evaluating digital systems in health care must cater both to the holistic level and to the details of interaction and ergonomics. It must also be acknowledged that health care professionals are neither designers nor engineers, so expectations of them during the development of digital systems must be realistic. We suggest three paths toward a more sustainable digital work environment in health care: (1) better tools for evaluating the digital work environment in the field; (2) generic formulations of qualitative requirements related to usability and for adaptation to the user, context, and task, to be used in procurement; and (3) the introduction of digital ergonomics as an embracing concept capturing several of the ergonomic challenges (including physical, cognitive, and organizational aspects) involved in implementing and using digital systems.

Patients' and Providers' Needs and Preferences When Considering Fertility Preservation Before Cancer Treatment: Decision-Making Needs Assessment

BACKGROUND

As cancer treatments continue to improve, it is increasingly important that women of reproductive age have an opportunity to decide whether they want to undergo fertility preservation treatments to try to protect their ability to have a child after cancer. Clinical practice guidelines recommend that providers offer fertility counseling to all young women with cancer; however, as few as 12% of women recall discussing fertility preservation. The long-term goal of this program is to develop an interactive web-based patient decision aid to improve awareness, access, knowledge, and decision making for all young women with cancer. The International Patient Decision Aid Standards collaboration recommends a formal decision-making needs assessment to inform and guide the design of understandable, meaningful, and usable patient decision aid interventions.

OBJECTIVE

This study aims to assess providers' and survivors' fertility preservation decision-making experiences, unmet needs, and initial design preferences to inform the development of a web-based patient decision aid.

METHODS

Semistructured interviews and an ad hoc focus group assessed current decision-making experiences, unmet needs, and recommendations for a patient decision aid. Two researchers coded and analyzed the transcripts using NVivo (QSR International). A stakeholder advisory panel guided the study and interpretation of results.

RESULTS

A total of 51 participants participated in 46 interviews (18 providers and 28 survivors) and 1 ad hoc focus group (7 survivors). The primary themes included the importance of fertility decisions for survivorship, the existence of significant but potentially modifiable barriers to optimal decision making, and a strong support for developing a carefully designed patient decision aid website. Providers reported needing an intervention that could quickly raise awareness and facilitate timely referrals. Survivors reported needing understandable information and help with managing uncertainty, costs, and pressures. Design recommendations included providing tailored information (eg, by age and cancer type), optional interactive features, and multimedia delivery at multiple time points, preferably outside the consultation.

CONCLUSIONS

Decision making about fertility preservation is an important step in providing high-quality comprehensive cancer care and a priority for many survivors' optimal quality of life. Decision support interventions are needed to address gaps in care and help women quickly navigate toward an informed, values-congruent decision. Survivors and providers support developing a patient decision aid website to make information directly available to women outside of the consultation and to provide self-tailored content according to women's clinical characteristics and their information-seeking and deliberative styles.

Educational interventions using a primer and motivational interviewing: randomized clinical trial

BACKGROUND

Many educational technologies have been used to promote the health of the population. Thus, the objective was to assess the effect of using an individual educational primer along with the Brief Motivational Interviewing (BMI) for increasing maternal self-efficacy for preventing childhood diarrhoea.

METHODS

Randomized clinical trial, conducted in Fortaleza/Ceará-Brazil, composed of 181 mothers and/or guardians of children under five years, who were randomized into three groups: experimental group A (EG A)-who read the primer, experimental group B (EG B)-application of the primer and BMI and the control group (CG). The participants' assessment was based on the Maternal Self-Efficacy Scale for Preventing Childhood Diarrhoea and the diarrhoea Investigation Form at the beginning of the intervention and then 30 and 60 days after the first contact with the participants.

RESULTS

There were 60 participants in EG A and CG and 61 in EG B. It was noted a greater incidence of participants with high self-efficacy in EG B after applying the technologies. All groups manifested diarrhoea among children after the interventions, although with a lower number in EG B, one-month post-intervention (P = 0.025).

CONCLUSIONS

The combined use of the primer and the BMI contributed significantly over time to increase maternal self-efficacy in preventing childhood diarrhoea and reduce cases of this disease.

Harmonizing evidence-based practice, implementation context, and implementation strategies with user-centered design: a case example in young adult cancer care

BACKGROUND

Attempting to implement evidence-based practices in contexts for which they are not well suited may compromise their fidelity and effectiveness or burden users (e.g., patients, providers, healthcare organizations) with elaborate strategies intended to force implementation. To improve the fit between evidence-based practices and contexts, implementation science experts have called for methods for adapting evidence-based practices and contexts and tailoring implementation strategies; yet, methods for considering the dynamic interplay among evidence-based practices, contexts, and implementation strategies remain lacking. We argue that harmonizing the three can be facilitated by user-centered design, an iterative and highly stakeholder-engaged set of principles and methods.

METHODS

This paper presents a case example in which we used a three-phase user-centered design process to design and plan to implement a care coordination intervention for young adults with cancer. Specifically, we used usability testing to redesign and augment an existing patient-reported outcome measure that served as the basis for our intervention to optimize its usability and usefulness, ethnographic contextual inquiry to prepare the context (i.e., a comprehensive cancer center) to promote receptivity to implementation, and iterative prototyping workshops with a multidisciplinary design team to design the care coordination intervention and anticipate implementation strategies needed to enhance contextual fit.

RESULTS

Our user-centered design process resulted in the Young Adult Needs Assessment and Service Bridge (NA-SB), including a patient-reported outcome measure and a collection of referral pathways that are triggered by the needs young adults report, as well as implementation guidance. By ensuring NA-SB directly responded to features of users and context, we designed NA-SB for implementation, potentially minimizing the strategies needed to address misalignment that may have otherwise existed. Furthermore, we designed NA-SB for scale-up; by engaging users from other cancer programs across the country to identify points of contextual variation which would require flexibility in delivery, we created a tool intended to accommodate diverse contexts.

CONCLUSIONS

User-centered design can help maximize usability and usefulness when designing evidence-based practices, preparing contexts, and informing implementation strategies-in effect, harmonizing evidence-based practices, contexts, and implementation strategies to promote implementation and effectiveness.

Generating Intervention Concepts for Reducing Adolescent Relationship Abuse Inequities Among Sexual and Gender Minority Youth: Protocol for a Web-Based, Longitudinal, Human-Centered Design Study

Background

Sexual and gender minority youth (SGMY; eg, lesbian, gay, bisexual, and transgender youth) are at greater risk than their cisgender heterosexual peers for adolescent relationship abuse (ARA; physical, sexual, or psychological abuse in a romantic relationship). However, there is a dearth of efficacious interventions for reducing ARA among SGMY. To address this intervention gap, we designed a novel web-based methodology leveraging the field of human-centered design to generate multiple ARA intervention concepts with SGMY.

Objective

This paper aims to describe study procedures for a pilot study to rigorously test the feasibility, acceptability, and appropriateness of using web-based human-centered design methods with SGMY to create novel, stakeholder-driven ARA intervention concepts.

Methods

We are conducting a longitudinal, web-based human-centered design study with 45-60 SGMY (aged between 14 and 18 years) recruited via social media from across the United States. Using MURAL (a collaborative, visual web-based workspace) and Zoom (a videoconferencing platform), the SGMY will participate in four group-based sessions (1.5 hours each). In session 1, the SGMY will use rose-thorn-bud to individually document their ideas about healthy and unhealthy relationship characteristics and then use affinity clustering as a group to categorize their self-reported ideas based on similarities and differences. In session 2, the SGMY will use rose-thorn-bud to individually critique a universal evidence-based intervention to reduce ARA and affinity clustering to aggregate their ideas as a group. In session 3, the SGMY will use a creative matrix to generate intervention ideas for reducing ARA among them and force-rank the intervention ideas based on their potential ease of implementation and potential impact using an importance-difficulty matrix. In session 4, the SGMY will generate and refine intervention concepts (from session 3 ideations) to reduce ARA using round robin (for rapid iteration) and concept poster (for fleshing out ideas more fully). We will use content analyses to document the intervention concepts. In a follow-up survey, the SGMY will complete validated measures about the feasibility, acceptability, and appropriateness of the web-based human-centered design methods (a priori benchmarks for success: means >3.75 on each 5-point scale).

Results

This study was funded in February 2020. Data collection began in August 2020 and will be completed by April 2021.

Conclusions

Through rigorous testing of the feasibility of our web-based human-centered design methodology, our study may help demonstrate the use of human-centered design methods to engage harder-to-reach stakeholders and actively involve them in the co-creation of relevant interventions. Successful completion of this project also has the potential to catalyze intervention research to address ARA inequities for SGMY. Finally, our approach may be transferable to other populations and health topics, thereby advancing prevention science and health equity.

International Registered Report Identifier (IRRID)

DERR1-10.2196/26554

Patient decision aid based on multi-criteria decision analysis for disease-modifying drugs for multiple sclerosis: prototype development

Background

Since decision making about treatment with disease-modifying drugs (DMDs) for multiple sclerosis (MS) is preference sensitive, shared decision making between patient and healthcare professional should take place. Patient decision aids could support this shared decision making process by providing information about the disease and the treatment options, to elicit the patient’s preference and to support patients and healthcare professionals in discussing these preferences and matching them with a treatment. Therefore, a prototype of a patient decision aid for MS patients in the Netherlands—based on the principles of multi-criteria decision analysis (MCDA) —was developed, following the recommendations of the International Patient Decision Aid Standards. MCDA was chosen as it might reduce cognitive burden of considering treatment options and matching patient preferences with the treatment options.

Results

After determining the scope to include DMDs labelled for relapsing-remitting MS and clinically isolated syndrome, users’ informational needs were assessed using focus groups (N = 19 patients) and best-worst scaling surveys with patients (N = 185), neurologists and nurses (N = 60) to determine which information about DMDs should be included in the patient decision aid. Next, an online format and computer-based delivery of the patient decision aid was chosen to enable embedding of MCDA. A literature review was conducting to collect evidence on the effectiveness and burden of use of the DMDs. A prototype was developed next, and alpha testing to evaluate its comprehensibility and usability with in total thirteen patients and four healthcare professionals identified several issues regarding content and framing, methods for weighting importance of criteria in the MCDA structure, and the presentation of the conclusions of the patient decision aid ranking the treatment options according to the patient’s preferences. Adaptations were made accordingly, but verification of the rankings provided, validation of the patient decision aid, evaluation of the feasibility of implementation and assessing its value for supporting shared decision making should be addressed in further development of the patient decision aid.

Conclusion

This paper aimed to provide more transparency regarding the developmental process of an MCDA-based patient decision aid for treatment decisions for MS and the challenges faced during this process. Issues identified in the prototype were resolved as much as possible, though some issues remain. Further development is needed to overcome these issues before beta pilot testing with patients and healthcare professionals at the point of clinical decision-making can take place to ultimately enable making conclusions about the value of the MCDA-based patient decision aid for MS patients, healthcare professionals and the quality of care.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-021-01479-w.

An 11-Item Measure of User- and Human-Centered Design for Personal Health Tools (UCD-11): Development and Validation

BACKGROUND

Researchers developing personal health tools employ a range of approaches to involve prospective users in design and development.

OBJECTIVE

The aim of this paper was to develop a validated measure of the human- or user-centeredness of design and development processes for personal health tools.

METHODS

We conducted a psychometric analysis of data from a previous systematic review of the design and development processes of 348 personal health tools. Using a conceptual framework of user-centered design, our team of patients, caregivers, health professionals, tool developers, and researchers analyzed how specific practices in tool design and development might be combined and used as a measure. We prioritized variables according to their importance within the conceptual framework and validated the resultant measure using principal component analysis with Varimax rotation, classical item analysis, and confirmatory factor analysis.

RESULTS

We retained 11 items in a 3-factor structure explaining 68% of the variance in the data. The Cronbach alpha was .72. Confirmatory factor analysis supported our hypothesis of a latent construct of user-centeredness. Items were whether or not: (1) patient, family, caregiver, or surrogate users were involved in the steps that help tool developers understand users or (2) develop a prototype, (3) asked their opinions, (4) observed using the tool or (5) involved in steps intended to evaluate the tool, (6) the process had 3 or more iterative cycles, (7) changes between cycles were explicitly reported, (8) health professionals were asked their opinion and (9) consulted before the first prototype was developed or (10) between initial and final prototypes, and (11) a panel of other experts was involved.

CONCLUSIONS

The User-Centered Design 11-item measure (UCD-11) may be used to quantitatively document the user/human-centeredness of design and development processes of patient-centered tools. By building an evidence base about such processes, we can help ensure that tools are adapted to people who will use them, rather than requiring people to adapt to tools.

User Involvement in the Design and Development of Patient Decision Aids and Other Personal Health Tools: A Systematic Review

BACKGROUND

When designing and developing patient decision aids, guidelines recommend involving patients and stakeholders. There are myriad ways to do this. We aimed to describe how such involvement occurs by synthesizing reports of patient decision aid design and development within a user-centered design framework and to provide context by synthesizing reports of user-centered design applied to other personal health tools.

METHODS

We included articles describing at least one development step of 1) a patient decision aid, 2) user- or human-centered design of another personal health tool, or 3) evaluation of these. We organized data within a user-centered design framework comprising 3 elements in iterative cycles: understanding users, developing/refining prototype, and observing users.

RESULTS

We included 607 articles describing 325 patient decision aid projects and 65 other personal health tool projects. Fifty percent of patient decision aid projects reported involving users in at least 1 step for understanding users, 35% in at least 1 step for developing/refining the prototype, and 84% in at least 1 step for observing users' interaction with the prototype. In comparison, other personal health tool projects reported 91%, 49%, and 92%, respectively. A total of 74% of patient decision aid projects and 92% of other personal health tool projects reported iterative processes, both with a median of 3 iterative cycles. Preliminary evaluations such as usability or feasibility testing were reported in 66% of patient decision aid projects and 89% of other personal health tool projects.

CONCLUSIONS

By synthesizing design and development practices, we offer evidence-based portraits of user involvement. Those wishing to further align patient decision aid design and development with user-centered design methods could involve users earlier, design and develop iteratively, and report processes in greater detail.

Opportunities for Interventions That Address Socioeconomic Barriers to Type 2 Diabetes Management: Patient Perspectives

PURPOSE

The purpose of the study was to explore patient perspectives on socioeconomic barriers related to diabetes self-management and interventions to address these barriers.

METHODS

Focus groups (n = 8) were conducted with a diverse sample of adults with type 2 diabetes (T2D; n = 53). Researchers used a semistructured moderator guide; focus groups were audio recorded and transcribed verbatim. Researchers employed the constant comparison method for qualitative content analysis and utilized Atlas.ti (Version 8.1.1) to digitalize the analytic process.

RESULTS

Findings revealed 3 primary themes: (1) Existing food and nutrition resources are insufficient to support healthy eating for diabetes; (2) healthy eating is critical for diabetes management, but socioeconomic circumstances make doing so challenging; and (3) participants supported several broad categories of preferred intervention strategies. First, they endorsed lifestyle intervention informed by socioeconomic status (SES; eg, focusing on food resource management, sensitive health coaching and nutritional counseling). Next, they expressed enthusiasm for group-based learning opportunities, such as cooking classes and support groups with similar SES peers. Finally, they suggested healthy food access resources.

CONCLUSIONS

Participant suggestions should be incorporated into intervention development. Ultimately, these interventional strategies should be tested and refined to help improve health for individuals with type 2 diabetes.

User-centered and theory-based design of a professional training program on shared decision-making with older adults living with neurocognitive disorders: a mixed-methods study

BACKGROUND

We know little about the best approaches to design training for healthcare professionals. We thus studied how user-centered and theory-based design contribute to the development of a distance learning program for professionals, to increase their shared decision-making (SDM) with older adults living with neurocognitive disorders and their caregivers.

METHODS

In this mixed-methods study, healthcare professionals who worked in family medicine clinics and homecare services evaluated a training program in a user-centered approach with several iterative phases of quantitative and qualitative evaluation, each followed by modifications. The program comprised an e-learning activity and five evidence summaries. A subsample assessed the e-learning activity during semi-structured think-aloud sessions. A second subsample assessed the evidence summaries they received by email. All participants completed a theory-based questionnaire to assess their intention to adopt SDM. Descriptive statistical analyses and qualitative thematic analyses were integrated at each round to prioritize training improvements with regard to the determinants most likely to influence participants' intention.

RESULTS

Of 106 participants, 98 completed their evaluations of either the e-learning activity or evidence summary (93%). The professions most represented were physicians (60%) and nurses (15%). Professionals valued the e-learning component to gain knowledge on the theory and practice of SDM, and the evidence summaries to apply the knowledge gained through the e-learning activity to diverse clinical contexts. The iterative design process allowed addressing most weaknesses reported. Participants' intentions to adopt SDM and to use the summaries were high at baseline and remained positive as the rounds progressed. Attitude and social influence significantly influenced participants' intention to use the evidence summaries (P < 0.0001). Despite strong intention and the tailoring of tools to users, certain factors external to the training program can still influence the effective use of these tools and the adoption of SDM in practice.

CONCLUSIONS

A theory-based and user-centered design approach for continuing professional development interventions on SDM with older adults living with neurocognitive disorders and their caregivers appeared useful to identify the most important determinants of learners' intentions to use SDM in their practice, and validate our initial interpretations of learners' assessments during the subsequent evaluation round.

Feasibility of Rapidly Developing and Widely Disseminating Patient Decision Aids to Respond to Urgent Decisional Needs due to the COVID-19 Pandemic

To meet urgent decisional needs of retirement/nursing home residents and their families, our interdisciplinary stakeholder team rapidly developed and disseminated patient decision aids (PtDAs) regarding leaving one's residence during the COVID-19 pandemic. The development steps were as follows: identify urgent decisional needs, develop PtDAs using the Ottawa Decision Support Framework template and minimal International PtDA Standards, obtain stakeholder feedback, broadly disseminate, and incorporate user feedback. Within 2 wk, we developed 2 PtDAs for retirement and nursing home living environments that were informed by decisional needs (identified from public responses to related media reports), current pandemic regulations/guidance, and recent systematic reviews. Within 3 wk of their dissemination (websites, international PtDA inventory, Twitter, Facebook, media interviews), the PtDAs were downloaded 10,000 times, and user feedback was positive. Our expert team showed feasible rapid development and wide dissemination of PtDAs to respond to urgent decisional needs. Development efficiencies included access to a well-tested theory-based PtDA template, recent evidence syntheses, and values-based public responses to media reports. Future research includes methods for rapidly collecting user feedback, facilitating implementation, and measuring use and outcomes.

An actionable needs assessment for adolescents and young adults with cancer: the AYA Needs Assessment & Service Bridge (NA-SB)

PURPOSE

In the USA, many of the nearly 90,000 adolescents and young adults (AYAs) diagnosed with cancer each year do not receive services to address the full scope of needs they experience during and after cancer treatment. To facilitate a systematic and patient-centered approach to delivering services to address the unmet needs of AYAs with cancer, we developed the AYA Needs Assessment & Service Bridge (NA-SB).

METHODS

To develop NA-SB, we leveraged user-centered design, an iterative process for intervention development based on prospective user (i.e., provider and AYA) engagement. Specifically, we conducted usability testing and concept mapping to refine an existing tool-the Cancer Needs Questionnaire-Young People-to promote its usability and usefulness in routine cancer practice.

RESULTS

Our user-centered design process yielded a need assessment which assesses AYAs' physical, psychosocial, and practical needs. Importantly, needs in the assessment are grouped by services expected to address them, creating an intuitive and actionable link between needs and services.

CONCLUSION

NA-SB has the potential to improve care coordination at the individual level by allowing cancer care programs to tailor service delivery and resource provision to the individual needs of AYAs they serve.

Technology to Improve Autonomy and Inform Housing Decisions for Older Adults With Memory Problems Who Live at Home in Canada, Sweden, and the Netherlands: Protocol for a Multipronged Mixed Methods Study

BACKGROUND

Understanding the mobility patterns and experiences of older adults with memory problems living at home has the potential to improve autonomy and inform shared decision making (SDM) about their housing options.

OBJECTIVE

We aim to (1) assess the mobility patterns and experiences of older adults with memory problems, (2) co-design an electronic decision support intervention (e-DSI) that integrates users' mobility patterns and experiences, (3) explore their intention to use an e-DSI to support autonomy at home, and (4) inform future SDM processes about housing options.

METHODS

Informed by the Good Reporting of A Mixed Methods Study (GRAMMS) reporting guidelines, we will conduct a 3-year, multipronged mixed methods study in Canada, Sweden, and the Netherlands. For Phase 1, we will recruit a convenience sample of 20 older adults living at home with memory problems from clinical and community settings in each country, for a total of 60 participants. We will ask participants to record their mobility patterns outside their home for 14 days using a GPS tracker and a travel diary; in addition, we will conduct a walking interview and a final debrief interview after 14 days. For Phase 2, referring to results from the first phase, we will conduct one user-centered co-design process per country with older adults with memory issues, caregivers, health care professionals, and information technology representatives informed by the Double Diamond method. We will ask participants how personalized information about mobility patterns and experiences could be added to an existing e-DSI and how this information could inform SDM about housing options. For Phase 3, using online web-based surveys, we will invite 210 older adults with memory problems and/or their caregivers, split equally across the three countries, to use the e-DSI and provide feedback on its strengths and limitations. Finally, in Phase 4, we will triangulate and compare data from all phases and countries to inform a stakeholder meeting where an action plan will be developed.

RESULTS

The study opened for recruitment in the Netherlands in November 2018 and in Canada and Sweden in December 2019. Data collection will be completed by April 2021.

CONCLUSIONS

This project will explore how e-DSIs can integrate the mobility patterns and mobility experiences of older adults with memory problems in three countries, improve older adults' autonomy, and, ultimately, inform SDM about housing options.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04267484; https://clinicaltrials.gov/ct2/show/NCT04267484.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/19244.

A New Method for Structured Integration of User Needs in Two Health Technology Development Projects: Action Sheets

An early integration of users and stakeholders is needed for a successful innovation process. Nonetheless, the integration of users is often hard to realize - especially when dealing with persons with chronic diseases. In addition, patients or users in general often are not able to formulate the requirements in a technical manner. Therefore, even if user requirements are collected, it is not certain that the developers know or understand 'what is really wanted'. To overcome these 'gaps', we have developed so-called Action Sheets (AS). This article presents the use of AS in two projects: the development of health technologies for people with cancer (INFOPAT) and dementia (QuartrBack). Depending on the project context, group sessions were conducted with different stakeholders to identify the needs of (potential) users. Within the INFOPAT project, ten focus groups were conducted with patients, physicians and other healthcare professionals. In QuartrBack stakeholders like e.g. care professionals, technical assistance organizations and citizens participated in two focus groups and three world cafés. Their requirements were then 'fed' into the technology development by the use of AS. AS appear to be a promising tool to make user needs based on social values more tangible and implementable into technology development processes. In addition, it shows up that four phases seem to be necessary for transferring identified user and stakeholder needs into AS, which can therefore be seen as essential to translate non-technically formulated requirements into technically feasible ones. The case study shows as lessons learned that despite the successful integration of user needs, context-sensitive adjustments are still necessary.

A Web Application About Herd Immunity Using Personalized Avatars: Development Study

BACKGROUND

Herd immunity or community immunity refers to the reduced risk of infection among susceptible individuals in a population through the presence and proximity of immune individuals. Recent studies suggest that improving the understanding of community immunity may increase intentions to get vaccinated.

OBJECTIVE

This study aims to design a web application about community immunity and optimize it based on users' cognitive and emotional responses.

METHODS

Our multidisciplinary team developed a web application about community immunity to communicate epidemiological evidence in a personalized way. In our application, people build their own community by creating an avatar representing themselves and 8 other avatars representing people around them, for example, their family or coworkers. The application integrates these avatars in a 2-min visualization showing how different parameters (eg, vaccine coverage, and contact within communities) influence community immunity. We predefined communication goals, created prototype visualizations, and tested four iterative versions of our visualization in a university-based human-computer interaction laboratory and community-based settings (a cafeteria, two shopping malls, and a public library). Data included psychophysiological measures (eye tracking, galvanic skin response, facial emotion recognition, and electroencephalogram) to assess participants' cognitive and affective responses to the visualization and verbal feedback to assess their interpretations of the visualization's content and messaging.

RESULTS

Among 110 participants across all four cycles, 68 (61.8%) were women and 38 (34.5%) were men (4/110, 3.6%; not reported), with a mean age of 38 (SD 17) years. More than half (65/110, 59.0%) of participants reported having a university-level education. Iterative changes across the cycles included adding the ability for users to create their own avatars, specific signals about who was represented by the different avatars, using color and movement to indicate protection or lack of protection from infectious disease, and changes to terminology to ensure clarity for people with varying educational backgrounds. Overall, we observed 3 generalizable findings. First, visualization does indeed appear to be a promising medium for conveying what community immunity is and how it works. Second, by involving multiple users in an iterative design process, it is possible to create a short and simple visualization that clearly conveys a complex topic. Finally, evaluating users' emotional responses during the design process, in addition to their cognitive responses, offers insights that help inform the final design of an intervention.

CONCLUSIONS

Visualization with personalized avatars may help people understand their individual roles in population health. Our app showed promise as a method of communicating the relationship between individual behavior and community health. The next steps will include assessing the effects of the application on risk perception, knowledge, and vaccination intentions in a randomized controlled trial. This study offers a potential road map for designing health communication materials for complex topics such as community immunity.

High Users of Healthcare Services: Development and Alpha Testing of a Patient Decision Aid for Case Management

BACKGROUND

Some patients with complex healthcare needs become high users of healthcare services. Case management allows these patients and their interprofessional team to work together to evaluate their needs, priorities and available resources. High-user patients must make an informed decision when choosing whether to engage in case management and currently there is no tool to support them.

OBJECTIVE

The objective of this study was to develop and conduct a pilot alpha testing of a patient decision aid that supports high-user patients with complex needs and the teams who guide those patients in shared decision making when engaging in case management.

METHODS

We chose a user-centered design to co-develop a patient decision aid with stakeholders informed by the Ottawa Research Institute and International Patient Decision Aid Standards frameworks. Perceptions and preferences for the patient decision aid's content and format were assessed with patients and clinicians and were iteratively collected through interviews and focus groups. We developed a prototype and assessed its acceptability by using a think-aloud method and a questionnaire with three patient-partners, six clinicians and seven high-user patients with complex needs.

RESULTS

The three rounds of evaluation to assess the decision aid's acceptability highlighted comments related to simplicity, readability and visual aspect. A section presenting clinical vignettes including story telling was identified as the most helpful.

CONCLUSIONS

We created and evaluated a patient decision aid. Considering the positive comments, we believe that this aid has the potential to help high-user patients with complex care needs make better choices concerning case management.

Improving patient-provider communication about chronic pain: development and feasibility testing of a shared decision-making tool

Background

Chronic pain has emerged as a disease in itself, affecting a growing number of people. Effective patient-provider communication is central to good pain management because pain can only be understood from the patient’s perspective. We aimed to develop a user-centered tool to improve patient-provider communication about chronic pain and assess its feasibility in real-world settings in preparation for further evaluation and distribution.

Methods

To identify and prioritize patient treatment goals for chronic pain, strategies to improve patient-provider communication about chronic pain, and facilitate implementation of the tool, we conducted nominal group technique meetings and card sorting with patients with chronic pain and experienced providers (n = 12). These findings informed the design of the PainAPP tool. Usability and beta-testing with patients (n = 38) and their providers refined the tool and assessed its feasibility, acceptability, and preliminary impact.

Results

Formative work revealed that patients felt neither respected nor trusted by their providers and focused on transforming providers’ negative attitudes towards them, whereas providers focused on gathering patient information. PainAPP incorporated areas prioritized by patients and providers: assessing patient treatment goals and preferences, functional abilities and pain, and providing patients tailored education and an overall summary that patients can share with providers.

Beta-testing involved 38 patients and their providers. Half of PainAPP users shared their summaries with their providers. Patients rated PainAPP highly in all areas. All users would recommend it to others with chronic pain; nearly all trusted the information and said it helped them think about my treatment goals (94%), understand my chronic pain (82%), make the most of my next doctor’s visit (82%), and not want to use opioids (73%). Beta-testing revealed challenges delivering the tool and summary report to patients and providers in a timely manner and obtaining provider feedback.

Conclusions

PainAPP appears feasible for use, but further adaptation and testing is needed to assess its impact on patients and providers.

Trial registration

This study was approved by the University of New England Independent Review Board for the Protection of Human Subjects in Research (012616–019) and was registered with ClinicalTrials.gov (protocol ID: NCT03425266) prior to enrollment. The trial was prospectively registered and was approved on February 7, 2018.

From multisource data to clinical decision aids in radiation oncology: The need for a clinical data science community

Big data are no longer an obstacle; now, by using artificial intelligence (AI), previously undiscovered knowledge can be found in massive data collections. The radiation oncology clinic daily produces a large amount of multisource data and metadata during its routine clinical and research activities. These data involve multiple stakeholders and users. Because of a lack of interoperability, most of these data remain unused, and powerful insights that could improve patient care are lost. Changing the paradigm by introducing powerful AI analytics and a common vision for empowering big data in radiation oncology is imperative. However, this can only be achieved by creating a clinical data science community in radiation oncology. In this work, we present why such a community is needed to translate multisource data into clinical decision aids.

MyPath to Home Web-Based Application for the Geriatric Rehabilitation Program at Bruyère Continuing Care: User-Centered Design and Feasibility Testing Study

Background

When older adults return home from geriatric rehabilitation in a hospital, remembering the plethora of medical advice and medical instructions provided can be overwhelming for them and for their caregivers.

Objective

The overall objective was to develop and test the feasibility of a novel web-based application called MyPath to Home that can be used to manage the personalized needs of geriatric rehabilitation patients during their transition from the hospital to home.

Methods

This study involved (1) co-designing a patient- and clinician-tailored web-based application and (2) testing the feasibility of the application to manage the needs of geriatric rehabilitation patients when leaving the hospital. In phase 1, we followed a user-centered design process integrated with the modern agile software development methodology to iteratively co-design the application. The approach consisted of three cycles in which we engaged patients, caregivers, and clinicians to design a series of prototypes (cycles 1-3). In phase 2, we conducted a single-arm feasibility pilot test of MyPath to Home. Baseline and follow-up surveys, as well as select semistructured interviews were conducted.

Results

In phase 1, semistructured interviews and talk-aloud sessions were conducted with patients/caregivers (n=5) and clinicians (n=17) to design the application. In phase 2, patients (n=30), caregivers (n=18), and clinicians (n=20) received access to use the application. Patients and their caregivers were asked to complete baseline and follow-up surveys. A total of 91% (21/23) of patients would recommend this application to other patients. In addition, clinicians (n=6) and patients/caregivers (n=6) were interviewed to obtain further details on the value of the web-based application with respect to engaging patients and facilitating communication and sharing of information with the health care team.

Conclusions

We were successful at designing the MyPath to Home prototype for patients and their caregivers to engage with their clinicians during the transition from geriatric rehabilitation to home. Further work is needed to increase the uptake and usage by clinicians, and determine if this translates to meaningful changes in clinical and functional outcomes.

International Registered Report Identifier (IRRID)

RR2-10.2196/11031

Understanding shared decision-making experience among vulnerable population: Focus group with food bank clients

INTRODUCTION

Shared decision-making (SDM) is a critical component of delivering patient-centered care. Members of vulnerable populations may play a passive role in clinical decision-making; therefore, understanding their prior decision-making experiences is a key step to engaging them in SDM.

OBJECTIVE

To understand the previous healthcare experiences and current expectations of vulnerable populations on clinical decision-making regarding therapeutic options.

METHODS

Clients of a local food bank were recruited to participate in focus groups. Participants were asked to share prior health decision experiences, explain difficulties they faced when making a therapeutic decision, describe features of previous satisfactory decision-making processes, share factors under consideration when choosing between treatment options, and suggest tools that would help them to communicate with healthcare providers. We used the inductive content analysis to interpret data gathered from the focus groups.

RESULTS

Twenty-six food bank clients participated in four focus groups. All participants lived in areas of socioeconomic disadvantage. Four themes emerged: prior negative clinical decision-making experience with providers, patients preparing to engage in SDM, challenges encountered during the decision-making process, and patients' expectations of decision aids. Participants also reported they were unable to discuss therapeutic options at the time of decision-making. They also expressed financial concerns and the need for sufficiently detailed information to evaluate risks.

CONCLUSION

Our findings suggest the necessity of developing decision aids that would improve the engagement of vulnerable populations in the SDM process, including consideration of affordability, use of patient-friendly language, and incorporation of drug-drug and drug-food interactions information.