Participatory Methods to Engage Health Service Users in the Development of Electronic Health Resources: Systematic Review

Involvement of children and young people in the conduct of health research: A rapid umbrella review

BACKGROUND

Patient and public involvement and engagement (PPIE) have long been considered important to good research practice. There is growing, yet diverse, evidence in support of PPIE with children and young people (CYP). We must now understand the various approaches to involvement of CYP in research.

AIMS

This rapid umbrella review aimed to provide an overview of when, how and to what extent CYP are involved in the conduct of health research, as well as the reported benefits, challenges, and facilitators of involvement.

METHODS

We searched OVID Medline, Embase and PubMed. Published reviews were included if they reported meaningful involvement of CYP in the conduct of health research. Extracted data were synthesised using thematic analysis.

RESULTS

The 26 reviews included were predominately systematic and scoping reviews, published within the last decade, and originating from North America and the United Kingdom. CYPs were involved in all stages of research across the literature, most commonly during research design and data collection, and rarely during research funding or data sharing and access. Researchers mostly engaged CYP using focus groups, interviews, advisory panels, questionnaires, and to a lesser extent arts-based approaches such as photovoice and drawing. Visual and active creative methods were more commonly used with children ≤12 years. The evidence showed a shared understanding of the benefits, challenges, and facilitators for involvement of CYP, such as time and resource commitment and building partnership.

CONCLUSION

Overall, the review identified consistency in the range of methods and approaches used, and stages of research with which CYP are commonly involved. There is a need for more consistent reporting of PPIE in the literature, both in terminology and detail used. Furthermore, the impact of approaches to CYP involvement on research and community outcomes must be better evaluated.

PATIENT/PUBLIC CONTRIBUTION

This review forms part of broader research initiatives being led by the authors. Together, these projects aim to support embedding of child voices in research practice and to explore the desirability and suitability of Young Persons Advisory Groups within birth cohort studies. The findings from this review, alongside public and stakeholder consultation, will inform development of resources such as practice recommendations to guide future involvement of CYP in health research undertaken at the author's respective institutions.

What Enables Child Sexual Abuse in Sport? A Systematic Review

Sporting environments provide opportunities for perpetrators to commit child sexual abuse (CSA). While awareness of CSA in sport and preventative interventions are increasing, CSA in sport still occurs at alarming rates. A systematic review was conducted to identify and synthesize the extant literature on the enabling factors for CSA in sport. The 34 included articles were peer-reviewed and were primary sources; had full-text versions in English; included the individual, situational, environmental, or systemic antecedent factors and characteristics which enable CSA in organized sport (clubs, schools, universities, and representative teams); and focused on abuse in children (0-18 years old), and included retrospective incidents. The enabling factors from across the broader sports system were identified and mapped using a systems thinking-based approach, the Risk Management Framework (RMF) and the associated AcciMap method. The results indicated that enabling factors for CSA in sport were identified at multiple levels of the sporting system hierarchy. The results show that 24.1% (n = 46) of the enabling factors identified in the literature relate to the hierarchical level of the Athlete, teammates, opponents, and fans levels, and 52.9% (n = 101) of the enabling factors relate to the level of Direct supervisors, management, medical, and performance personnel level. However, only 13% (n = 25) of enabling factors to CSA in sport were identified at the combined top four hierarchical levels. Results indicate that the problem of CSA in sport is a systems issue, and future research is required to explore how these factors interact to enable CSA in sport.

Artificial intelligence-driven virtual rehabilitation for people living in the community: A scoping review

Virtual Rehabilitation (VRehab) is a promising approach to improving the physical and mental functioning of patients living in the community. The use of VRehab technology results in the generation of multi-modal datasets collected through various devices. This presents opportunities for the development of Artificial Intelligence (AI) techniques in VRehab, namely the measurement, detection, and prediction of various patients' health outcomes. The objective of this scoping review was to explore the applications and effectiveness of incorporating AI into home-based VRehab programs. PubMed/MEDLINE, Embase, IEEE Xplore, Web of Science databases, and Google Scholar were searched from inception until June 2023 for studies that applied AI for the delivery of VRehab programs to the homes of adult patients. After screening 2172 unique titles and abstracts and 51 full-text studies, 13 studies were included in the review. A variety of AI algorithms were applied to analyze data collected from various sensors and make inferences about patients' health outcomes, most involving evaluating patients' exercise quality and providing feedback to patients. The AI algorithms used in the studies were mostly fuzzy rule-based methods, template matching, and deep neural networks. Despite the growing body of literature on the use of AI in VRehab, very few studies have examined its use in patients' homes. Current research suggests that integrating AI with home-based VRehab can lead to improved rehabilitation outcomes for patients. However, further research is required to fully assess the effectiveness of various forms of AI-driven home-based VRehab, taking into account its unique challenges and using standardized metrics.

Fertility education: recommendations for developing and implementing tools to improve fertility literacy†

Many recent societal trends have led to the need for fertility education, including the age at which individuals become parents, the development of new reproductive technologies, and family diversity. Fertility awareness has emerged as a concept very recently and is increasingly gaining recognition. However, fertility education is often neglected as there is no consensus on the appropriate content, target populations, or on who should provide it. This article attempts to provide an overview of the use of interventions to improve fertility education. We emphasize the importance of delivering evidence-based information on fertility and reproductive health through various methods while providing guidelines for their standardization and systematization. Recommendations are provided to aid the development and implementation of fertility education tools, including: the establishment of a comprehensive understanding of the target populations; the incorporation of theories of behavioural change; the inclusion of the users' perspectives and the use of participatory research; and the use of specific guidelines for increasing engagement. By following these recommendations, it is expected that fertility education resources can contribute to improving fertility literacy, empowering individuals and couples to make informed reproductive decisions, and ultimately reducing the incidence of infertility and need for fertility treatment.

The Evaluation of the Suitability, Quality, and Readability of Publicly Available Online Resources for the Self-Management of Fear of Cancer Recurrence

Cancer survivors often rely on the internet for health information, which has varying levels of readability, suitability, and quality. There is a need for high-quality online self-management resources for cancer survivors with fear of cancer recurrence (FCR). This study evaluated the readability, suitability, and quality of publicly available online FCR self-management resources. A Google search using FCR-related keywords identified freely available FCR self-management resources for cancer survivors in English. Resource readability (reading grade level), suitability, and quality were evaluated using relevant assessment tools. Descriptive statistics and cluster analysis identified resources with higher suitability and quality scores. Mean resource (n = 23) readability score was grade 11 (SD = 1.6, Range = 9-14). The mean suitability score was 56.0% (SD = 11.4%, Range = 31.0-76.3%), indicating average suitability and the mean quality score was 53% (SD = 11.7%, Range = 27-80%), indicating fair quality. A cluster of 15 (65%) resources with higher suitability and quality scores was identified. There were no significant associations between suitability or quality scores and the type of organisation that published the resources. Online FCR self-management resources varied in readability, suitability and quality. Resources with higher quality and suitability scores relative to other resources are identified for use by healthcare professionals and cancer survivors. Resources that are more culturally appropriate, with lower reading grade levels and detailed self-management strategies are needed.

[Participatory Design of Health Technologies - Challenges and Requirements for Action from the Perspective of Health Services Research]

The use of participatory design (PD) provides a framework for involving users in the process of developing healthcare technologies. Within PD, theoretical and methodological decisions need to be made. However, these decisions are often not adequately described or justified. This can lead to limited interpretability of the results. This paper has three objectives: First, to provide an overview of the key theoretical and methodological decisions that must be made in PD from the perspective of health services research; second, to describe the associated challenges and third, to describe action requirements for the future development of PD in health services research.

Association Between the Characteristics of mHealth Apps and User Input During Development and Testing: Secondary Analysis of App Assessment Data

BACKGROUND

User involvement is increasingly acknowledged as a central part of health care innovation. However, meaningful user involvement during the development and testing of mobile health apps is often not fully realized.

OBJECTIVE

This study aims to examine in which areas user input is most prevalent and whether there is an association between user inclusion and compliance with best practices for mobile health apps.

METHODS

A secondary analysis was conducted on an assessment data set of 1595 health apps. The data set contained information on whether the apps had been developed or tested with user input and whether they followed best practices across several domains. Background information was also available regarding the apps' country of origin, targeted condition areas, subjective user ratings, download numbers, and risk (as per the National Institute for Health and Care Excellence Evidence Standards Framework [ESF]). Descriptive statistics, Mann-Whitney U tests, and Pearson chi-square analyses were applied to the data.

RESULTS

User involvement was reported by 8.71% (139/1595) of apps for only the development phase, by 33.67% (537/1595) of apps for only the testing phase, by 21.88% (349/1595) of apps for both phases, and by 35.74% (570/1595) of apps for neither phase. The highest percentage of health apps with reported user input during development was observed in Denmark (19/24, 79%); in the condition areas of diabetes (38/79, 48%), cardiology (15/32, 47%), pain management (20/43, 47%), and oncology (25/54, 46%); and for high app risk (ESF tier 3a; 105/263, 39.9%). The highest percentage of health apps with reported user input during testing was observed in Belgium (10/11, 91%), Sweden (29/34, 85%), and France (13/16, 81%); in the condition areas of neurodiversity (42/52, 81%), respiratory health (58/76, 76%), cardiology (23/32, 72%), and diabetes (56/79, 71%); and for high app risk (ESF tier 3a; 176/263, 66.9%). Notably, apps that reported seeking user input during testing demonstrated significantly more downloads than those that did not (P=.008), and user inclusion was associated with better compliance with best practices in clinical assurance, data privacy, risk management, and user experience.

CONCLUSIONS

The countries and condition areas in which the highest percentage of health apps with user involvement were observed tended to be those with higher digital maturity in health care and more funding availability, respectively. This suggests that there may be a trade-off between developers' willingness or ability to involve users and the need to meet challenges arising from infrastructure limitations and financial constraints. Moreover, the finding of a positive association between user inclusion and compliance with best practices indicates that, where no other guidance is available, users may benefit from prioritizing health apps developed with user input as the latter may be a proxy for broader app quality.

Maximizing the value of patient and public involvement in the digital health co-design process: A qualitative descriptive study with design leaders and patient-public partners

Digital health interventions have enormous potential to support patients and the public in achieving their health goals. Nonetheless, many digital health interventions are failing to effectively engage patients and the public. One solution that has been proposed is to directly involve patients and the public in the design process of these digital health interventions. Although there is consensus that involving patients and the public in collaborative design is valuable, design teams have little guidance on how to maximize the value of their collaborative design work. The main objective of this study was to understand how the value of patient and public involvement in digital health design can be maximized, from the perspective of design leaders and patient-public partners. Using a qualitative descriptive methodology, we conducted semi-structured interviews with 19 design leaders and 9 patient-public partners. Interviewees agreed that involving patients and the public was valuable, however, they questioned if current collaborative methods were optimized to ensure maximal value. Interviewees suggested that patient and public collaborative design can add value through four different mechanisms: (1) by allowing the design process to be an empowering intervention itself, (2) by ensuring that the digital health intervention will be effectively engaging for users, (3) by ensuring that the digital health intervention will be seamlessly implemented in practice, and (4) by allowing patient-public collaborations extend beyond the initial product design. Overall, interviewees emphasized that although collaborative design has historically focused on improving the digital health product itself, patients and the public have crucial insights on implementation planning as well as how collaborative design can be used as its own empowering intervention. The results of this paper provide clarity about the ways that patient and public collaborative design can be made more valuable. Digital health design teams can use these results to be more intentional about their collaborative design approaches.

Design and development of an eHealth intervention to support self-management in people with musculoskeletal disorders - 'eHealth: It's TIME': a study protocol

Background: Musculoskeletal disorders (MSDs) are a leading cause of global morbidity, with the burden expected to increase in the near future. Self-management, with the support of healthcare professionals, is recommended for many MSDs. However, frequent clinical contact is not feasible. Previous research has highlighted the need for a co-designed eHealth-mediated self-management follow-up support intervention which integrates remote monitoring and behavioural change. Thus, the current study aims to develop and design a user-centred, eHealth-mediated self-management support prototype for people with MSDs. Methods: A three-step, iterative system development cycle will be utilised to develop and design the "eHealth: It's TIME prototype". The three-step process will include creating website features and content using two sequential focus groups with people with MSDs (n = 6 - 8); heuristic testing using the 10 heuristic principles of Nielsen (n = 5); and usability testing through in-person 60-minute interviews with people with MSDs (n = 3 - 5) and musculoskeletal physiotherapists (n = 3 - 5). Conclusion: The eHealth: It's TIME prototype will be a systematically developed, follow-up self-management support intervention guided by behavioural change theory and the preferences of end users.

Toward Inclusive Approaches in the Design, Development, and Implementation of eHealth in the Intellectual Disability Sector: Scoping Review

BACKGROUND

The use of eHealth is more challenging for people with intellectual disabilities (IDs) than for the general population because the technologies often do not fit the complex needs and living circumstances of people with IDs. A translational gap exists between the developed technology and users' needs and capabilities. User involvement approaches have been developed to overcome this mismatch during the design, development, and implementation processes of the technology. The effectiveness and use of eHealth have received much scholarly attention, but little is known about user involvement approaches.

OBJECTIVE

In this scoping review, we aimed to identify the inclusive approaches currently used for the design, development, and implementation of eHealth for people with IDs. We reviewed how and in what phases people with IDs and other stakeholders were included in these processes. We used 9 domains identified from the Centre for eHealth Research and Disease management road map and the Nonadoption, Abandonment, and challenges to the Scale-up, Spread, and Sustainability framework to gain insight into these processes.

METHODS

We identified both scientific and gray literature through systematic searches in PubMed, Embase, PsycINFO, CINAHL, Cochrane, Web of Science, Google Scholar, and (websites of) relevant intermediate (health care) organizations. We included studies published since 1995 that showed the design, development, or implementation processes of eHealth for people with IDs. Data were analyzed along 9 domains: participatory development, iterative process, value specification, value proposition, technological development and design, organization, external context, implementation, and evaluation.

RESULTS

The search strategy resulted in 10,639 studies, of which 17 (0.16%) met the inclusion criteria. Various approaches were used to guide user involvement (eg, human or user-centered design and participatory development), most of which applied an iterative process mainly during technological development. The involvement of stakeholders other than end users was described in less detail. The literature focused on the application of eHealth at an individual level and did not consider the organizational context. Inclusive approaches in the design and development phases were well described; however, the implementation phase remained underexposed.

CONCLUSIONS

The participatory development, iterative process, and technological development and design domains showed inclusive approaches applied at the start of and during the development, whereas only a few approaches involved end users and iterative processes at the end of the process and during implementation. The literature focused primarily on the individual use of the technology, and the external, organizational, and financial contextual preconditions received less attention. However, members of this target group rely on their (social) environment for care and support. More attention is needed for these underrepresented domains, and key stakeholders should be included further on in the process to reduce the translational gap that exists between the developed technologies and user needs, capabilities, and context.

Anticipated barriers and facilitators for implementing smart inhalers in asthma medication adherence management

Smart inhalers are electronic monitoring devices which are promising in increasing medication adherence and maintaining asthma control. A multi-stakeholder capacity and needs assessment is recommended prior to implementation in healthcare systems. This study aimed to explore perceptions of stakeholders and to identify anticipated facilitators and barriers associated with the implementation of smart digital inhalers in the Dutch healthcare system. Data were collected through focus group discussions with female patients with asthma (n = 9) and healthcare professionals (n = 7) and through individual semi-structured interviews with policy makers (n = 4) and smart inhaler developers (n = 4). Data were analysed using the Framework method. Five themes were identified: (i) perceived benefits, (ii) usability, (iii) feasibility, (iv) payment and reimbursement, and (v) data safety and ownership. In total, 14 barriers and 32 facilitators were found among all stakeholders. The results of this study could contribute to the design of a tailored implementation strategy for smart inhalers in daily practice.

Design and development of an eHealth intervention to support self-Management in people with musculoskeletal Disorders - ‘eHealth: It’s TIME’: a study protocol

Background: Musculoskeletal disorders (MSDs) are a leading cause of global morbidity, with the burden expected to increase in the near future. Self-management, with the support of healthcare professionals, is recommended for many MSDs. However, frequent clinical contact is not feasible. Previous research has highlighted the need for a co-designed eHealth-mediated self-management follow-up support intervention which integrates remote monitoring and behavioural change. Thus, the current study aims to develop and design a user-centred, eHealth-mediated self-management support prototype for people with MSDs. Methods: A three-step, iterative system development cycle will be utilised to develop and design the “eHealth: It’s TIME prototype”. The three-step process will include creating website features and content using two sequential focus groups with people with MSDs (n = 6 – 8); heuristic testing using the 10 heuristic principles of Nielsen (n = 5); and usability testing through in-person 60-minute interviews with people with MSDs (n = 3 – 5) and musculoskeletal physiotherapists (n = 3 – 5). Conclusion: The eHealth: It’s TIME prototype will be a systematically developed, follow-up self-management support intervention guided by behavioural change theory and the preferences of end users.

An Overview of Stakeholders, Methods, Topics, and Challenges in Participatory Approaches Used in the Development of Medical Devices: A Scoping Review

BACKGROUND

There is a wide variety of participatory approaches to involve stakeholders in the development of medical devices, but there is no comprehensive overview of these approaches. We therefore studied what participatory approaches are used in the development of medical devices as well as the most important characteristics and challenges of these approaches.

METHODS

We conducted a scoping review and searched PubMed, Embase and Web of Science for articles published between July 2014 and July 2019. Papers were included if they presented original research featuring any form of stakeholder participation in the development of medical devices. We used The Spectrum of Public Participation to categorise the approach of each paper. Subsequently, we described the characteristics of each approach: the stakeholders involved, data collection methods, and topics addressed. We also identified challenges of the approaches as reported by researchers.

RESULTS

277 papers were included, which could be categorised into three levels of participation: collaboration, involvement, and consultation. Patients and healthcare professionals are frequently engaged in all approaches. The most often used methods are workshops in the collaboration approach papers, and interviews in the involvement and consultation approach papers. Topics addressed in all approaches are: the problem, device requirements, design choices, testing, and procedural aspects of involvement. Reported challenges entail issues related to sampling, analysis, social dynamics, feasibility, and the limited number of topics that can be addressed.

CONCLUSION

Participatory approaches reported in literature can be categorised in three overarching approaches that have comparable methodological characteristics. This suggests that if researchers want to apply a participatory approach it is not necessary to adopt a pre-determined approach, such as 'participatory action research' (PAR). Instead, they can independently determine the degree of participation, stakeholders, methods, topics, and strategies to account for challenges, making sure the participatory approach fits their research question and context.

What Do Adolescents and Their Parents Need From Mental Health Integration in Primary Care? A Qualitative Exploration of Design Insights

INTRODUCTION

The design of integrated adolescent mental health care should address needs and preferences of patients and parents/guardians.

METHOD

We conducted interviews and focus groups with adolescents aged 13-17 years who received care at Kaiser Permanente Washington in 2020 and interviews with parents of such adolescents. We sought to (1) understand the challenges of primary care-based mental health and substance use screening and care for adolescents and (2) identify program design solutions. Sessions were audio-recorded, transcribed, and coded. Thematic analysis was applied to identify key challenges and design solutions.

RESULTS

Emerging themes from interviews (n = 41) and focus groups (n = 10) were summarized in five overarching design principles: Engagement, Privacy, Communication, Choice, and Ease. Each design principle was expanded for operationalization within a new health system program.

DISCUSSION

Health systems serving adolescents in primary care may consider application of these design principles to the development of mental health integration programs.

Evaluation of an Electronic Medical Record Module for Nursing Documentation in Paediatric Palliative Care: Involvement of Nurses with a Think-Aloud Approach

Background: Paediatric palliative care (PPC) is a noncurative approach to the care of children and adolescents with life-limiting and life-threatening illnesses. Electronic medical records (EMRs) play an important role in documenting such complex processes. Despite their benefits, they can introduce unintended consequences if future users are not involved in their development. Aim: The aim of this study was to evaluate the acceptance of a novel module for nursing documentation by nurses working in the context of PPC. Methods: An observational study employing concurrent think-aloud and semi-structured qualitative interviews were conducted with 11 nurses working in PPC. Based on the main determinants of the unified theory of acceptance and use of technology (UTAUT), data were analysed using qualitative content analysis. Results: The main determinants of UTAUT were found to potentially influence acceptance of the novel module. Participants perceived the module to be self-explanatory and intuitive. Some adaptations, such as the reduction of fragmentation in the display, the optimization of confusing mouseover fields, and the use of familiar nursing terminology, are reasonable ways of increasing software adoption. Conclusions: After adaptation of the modules based on the results, further evaluation with the participation of future users is required.

Determining Priorities in the Aboriginal and Islander Mental Health Initiative for Youth App Second Phase Participatory Design Project: Qualitative Study and Narrative Literature Review

Background

Digital mental health tools can promote access to culturally safe early intervention mental health services for Aboriginal and Torres Strait Islander young people. Participatory design methodology facilitates user engagement in the co-design of digital resources. However, several challenges have been identified that limit the methodological rigor of this approach.

Objective

This paper aims to present an in-depth account of the second phase of participatory design in the development of the Aboriginal and Islander Mental Health Initiative for Youth (AIMhi-Y) app.

Methods

A first idea storyboard, generated from a formative phase of the AIMhi-Y project, was refined through a series of youth co-design workshops and meetings. A narrative review of the literature, 6 service provider interviews, and engagement with an expert reference group also informed the design process. Generative design activities, storyboarding, discussions, and voting strategies were used.

Results

The participatory design process identified the app features preferred by young people and service providers and assessed their alignment with current recommendations from the scientific literature. Findings from the co-design process are presented across 9 app characteristic domains. Integration of findings into app design proved complex. Although most preferred features identified by young people were included to some degree, other inclusions were restricted by budget, time, and the need to integrate best practice recommendations. A process of prioritization was required.

Conclusions

Participatory design is often cited in the development of digital mental health resources; however, methods are diverse and often lack detailed descriptions. This study reports the outcomes and strategies used to determine priorities in the second phase of the development of the AIMhi-Y app. We provide an example and the key learnings to inform others seeking to use participatory design with a similar cohort.

Boundary Objects as Dialogical Learning Accelerators for Social Change in Design for Health: Systematic Review

Background

Boundary objects can add value for innovative design and implementation research in health care through their organizational focus and the dynamic structure between ill-structured and tailored use. However, when innovation is approached as a boundary object, more attention will need to be paid to the preimplementation phase. Research and design thinking pay attention to the preimplementation stage but do not have a social or organizational focus per se. The integration of boundary objects in design methodologies can provide a more social and organizational focus in innovative design projects by mapping out the mechanisms that occur at boundaries during design. Four dialogical learning mechanisms that can be triggered at boundaries have been described in the literature: identification, coordination, reflection, and transformation. These mechanisms seem suitable for integration in innovative design research on health.

Objective

Focusing on innovation in health, this study aims to find out whether the different learning mechanisms can be linked to studies on health innovation that mention boundary objects as a concept and assess whether the related mechanisms provide insight into the stage of the design and implementation or change process.

Methods

The following 6 databases were searched for relevant abstracts: PubMed, Scopus, Education Resources Information Center, PsycINFO, Information Science and Technology Abstracts, and Embase. These databases cover a wide range of published studies in the field of health.

Results

Our initial search yielded 3102 records; after removing the duplicates, 2186 (70.47%) records were screened on the title and abstract, and 25 (0.81%) papers were included; of the 13 papers where we identified 1 mechanism, 5 (38%) described an innovation or innovative project, and of the 12 papers where we identified more mechanisms, 9 (75%) described the development or implementation of an innovation. The reflective mechanism was not identified solely but was present in papers describing a more successful development or implementation project of innovation. In these papers, the predetermined goals were achieved, and the process of integration was relatively smoother.

Conclusions

The concept of boundary objects has found its way into health care. Although the idea of a boundary object was introduced to describe how specific artifacts can fulfill a bridging function between different sociocultural sites and thus have a social focus, the focus in the included papers was often on the boundary object itself rather than the social effect. The reflection and transformation mechanisms were underrepresented in the included studies but based on the findings in this review, pursuing to trigger the reflective mechanism in design, development, and implementation projects can lead to a more fluid and smooth integration of innovation into practice.

Best Practices and Lessons Learned for Action Research in eHealth Design and Implementation: Literature Review

BACKGROUND

Action research (AR) is an established research framework to introduce change in a community following a cyclical approach and involving stakeholders as coresearchers in the process. In recent years, it has also been used for eHealth development. However, little is known about the best practices and lessons learned from using AR for eHealth development.

OBJECTIVE

This literature review aims to provide more knowledge on the best practices and lessons learned from eHealth AR studies. Additionally, an overview of the context in which AR eHealth studies take place is given.

METHODS

A semisystematic review of 44 papers reporting on 40 different AR projects was conducted to identify the best practices and lessons learned in the research studies while accounting for the particular contextual setting and used AR approach.

RESULTS

Recommendations include paying attention to the training of stakeholders' academic skills, as well as the various roles and tasks of action researchers. The studies also highlight the need for constant reflection and accessible dissemination suiting the target group.

CONCLUSIONS

This literature review identified room for improvements regarding communicating and specifying the particular AR definition and applied approach.

Methods for Human-Centered eHealth Development: Narrative Scoping Review

Background

Thorough holistic development of eHealth can contribute to a good fit among the technology, its users, and the context. However, despite the availability of frameworks, not much is known about specific research activities for different aims, phases, and settings. This results in researchers having to reinvent the wheel. Consequently, there is a need to synthesize existing knowledge on research activities for participatory eHealth development processes.

Objective

The 3 main goals of this review are to create an overview of the development strategies used in studies based on the CeHRes (Center for eHealth Research) Roadmap, create an overview of the goals for which these methods can be used, and provide insight into the lessons learned about these methods.

Methods

We included eHealth development studies that were based on the phases and/or principles of the CeHRes Roadmap. This framework was selected because of its focus on participatory, iterative eHealth design in context and to limit the scope of this review. Data were extracted about the type of strategy used, rationale for using the strategy, research questions, and reported information on lessons learned. The most frequently mentioned lessons learned were summarized using a narrative, inductive approach.

Results

In the included 160 papers, a distinction was made between overarching development methods (n=10) and products (n=7). Methods are used to gather new data, whereas products can be used to synthesize previously collected data and support the collection of new data. The identified methods were focus groups, interviews, questionnaires, usability tests, literature studies, desk research, log data analyses, card sorting, Delphi studies, and experience sampling. The identified products were prototypes, requirements, stakeholder maps, values, behavior change strategies, personas, and business models. Examples of how these methods and products were applied in the development process and information about lessons learned were provided.

Conclusions

This study shows that there is a plethora of methods and products that can be used at different points in the development process and in different settings. To do justice to the complexity of eHealth development, it seems that multiple strategies should be combined. In addition, we found no evidence for an optimal single step-by-step approach to develop eHealth. Rather, researchers need to select the most suitable research methods for their research objectives, the context in which data are collected, and the characteristics of the participants. This study serves as a first step toward creating a toolkit to support researchers in applying the CeHRes Roadmap to practice. In this way, they can shape the most suitable and efficient eHealth development process.

Participatory Design of a Medication Module in an Electronic Medical Record for Paediatric Palliative Care: A Think-Aloud Approach with Nurses and Physicians

BACKGROUND

Electronic medical records (EMRs) play a key role in improving documentation and quality of care in paediatric palliative care (PPC). Inadequate EMR design can cause incorrect prescription and administration of medications. Due to the fact of complex diseases and the resulting high level of medical complexity, patients in PPC are vulnerable to medication errors. Consequently, involving users in the development process is important. Therefore, the aim of this study was to evaluate the acceptance of a medication module from the perspective of potential users in PPC and to involve them in the development process.

METHODS

A qualitative observational study was conducted with 10 nurses and four physicians using a concurrent think-aloud protocol and semi-structured qualitative interviews. A qualitative content analysis was applied based on a unified theory of acceptance and use of technology.

RESULTS

Requirements from the user's perspective could be identified as possible influences on acceptance and actual use. Requirements were grouped into the categories "performance expectancies" and "effort expectancies".

CONCLUSIONS

The results serve as a basis for further development. Attention should be given to the reduction of display fragmentation, as it decreases cognitive load. Further approaches to evaluation should be taken.

Researchers' Perspectives on Digital Mental Health Intervention Co-Design With Marginalized Community Stakeholder Youth and Families

Co-design of digital mental health technology with youth and families is a relatively new but growing approach to intervention development. In this perspective article, researchers used collaborative reflexivity through duoethnography methodology to reflect and report on experiences and lessons learned conducting co-designed projects with marginalized youth and families. Researchers engaged in written reflective dialogue regarding projects designed to co-develop technology-based apps and computer programs to support mental health of youth and their families. Reflections described the barriers and challenges for sharing responsibilities with stakeholders who have extensive lived experience but limited exposure to research. Researchers shared insights about their own intersectionality and positionality from marginalized to privileged, relative to co-design participants, and what it means to share authority, authentic partnership, and responsibility in the research process. Cultural understanding may diverge, even between acculturated minority researchers and matched minority stakeholders. While there are a variety of approaches that researchers might refer to as co-design, it is important to be intentional in the implementation of these processes so that collaborations with stakeholder youth and families are neither disingenuous nor exploitative. Implications for equitable and meaningful engagement of marginalized communities in co-design projects for youth mental health are discussed.

Development and Evaluation of the Canteen Connect Online Health Community: Using a Participatory Design Approach in Meeting the Needs of Young People Impacted by Cancer

Simple Summary

Adolescent and young adults (AYAs) impacted by their own or familial cancer require information and peer support throughout the cancer journey to help with their feelings of isolation. AYAs impacted by cancer need safe, secure, and accessible ways to connect with their peers and access information, peer, and professional support. Online Health Communities provide social networks, support, and health-related content to people united by a shared health experience. Canteen Connect (CC) was developed using a participatory design (PD) process, covering a needs assessment, idea generation, and implementation evaluation. The evaluation showed CC was appropriate for connecting with other AYAs. Most AYAs reported satisfaction with CC and a positive impact on their feelings of sadness, worry, and/or anxiety. By using a PD approach, CC fills an important service provision gap in providing an acceptable and appropriate online health community for AYAs impacted by cancer, with initial promising psychological outcomes.

Abstract

Adolescent and young adults (AYAs) impacted by their own or familial cancer require information and peer support throughout the cancer journey to ameliorate feelings of isolation. Online Health Communities (OHC) provide social networks, support, and health-related content to people united by a shared health experience. Using a participatory design (PD) process, Canteen developed Canteen Connect (CC), an OHC for AYAs impacted by cancer. This manuscript outlines the process used to develop CC: (1) A mixed-methods implementation evaluation of Version I of CC (CCv.1); (2) Qualitative workshops utilizing strengths-based approaches of PD and appreciative inquiry to inform the development of CC Version 2 (CCv.2); quantitative implementation evaluation to assess the appropriateness, acceptability, and effectiveness of CCv.2. Through several iterations designed and tested in collaboration with AYAs, CCv.2 had improvements in the user experience, such as the ability to send a private message to other users and the site becoming mobile responsive. Results from the evaluation showed CCv.2 was appropriate for connecting with other AYAs. Most AYAs reported satisfaction with CCv.2 and a positive impact on their feelings of sadness, worry, and/or anxiety. CCv.2 fills an important service provision gap in providing an appropriate and acceptable OHC for AYAs impacted by cancer, with initial promising psychological outcomes.

Patient Engagement in the Design of a Mobile Health App That Supports Enhanced Recovery Protocols for Cardiac Surgery: Development Study

Background

Despite the importance of their perspectives, end users (eg, patients, caregivers) are not typically engaged by academic researchers in the development of mobile health (mHealth) apps for perioperative cardiac surgery settings.

Objective

The aim of this study was to describe a process for and the impact of patient engagement in the development of an mHealth app that supports patient and caregiver involvement with enhanced recovery protocols during the perioperative period of cardiac surgery.

Methods

Engagement occurred at the level of consultation and took the form of an advisory panel. Patients who underwent cardiac surgery (2017-2018) at St. Boniface Hospital (Winnipeg, Manitoba) and their caregivers were approached for participation. A qualitative exploration determined the impact of patient engagement on the development (ie, design and content) of the mHealth app. This included a description of (1) the key messages generated by the advisory panel, (2) how key messages were incorporated into the development of the mHealth app, and (3) feedback from the developers of the mHealth app about the key messages generated by the advisory panel.

Results

The advisory panel (N=10) generated 23 key messages to guide the development of the mHealth app. Key design-specific messages (n=7) centered around access, tracking, synchronization, and reminders. Key content-specific messages (n=16) centered around medical terms, professional roles, cardiac surgery procedures and recovery, educational videos, travel, nutrition, medications, resources, and physical activity. This information was directly incorporated into the design of the mHealth app as long as it was supported by the existing functionalities of the underlying platform. For example, the platform did not support the scheduling of reminders by users, identifying drug interactions, or synchronizing with other devices. The developers of the mHealth app noted that key messages resulted in the integration of a vast range and volume of information and resources instead of ones primarily focused on surgical information, content geared toward expectations management, and an expanded focus to include caregivers and other family members, so that these stakeholders may be directly included in the provision of information, allowing them to be better informed, prepare along with the patient, and be involved in recovery planning.

Conclusions

Patient engagement may facilitate the development of a detail-oriented and patient-centered mHealth app whose design and content are driven by the lived experiences of end users.

Innovators' views on involving users and patients in surgical device development: a qualitative interview study

OBJECTIVES

Involving end-users and patients in the development of surgical devices, even when patients are not end-users, is deemed important in policy and in academia since it could improve strategic choices in research and development (R&D). Nonetheless, research into innovators' views on end-user and patient involvement is rare. This study explores what end-users and patients are being involved by innovators during development, what methods for involvement are being used and what topics are being discussed with these end-users and patients.

DESIGN

A qualitative study featuring semi-structured interviews with innovators of surgical devices. Interviews were recorded and a thematic analysis was performed on verbatim transcripts.

PARTICIPANTS

15 interviews were conducted with 19 innovators of 14 surgical devices.

SETTING

Innovation practices of surgical devices in the Netherlands and Belgium.

RESULTS

End-users were engaged in R&D with formal methods and in unsystematic ways. These users all work in the clinical domain, for example, as surgeons or nurses. The innovators engaged users to analyse problems for which a device could be a solution, define functionalities, make design choices, analyse usability, ensure safety and improve aesthetics. Patients were rarely involved. Innovators stated that patients are not considered to be end-users, that physicians can represent patient interests and that involving patients is unethical as false expectations could be raised.

CONCLUSION

Innovators involve end-users with methods and unsystematic ways in the development of surgical devices. Despite governmental calls for patient involvement in the development of medical devices and surgical devices, innovators do not generally involve patients.

Involvement of End Users in the Development of Serious Games for Health Care Professions Education: Systematic Descriptive Review

BACKGROUND

On the basis of ethical and methodological arguments, numerous calls have been made to increase the involvement of end users in the development of serious games (SGs). Involving end users in the development process is considered a way to give them power and control over educational software that is designed for them. It can also help identify areas for improvement in the design of SGs and improve their efficacy in targeted learning outcomes. However, no recognized guidelines or frameworks exist to guide end users' involvement in SG development.

OBJECTIVE

The aim of this study is to describe how end users are involved in the development of SGs for health care professions education.

METHODS

We examined the literature presenting the development of 45 SGs that had reached the stage of efficacy evaluation in randomized trials. One author performed data extraction using an ad hoc form based on a design and development framework for SGs. Data were then coded and synthesized on the basis of similarities. The coding scheme was refined iteratively with the involvement of a second author. Results are presented using frequencies and percentages.

RESULTS

End users' involvement was mentioned in the development of 21 of 45 SGs. The number of end users involved ranged from 12 to 36. End users were often involved in answering specific concerns that arose during the SG design (n=6) or in testing a prototype (n=12). In many cases, researchers solicited input from end users regarding the goals to reach (n=10) or the functional esthetics of the SGs (n=7). Most researchers used self-reported questionnaires (n=7).

CONCLUSIONS

Researchers mentioned end users' involvement in the development of less than half of the identified SGs, and this involvement was also poorly described. These findings represent significant limitations to evaluating the impact of the involvement of end users on the efficacy of SGs and in making recommendations regarding their involvement.

Participatory Design of an Electronic Medical Record for Paediatric Palliative Care: A Think-Aloud Study with Nurses and Physicians

Background: Electronic medical records (EMRs) offer a promising approach to mapping and documenting the complex information gathered in paediatric palliative care (PPC). However, if they are not well developed, poorly implemented EMRs have unintended consequences that may cause harm to patients. One approach to preventing such harm is the involvement of users in the participatory design to ensure user acceptance and patient safety. Therefore, the aim of this study is to evaluate the acceptance of a novel patient chart module (PCM) as part of an EMR from the perspective of potential users in PPC and to involve these professionals in the design process. Methods: A qualitative observational study with N = 16 PPC professionals (n = 10 nurses, n = 6 physicians) was conducted, including concurrent think aloud (CTA) and semi-structured interviews. A structured content analysis based on the Unified Theory of Acceptance and Use of Technology was applied. Results: The results can be summarized in terms of general observations, performance expectancy, effort expectancy and facilitating conditions, all of which are likely to have a positive influence on acceptance of the PCM from the user perspective in the context of PPC. Conclusions: The involvement of users in the development of EMRs is important for meeting the requirements in PPC. Further software adaptations are necessary to implement these requirements.

Examining Challenges to the Incorporation of End Users in the Design of Digital Health Interventions: Protocol for a Systematic Review

Background

The process of designing a digital health intervention (DHI)—also referred to as mobile health or eHealth—spans needs assessments, technical functionality and feasibility, user satisfaction, effectiveness, impact, and value. These interventions are causing a rapid evolution in the landscape of health care. Multiple studies have shown their propensity to extend both the quality and reach of interventions. However, failure to improve DHI design is linked to failed uptake and health outcomes. This dilemma is further conflicted by the colliding backdrops of the digital and health industries, both of which approach, understand, and involve end users differently in the framing of a DHI.

Objective

The objective of this systematic review is to assess the challenges to incorporating end users in the design stage of digital health interventions, to identify key pain points, and to identify limitations and gaps for areas of future investigation.

Methods

The PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols) checklist will be used to structure this protocol. A systematic search of the PsycINFO, PubMed (MEDLINE), Web of Science, CINAHL, Scopus, and IEEE Xplore databases will be conducted. Additionally, the PerSPEcTiF guidelines for complex interventions will be consulted. Two reviewers will independently screen the titles and abstracts of the identified references and select studies according to the eligibility criteria. Any discrepancies will then be discussed and resolved. Two reviewers will independently extract and validate data from the included studies into a standardized form and conduct quality appraisal.

Results

As of February 2021, we have completed a preliminary literature search examining challenges to the incorporation of end users in the design stage of DHIs. Systematic searches, data extraction and analysis, and writing of the systematic review are expected to be completed by December 2021.

Conclusions

This systematic review aims to provide an effective summary of key pain points toward incorporating end users in DHIs. Results from this review will provide an evidence base for a better approach to end user involvement in the interest of improving efficacy and uptake of DHIs.

Trial Registration

PROSPERO International Prospective Register of Systematic Reviews CRD42021238164; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=238164

International Registered Report Identifier (IRRID)

PRR1-10.2196/28083

Contrast of Digital and Health Literacy Between IT and Health Care Specialists Highlights the Importance of Multidisciplinary Teams for Digital Health-A Pilot Study

PURPOSE

Despite their promises, digital innovations have scarcely translated to technologies used in routine clinical practice, making the identification of barriers to successful implementation a research priority. Low levels of transdisciplinary skills represent such a barrier but so far, this has not been evaluated and compared between information technology (IT) and health care specialists. In this study, we evaluated the level of digital health literacy among IT and health care specialists.

MATERIALS AND METHODS

An anonymous questionnaire was distributed to staff at a breast cancer unit and an IT department of two German universities in December 2020. The survey questionnaire consisted of the previously validated eHealth Literacy Assessment Toolkit and additional questions with respect to age, profession, and career stage. Mann-Whitney or Wilcoxon rank-sum tests and two-sample chi-square tests were used for the analysis.

RESULTS

The survey was completed by 113 individuals: 70 (61.9%) IT specialists and 43 (38.1%) health care specialists. Health care specialists scored significantly higher on the health-related scales and IT specialists scored significantly higher on the digitally related scales. No single participant identified themselves to have the highest level of literacy on all survey questions (n = 0 of 113; 0%). Only one person (n = 1 of 113; 0.9%) consistently reported a high or the highest level of literacy.

CONCLUSION

Although IT and health care specialists showed great literacy in their respective disciplines, only few individuals combined both digital and health care literacy. Multidisciplinary teams and transdisciplinary curricula are crucial to bridge skill gaps between disciplines and to drive the implementation of digital health initiatives.

Involvement of Indigenous young people in the design and evaluation of digital mental health interventions: a scoping review protocol

BACKGROUND

Indigenous young people worldwide are at greater risk of developing mental health concerns due to ongoing inequity and disadvantage. Digital mental health (dMH) interventions are identified as a potential approach to improving access to mental health treatment for Indigenous youth. Although involvement in the development and evaluation of dMH resources is widely recommended, there is limited evidence to guide engagement of Indigenous young people in these processes. This scoping review aims to examine the methods used to involve Indigenous young people in the development or evaluation of dMH interventions.

METHODS

Articles published in English, involving Indigenous young people (aged 10-24 years) in the development or evaluation of dMH interventions, originating from Australia, New Zealand, Canada and the USA will be eligible for inclusion. PubMed, Scopus and EBSCOhost databases (Academic Search Premiere, Computer and Applied Science complete, CINAHL, MEDLINE, APA PsychArticles, Psychology and Behavioural Sciences collection, APA PsychInfo) will be searched to identify eligible articles (from January 1990 onwards). Infomit and Google Scholar (limited to 200 results) will be searched for grey literature. Two reviewers will independently screen citations, abstracts and full-text articles. Study methods, methodologies, dMH intervention details, participant information and engagement, and dissemination methods will be extracted, analysed (utilising content analysis), and qualitatively assessed for alignment with best practice ethical guidelines for undertaking Indigenous health research. A narrative summary of findings will be presented. Reporting will follow the Consolidated Criteria for Strengthening Reporting of Health Research involving Indigenous peoples (CONSIDER) and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews (PRISMA-ScR) guidelines.

DISCUSSION

To date, there are no reviews which analyse engagement of Indigenous young people in the development and evaluation of dMH interventions. This review will appraise alignment of current practice with best practice guidelines to inform future research. It will highlight appropriate methods for the engagement of young people in study processes, providing guidance for health practitioners, policy makers, and researchers working in the field of Indigenous youth and dMH.

SYSTEMATIC REVIEW REGISTRATION

Open Science Framework ( osf.io/2nkc6 ).

Generative Participatory Design Methodology to Develop Electronic Health Interventions: Systematic Literature Review

BACKGROUND

Generative participatory design (PD) may help in developing electronic health (eHealth) interventions. PD is characterized by the involvement of all stakeholders in creative activities. This is different from the traditional user-centered design, where users are less involved. When looking at PD from a research through design perspective, it is important to summarize the reasons for choosing a certain form of generative PD to further develop its methodology. However, the scientific literature is currently unclear about which forms of PD are used to develop eHealth and which arguments are used to substantiate the decision to use a certain form of generative PD.

OBJECTIVE

This study aimed to explore the reporting and substantiation of generative PD methodologies in empirical eHealth studies published in scientific journals to further develop PD methodology in the field of eHealth.

METHODS

A systematic literature review following the Cochrane guidelines was conducted in several databases (EMBASE, MEDLINE Ovid, Web of Science, and CINAHL EBSCOhost). Data were extracted on the recruitment and management of stakeholders, the use of tools, and the use of outcome measures.

RESULTS

Of the 3131 studies initially identified, 69 were selected for qualitative synthesis. The reporting was very variable, depending to a large extent on whether the study stated that reporting on the PD process was a major aim. The different levels of reporting and substantiation of the choices of a recruitment strategy, stakeholder management, and tools and outcome measures are presented. Only a few authors explicitly used arguments directly related to PD guiding principles such as democratic, mutual learning, tacit and latent knowledge, and collective creativity. Even though PD principles were not always explicitly discussed in the method descriptions of the studies, they were implicitly present, mostly in the descriptions of the use of PD tools. The arguments used to substantiate the choices made in stakeholder management, PD tools, and the type of outcome measures adopted point to the involvement of PD principles.

CONCLUSIONS

Studies that have used a PD research methodology to develop eHealth primarily substantiate the choice of tools made and much less the use of stakeholders and outcome measures.

Involving End Users in Adapting a Spanish Version of a Web-Based Mental Health Clinic for Young People in Colombia: Exploratory Study Using Participatory Design Methodologies

BACKGROUND

Health information technologies (HITs) hold enormous promise for improving access to and providing better quality of mental health care. However, despite the spread of such technologies in high-income countries, these technologies have not yet been commonly adopted in low- and middle-income countries. People living in these parts of the world are at risk of experiencing physical, technological, and social health inequalities. A possible solution is to utilize the currently available HITs developed in other counties.

OBJECTIVE

Using participatory design methodologies with Colombian end users (young people, their supportive others, and health professionals), this study aimed to conduct co-design workshops to culturally adapt a Web-based Mental Health eClinic (MHeC) for young people, perform one-on-one user-testing sessions to evaluate an alpha prototype of a Spanish version of the MHeC and adapt it to the Colombian context, and inform the development of a skeletal framework and alpha prototype for a Colombian version of the MHeC (MHeC-C).

METHODS

This study involved the utilization of a research and development (R&D) cycle including 4 iterative phases: co-design workshops; knowledge translation; tailoring to language, culture, and place (or context); and one-on-one user-testing sessions.

RESULTS

A total of 2 co-design workshops were held with 18 users-young people (n=7) and health professionals (n=11). Moreover, 10 users participated in one-on-one user-testing sessions-young people (n=5), supportive others (n=2), and health professionals (n=3). A total of 204 source documents were collected and 605 annotations were coded. A thematic analysis resulted in 6 themes (ie, opinions about the MHeC-C, Colombian context, functionality, content, user interface, and technology platforms). Participants liked the idea of having an MHeC designed and adapted for Colombian young people, and its 5 key elements were acceptable in this context (home page and triage system, self-report assessment, dashboard of results, booking and video-visit system, and personalized well-being plan). However, to be relevant in Colombia, participants stressed the need to develop additional functionality (eg, phone network backup; chat; geolocation; and integration with electronic medical records, apps, or electronic tools) as well as an adaptation of the self-report assessment. Importantly, the latter not only included language but also culture and context.

CONCLUSIONS

The application of an R&D cycle that also included processes for adaptation to Colombia (language, culture, and context) resulted in the development of an evidence-based, language-appropriate, culturally sensitive, and context-adapted HIT that is relevant, applicable, engaging, and usable in both the short and long term. The resultant R&D cycle allowed for the adaptation of an already available HIT (ie, MHeC) to the MHeC-C-a low-cost and scalable technology solution for low- and middle-income countries like Colombia, which has the potential to provide young people with accessible, available, affordable, and integrated mental health care at the right time.

In transition with ADHD: the role of information, in facilitating or impeding young people's transition into adult services

BACKGROUND

Many national and regional clinical guidelines emphasise the need for good communication of information to young people and their parent/carers about what to expect during transition into adult services. Recent research indicates only a minority of young people in need of transition for Attention Deficit Hyperactivity Disorder (ADHD) experience continuity of care into adulthood, with additional concerns about quality of transition. This qualitative study explored the role that information plays in experiences of transition from the perspectives of parent/carers and young people.

METHODS

Participants were recruited from 10 National Health Service Trusts, located across England, with varying service configurations. Ninety two qualitative interviews were conducted: 64 with young people with ADHD at different stages relative to transition, and 28 with parent/carers. Thematic analysis of data was completed using the Framework Method.

RESULTS

Interviewees reported a range of experiences; however reliance on parent/carers to gather and translate key information, and negative experiences associated with poor communication of information, were universal. Three themes emerged: Navigating information with help from parents; Information on ADHD into adulthood; Information about the transition process. The first revealed the essential role of parent in the translation and application of information, the other two explored distinct types of information necessary for a smooth transition. Interviewees made recommendations for clinical practice similar to UK (United Kingdom) National Institute for Health and Care Excellence (NICE) guidelines, with an additional emphasis on providing nuanced information on ADHD as a potentially long term condition. It was important to interviewees that General Practitioners had a basic understanding of adult ADHD and also had access to information about service provision.

CONCLUSIONS

Our findings illustrate that the availability and communication of information to young people and their parent/carers is an essential component of the transition process between child and adult ADHD services. How and when it is provided may support or impede transition. This study constitutes a substantial contribution to the evidence base, drawing on interviews from a range of participants across England and from Trusts offering different types of services.