Meaningful patient and public involvement in digital health innovation, implementation and evaluation: A systematic review

Barriers and facilitators influencing implementation of care technology for people with intellectual disabilities: A cross-sectional study among care professionals

BACKGROUND

Implementation issues often hinder reaching the potential of care technology to improve daily lives of people with intellectual disabilities. We investigated barriers to and facilitators of implementing different technology modalities (app/social robot/sensor/domotics) in long-term care.

METHOD

Care professionals (N = 83) from 12 Dutch disability care organisations completed a customised measurement instrument for determinants of innovations (MIDI) questionnaire.

RESULTS

Out of 27 determinants, 20 were identified as facilitators and 16 as barriers. We highlight common barriers: few colleagues who work with the technology; no (awareness of) formal ratification of technology use; no arrangements regarding turnover of staff using the technology; unsettling organisational changes; technological defects and limited IT preconditions.

CONCLUSIONS

The results, which could be combined and compared across study sites, provide insight into which implementation determinants were already well addressed, and where there is ground to gain when implementing care technology in disability care organisations.

Engagement of medication users in the development and implementation of digital medication adherence technologies: a multi-stakeholder study

BACKGROUND

This study aims to create a comprehensive framework for the development and implementation of digital medication adherence technologies (DMATech), focusing on critical stages where engagement of medication users (MU) is considered meaningful, i.e. adds significant value, as agreed upon by participating stakeholders.

METHODS

Through a literature review and expert consensus, a framework was outlined covering key DMATech development and implementation phases and steps. An in-person workshop with MU representatives and adherence experts, using the Nominal Group Technique, further refined these stages for MU engagement.

RESULTS

The DMATech framework included three phases: 'Innovation,' 'Research and Development,' and 'Launch and Implementation,' each encompassing multiple steps. The workshop, attended by five MU representatives and nine adherence experts, identified critical stages for MU input including context analysis, ideation, proof of concept, prototype creation, DMATech's iteration, critical evaluation, healthcare implementation, real-world assessment, and improvement. Nevertheless, there was a divergence of consensus regarding the importance of MUs engagement in regulatory, financial, and marketing aspects.

CONCLUSIONS

This study provides a holistic framework for DMATech development and implementation and underscores the necessity of MU engagement at various stages. Modes of MU engagement cannot be generalized; a case-by-case evaluation of engagement strategies is essential.

Implementation of a Web-Based Outpatient Asynchronous Consultation Service: Mixed Methods Study

BACKGROUND

Asynchronous outpatient patient-to-provider communication is expanding in UK health care, requiring evaluation. During the pandemic, Aberdeen Royal Infirmary in Scotland expanded its outpatient asynchronous consultation service from dermatology (deployed in May 2020) to gastroenterology and pain management clinics.

OBJECTIVE

We conducted a mixed methods study using staff, patient, and public perspectives and National Health Service (NHS) numerical data to obtain a rounded picture of innovation as it happened.

METHODS

Focus groups (3 web-based and 1 face-to-face; n=22) assessed public readiness for this service, and 14 interviews with staff focused on service design and delivery. The service's effects were examined using NHS Grampian service use data, a patient satisfaction survey (n=66), and 6 follow-up patient interviews. Survey responses were descriptively analyzed. Demographics, acceptability, nonattendance rates, and appointment outcomes of users were compared across levels of area deprivation in which they live and medical specialties. Interviews and focus groups underwent theory-informed thematic analysis.

RESULTS

Staff anticipated a simple technical system transfer from dermatology to other receptive medical specialties, but despite a favorable setting and organizational assistance, it was complicated. Key implementation difficulties included pandemic-induced technical integration delays, misalignment with existing administrative processes, and discontinuity in project management. The pain management clinic began asynchronous consultations (digital appointments) in December 2021, followed by the gastroenterology clinic in February 2022. Staff quickly learned how to explain and use this service. It was thought to function better for pain management as it fitted preexisting practices. From May to September 2022, the dermatology (adult and pediatric), gastroenterology, and pain management clinics offered 1709 appointments to a range of patients (n=1417). Digital appointments reduced travel by an estimated 44,712 miles (~71,956.81 km) compared to the face-to-face mode. The deprivation profile of people who chose to use this service closely mirrored that of NHS Grampian's population overall. There was no evidence that deprivation impacted whether digital appointment users subsequently received treatment. Only 18% (12/66) of survey respondents were unhappy or very unhappy with being offered a digital appointment. The benefits mentioned included better access, convenience, decreased travel and waiting time, information sharing, and clinical flexibility. Overall, patients, the public, and staff recognized its potential as an NHS service but highlighted informed choice and flexibility. Better communication-including the use of the term assessment instead of appointment-may increase patient acceptance.

CONCLUSIONS

Asynchronous pain management and gastroenterology consultations are viable and acceptable. Implementing this service is easiest when existing administrative processes face minimal disruption, although continuous support is needed. This study can inform practical strategies for supporting staff in adopting asynchronous consultations (eg, preparing for nonlinearity and addressing task issues). Patients need clear explanations and access to technical support, along with varied consultation options, to ensure digital inclusion.

Service innovations for people with multiple long-term conditions: reflections of a rapid evaluation team

Background

People living with multiple long-term conditions represent a significant concern for National Health Service policy and practice, and their care is a major theme in the 2019 National Health Service Long Term Plan. The Birmingham RAND and Cambridge Rapid Evaluation Centre team has undertaken a thematic synthesis of the 10 evaluations it has conducted from 2018 to 2023, exploring the needs, priorities and implications for people with multiple long-term conditions.

Objectives

The aims for this overarching study were to: (1) build a body of learning about service innovations in primary and community settings for people of all ages with multiple long-term conditions, focused on questions that matter most to people with multimorbidity; and (2) develop methodological insights about how rapid evaluation can be used to inform the scoping, testing and implementation of service innovations for people with multiple long-term conditions.

Design

The focus on multiple long-term conditions came from a Birmingham RAND and Cambridge Rapid Evaluation Centre prioritisation process undertaken in 2018 using James Lind Alliance methods. Cross-analysis of the findings from the 10 individual rapid evaluations was supplemented by (1) building aspects of multimorbidity into the design of later evaluations; (2) interviewing national and regional stakeholders (n=19) working in or alongside integrated care systems; (3) undertaking a rapid review of evidence on remote monitoring for people with multiple long-term conditions (19 papers included); and (4) testing overall insights with organisations representing patients and carers through a patient, public and professional engagement workshop with 10 participants plus members of the research team.

Results

While living with multiple long-term conditions is common and is the norm for people over the age of 50 using health and care services, it is not often a focus of health service provision or innovation, nor of research and evaluation activity. We discuss six themes emerging from the totality of the study: (1) our health system is mainly organised around single conditions and not multiple long-term conditions; (2) research calls and studies usually focus on single conditions and associated services; (3) building opportunities for engaged, informed individuals and carers and improved self-management; (4) the importance of measures that matter for patients and carers; (5) barriers to developing and implementing service innovations for people with multiple long-term conditions; and (6) what is needed to make patients with multiple long-term conditions a priority in healthcare planning and delivery.

Limitations

Care of people with multiple long-term conditions was not the principal focus of several of the rapid evaluations. While this was a finding in itself, it limited our learning about designing and implementing, as well as methodological approaches to evaluating, service innovations for people with multiple long-term conditions.

Conclusions

Through a thematic analysis of the portfolio of evaluations, we have deduced a set of suggested implications for how the needs of people with multiple long-term conditions can be better embedded in policy, research and practice.

Future work

Areas of uncertainty related to the care of people with multiple long-term conditions should be further explored, including developing and testing measures of patient experience of (un)co-ordinated care across settings, and interrogating the experience of health and care staff when working with people with multiple long-term conditions, to understand what works.

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (NIHR award ref: NIHR134284) and is published in full in Health and Social Care Delivery Research; Vol. 12, No. 15. See the NIHR Funding and Awards website for further award information.

Needs and Demands for e-Health Interventions in Patients Attending a Psychosomatic Outpatient Clinic: A Baseline Assessment for a User-Centered Design Approach

Objective: Increased utilization of e-health services can help to meet shortages of psychotherapeutic treatment. e-Health interventions can be effective if tailored according to the individual needs and demands of the target group. To gather comprehensive data for the development of a user-centered e-health intervention, a cross-sectional study was conducted among a heterogeneous cohort of 309 patients seeking treatment or consultation at psychosomatic university hospital in a densely populated region of Germany. Methods: Sociodemographic data, psychometric dimensions of mental burden, as well as needs and demands regarding an e-health intervention were assessed. A descriptive statistical analysis and a cluster analysis were performed to examine distribution of preferences and differences based on level of burden regarding needs and demands for e-health interventions. Results: Two hundred thirty-nine (N = 239) participants were included in the final data analysis. Among this primarily urban target group smartphone availability was favored by 77.8% of the participants. The cluster analysis revealed significant differences dependent on mental burden. 75.2% of participants with a high mental burden preferred longer interventions of 1-4 months compared with 49% in the low burden group, which also considered short interventions of up to 1 month (46%). Differences were also identified for content preferences and daily-life integration and were consistent irrespective of the initial reason for consultation. Conclusion: The findings of this study can provide a foundational framework for developing user-centered psychosomatic interventions. The potential relationship between individual burden and individual needs and demands highlights the crucial role of preliminary research to tailor interventions to effectively address diverse needs and preferences.

Telemonitoring of pediatric asthma in outpatient settings: A systematic review

Telemonitoring technologies are rapidly evolving, offering a promising solution for remote monitoring and timely management of asthma acute episodes. We aimed to describe current pediatric asthma telemonitoring technologies. A systematic review was conducted until September 2023 on Medline, Scopus, and Web of Science. We included studies of children (0-18 years) with asthma or recurrent wheezing whose respiratory condition was telemonitored outside the healthcare setting. A narrative synthesis was performed. We identified 40 telemonitoring technologies described in 40 studies. The more frequently used technologies for telemonitoring were mobile applications (n = 21) and web-based systems (n = 14). Telemonitoring duration varied between 2 weeks and 32 months. Data collection included asthma symptoms (n = 30), patient-reported outcome measures (PROMs) (n = 11), spirometry/peak flow readings (n = 20), medication adherence (n = 17), inhaler technique (n = 3), air quality (n = 2), and respiratory sounds (n = 2). Both parents and children were the technology target users in most studies (n = 23). Technology training was reported in 23 studies of which 3 provided ongoing support. Automatic feedback was found in 30 studies, mostly related with asthma control. HCP were involved in data management in 27 studies. Technologies were tested in samples from 4 to 327 children, with most studies including school-aged children and/or adolescents (n = 38) and eight including preschool children. This review provides an overview of existing technologies for the outpatient telemonitoring of pediatric asthma. Specific technologies for preschool children represent a gap in the literature that needs to be specifically addressed in future research.

Digital health interventions for improving access to primary care in India: A scoping review

Access to quality healthcare remains a challenge in low-and middle-income countries. Vulnerable populations with unmet needs face the greatest challenge in accessing primary care for appropriate and timely healthcare. The use of digital technologies can not only strengthen health systems but also improve access to health care, particularly for the vulnerable. This scoping review aims to assess the various digital health technologies and interventions available for improving access to primary care for the vulnerable in India. This scoping review employed the Joanna Brigg Institute's (JBI) guidelines and Arksey and O'Malley's methodological framework. The literature search was conducted in Medline/PubMed, Embase, Web of Science-Core Collection, Scopus, AgeLine, PsycINFO, CINAHL, ERIC, Cochrane CENTRAL, and Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register databases, using the keywords, such as 'Access', 'Healthcare', 'Assistive technology', 'Digital health' 'Vulnerable', 'India' and 'Healthcare technology'. A two-staged screening of titles and abstracts, followed by full-text was conducted independently by two reviewers, using the Rayyan software. Subsequently, the data was extracted from selected studies using a pre-designed and approved extraction form. The data was then synthesised and analysed narratively. The protocol for this review has been registered with open science forum (OSF) registries (https://osf.io/63pjw/). The search yielded about 3840 records, 3544 records were eligible for screening of titles and abstracts. We included seven studies after a two-round screening and identified seven different technological innovations developed to bridge gaps in access to primary care. The commonly used digital health interventions for improving access to primary care were virtual tele-health systems and mHealth applications in-built within an android smartphone or a tablet. Digital health interventions was either used as a standalone tele-health aid or a collaborative system for community workers, primary care physicians as well as the health service users. The purpose of these innovations was to increase awareness and knowledge to access support for specific aspects of healthcare. Virtual primary health care with the specialist in the hub supporting general physicians at the primary health centres in blocks and districts was another such model used for improving access to primary care. Digital health interventions was also used for mass community screening of disabilities, such as persons with hearing disability. To re-imagine a digitally empowered health systems in India, also inclusive of the vulnerable, it is important to inclusively conceptualise, systematically develop and rigorously evaluate any public health interventions including those that are enabled by digital health interventions to bridge the gaps in access to primary care in India. Such a strategy could address the paucity of evidence in public health interventions and provide sustainable strategies to strengthen health systems in India. Trial registration: Open Science Framework-Registration Link: https://osf.io/63pjw/.

Patient and public involvement workshop to shape artificial intelligence-supported connected asthma self-management research

Digital interventions with artificial intelligence (AI) can potentially support people with asthma to reduce the risk of exacerbation. Engaging patients throughout the development process is essential to ensure usability of the intervention for the end-users. Using our Connected for Asthma (C4A) intervention as an exemplar, we explore how patient involvement can shape a digital intervention. Seven Patient and Public Involvement (PPI) colleagues from the Asthma UK Centre for Applied Research participated in four advisory workshops to discuss how they would prefer to use/interact with AI to support living with their asthma, the benefit and caveats to use the AI that incorporated asthma monitoring and indoor/outdoor environmental data. Discussion focussed on the three most wanted use cases identified in our previous studies. PPI colleagues wanted AI to support data collection, remind them about self-management tasks, teach them about asthma environmental triggers, identify risk, and empower them to confidently look after their asthma whilst emphasising that AI does not replace clinicians. The discussion informed the key components in the next C4A interventions, including the approach to interacting with AI, the technology features and the research topics. Attendees highlighted the importance of considering health inequities, the presentation of data, and concerns about data accuracy, data privacy, security and ownership. We have demonstrated how patient roles can shift from that of 'user' (the traditional 'tester' of a digital intervention), to a co-design partner who shapes the next iteration of the intervention. Technology innovators should seek practical and feasible strategies to involve PPI colleagues throughout the development cycle of a digital intervention; supporting researchers to explore the barriers, concerns, enablers and advantages of implementing digital healthcare.

Patient and Public Willingness to Share Personal Health Data for Third-Party or Secondary Uses: Systematic Review

BACKGROUND

International advances in information communication, eHealth, and other digital health technologies have led to significant expansions in the collection and analysis of personal health data. However, following a series of high-profile data sharing scandals and the emergence of COVID-19, critical exploration of public willingness to share personal health data remains limited, particularly for third-party or secondary uses.

OBJECTIVE

This systematic review aims to explore factors that affect public willingness to share personal health data for third-party or secondary uses.

METHODS

A systematic search of 6 databases (MEDLINE, Embase, PsycINFO, CINAHL, Scopus, and SocINDEX) was conducted with review findings analyzed using inductive-thematic analysis and synthesized using a narrative approach.

RESULTS

Of the 13,949 papers identified, 135 were included. Factors most commonly identified as a barrier to data sharing from a public perspective included data privacy, security, and management concerns. Other factors found to influence willingness to share personal health data included the type of data being collected (ie, perceived sensitivity); the type of user requesting their data to be shared, including their perceived motivation, profit prioritization, and ability to directly impact patient care; trust in the data user, as well as in associated processes, often established through individual choice and control over what data are shared with whom, when, and for how long, supported by appropriate models of dynamic consent; the presence of a feedback loop; and clearly articulated benefits or issue relevance including valued incentivization and compensation at both an individual and collective or societal level.

CONCLUSIONS

There is general, yet conditional public support for sharing personal health data for third-party or secondary use. Clarity, transparency, and individual control over who has access to what data, when, and for how long are widely regarded as essential prerequisites for public data sharing support. Individual levels of control and choice need to operate within the auspices of assured data privacy and security processes, underpinned by dynamic and responsive models of consent that prioritize individual or collective benefits over and above commercial gain. Failure to understand, design, and refine data sharing approaches in response to changeable patient preferences will only jeopardize the tangible benefits of data sharing practices being fully realized.

Delivering Digital Health Solutions that Patients Need: A Call to Action

Digital health solutions have the potential to complement traditional healthcare approaches and deliver improved health outcomes, but there are system-wide challenges that need to be addressed. These include fragmentation of the digital health landscape, regulatory processes that lack the agility to accommodate the fast pace of digital health advances, and inadequate transparency around data sharing and data governance. All of these challenges have led to mistrust, limited understanding and sharing of best practices, a lack of digital education and awareness, and insufficient patient and public engagement and involvement. In this paper, we argue that for digital health solutions to fulfil their potential, there needs to be a significant increase in early, meaningful, and sustained engagement with the people they intend to benefit. The uptake as well as the impact of digital solutions created in partnership with patients for patients are greater and more relevant to the communities they address.

Action Opportunities to Pursue Responsible Digital Care for People With Intellectual Disabilities: Qualitative Study

BACKGROUND

Responsible digital care refers to any intentional systematic effort designed to increase the likelihood of a digital care technology developed through ethical decision-making, being socially responsible and aligned with the values and well-being of those impacted by it.

OBJECTIVE

We aimed to present examples of action opportunities for (1) designing "technology"; (2) shaping the "context" of use; and (3) adjusting the behavior of "users" to guide responsible digital care for people with intellectual disabilities.

METHODS

Three cases were considered: (1) design of a web application to support the preparation of meals for groups of people with intellectual disabilities, (2) implementation of an app to help people with intellectual disabilities regulate their stress independently, and (3) implementation of a social robot to stimulate interaction and physical activity among people with intellectual disabilities. Overall, 26 stakeholders participated in 3 multistakeholder workshops (case 1: 10/26, 38%; case 2: 10/26, 38%; case 3: 6/26, 23%) based on the "guidance ethics approach." We identified stakeholders' values based on bottom-up exploration of experienced and expected effects of using the technology, and we formulated action opportunities for these values in the specific context of use. Qualitative data were analyzed thematically.

RESULTS

Overall, 232 effects, 33 values, and 156 action opportunities were collected. General and case-specific themes were identified. Important stakeholder values included quality of care, autonomy, efficiency, health, enjoyment, reliability, and privacy. Both positive and negative effects could underlie stakeholders' values and influence the development of action opportunities. Action opportunities comprised the following: (1) technology: development of the technology (eg, user experience and customization), technology input (eg, recipes for meals, intervention options for reducing stress, and activities), and technology output (eg, storage and use of data); (2) context: guidelines, training and support, policy or agreements, and adjusting the physical environment in which the technology is used; and (3) users: integrating the technology into daily care practice, by diminishing (eg, "letting go" to increase the autonomy of people with intellectual disabilities), retaining (eg, face-to-face contact), and adding (eg, evaluation moments) certain behaviors of care professionals.

CONCLUSIONS

This is the first study to provide insight into responsible digital care for people with intellectual disabilities by means of bottom-up exploration of action opportunities to take account of stakeholders' values in designing technology, shaping the context of use, and adjusting the behavior of users. Although part of the findings may be generalized, case-specific insights and a complementary top-down approach (eg, predefined ethical frameworks) are essential. The findings represent a part of an ethical discourse that requires follow-up to meet the dynamism of stakeholders' values and further develop and implement action opportunities to achieve socially desirable, ethically acceptable, and sustainable digital care that improves the lives of people with intellectual disabilities.

Experiences with Wearable Sensors in Oncology during Treatment: Lessons Learned from Feasibility Research Projects in Denmark

BACKGROUND

The fraction of elderly people in the population is growing, the incidence of some cancers is increasing, and the number of available cancer treatments is evolving, causing a challenge to healthcare systems. New healthcare tools are needed, and wearable sensors could partly be potential solutions. The aim of this case report is to describe the Danish research experience with wearable sensors in oncology reporting from three oncological wearable research projects.

CASE STUDIES

Three planned case studies investigating the feasibility of different wearable sensor solutions during cancer treatment are presented, focusing on study design, population, device, aim, and planned outcomes. Further, two actual case studies performed are reported, focusing on patients included, data collected, results achieved, further activities planned, and strengths and limitations.

RESULTS

Only two of the three planned studies were performed. In general, patients found the technical issues of wearable sensors too challenging to deal with during cancer treatment. However, at the same time it was demonstrated that a large amount of data could be collected if the framework worked efficiently.

CONCLUSION

Wearable sensors have the potential to help solve challenges in clinical oncology, but for successful research projects and implementation, a setup with minimal effort on the part of patients is requested.

The role of open innovation in addressing resource constraints in healthcare: a systematic literature review

PURPOSE

The resource crisis in healthcare can be alleviated by engaging external stakeholders and resources in healthcare delivery. The authors use value and open innovation concepts to understand what motivates the stakeholders to join the healthcare innovation ecosystem and what value such an ecosystem brings to healthcare.

DESIGN/METHODOLOGY/APPROACH

A systematic literature review following the PRISMA framework method was applied to reach the research objective. Out of a total of 509 identified articles published till 2021, 25 were selected as relevant for this review.

FINDINGS

Six categories of actors were identified, including innovation intermediaries, which were so far neglected in the healthcare innovation literature. Furthermore, patients, healthcare providers, innovation suppliers, investors and influencers were described. The authors also distinguished internal and external stakeholders. The authors show why and how open innovation projects contribute to involving external stakeholders and resources in healthcare delivery by contributing to patient autonomy, relationship building, knowledge transfer, improving collaborative mindset and culture, advancing know-how and bringing additional finances.

ORIGINALITY/VALUE

This article is the first one to systematically describe the value of open innovation in healthcare. The authors challenge the positivist approach in value presented by value-based healthcare. The authors show how openness contributes to addressing the resource crisis by involving new stakeholders and resources in the care delivery process.

Users' involvement in digital health collaborative projects

PURPOSE

This research analyzes the roles of users in innovative digital health collaborative projects from the perspective of the user by considering three dimensions: their motivation, project activities and the support of the partnership for their effective involvement.

DESIGN/METHODOLOGY/APPROACH

The authors unraveled profiles of users by using a Q-methodological analysis of 24 statements and 44 service users. The statements for the three dimensions were designed according to previous models of stakeholder identification and customer participation in new product management.

FINDINGS

The authors obtained two profiles that advocate active participation of users, though with a different degree of involvement. One of them supports the role of users as "advisors" of users' preferences and needs, and the other indicates a higher involvement of users as "cocreators" of the innovation, with the same contribution and responsibility as the other partners.

ORIGINALITY/VALUE

Previous research has analyzed user involvement in digital health, as part of wider research on factors leading to the success and adoption of innovations. Moreover, previous research has analyzed user involvement in innovation projects, but without differentiating between projects carried out by an individual organization and those conducted by a partnership. This research contributes to filling this gap by revealing users' expectations about their involvement and how they think they will fit in with the dynamics of collaborative projects.

Walk a mile in my shoes: perspectives towards sharing of health and experience data among individuals living with sickle cell disorder

Background

Advancements in digital health technologies (DHTs) mean people are increasingly recording and managing personal health data. As observed during the COVID-19 pandemic, sharing of such data may provide unrivalled opportunities in advancing our understanding of conditions otherwise poorly understood, including rare conditions.

Methods

A semi-structured focus group (n=25) explored perspectives and experiences of sharing health data among those with a group of rare haematological conditions, sickle cell disorder (SCD). The focus group explored (I) what 'feeling well' looks like; (II) how this could be monitored using DHTs; (III) which data healthcare professionals (HCPs) should pay greater attention to and; (IV) types of data willing to be shared, with whom, and under which conditions. Key themes were further assessed via an online survey (n=50).

Results

Patient-relevant measures of condition-management focused on "everything else that comes with" SCD, suggesting HCPs did not pay sufficient attention to day-to-day symptom variability. This was juxtaposed against the "fixed and one-off" electronic health record (EHR), collecting pre-specified data at pre-determined snapshots of time, not considered reflective of outcomes associated with "feeling well" day-to-day. Forty-four-point-seven percent of respondents had previously shared health data. Most were willing to share data concerning symptoms and health service utilisation, but were less willing to share genomic and EHR data. Sixty-one-point-seven percent believed HCPs did not pay enough attention to daily fluctuations in mental and physical health. Financial benefits (74.5%), trust in organisations seeking data (72.3%), and knowing how data will be used (61.7%) were key facilitators of data sharing. Seventy-one percent, 70% and 65.2% had not previously shared health data with the pharmaceutical industry, charitable organisations and digital health interventions respectively, but were open to doing so in the future.

Conclusions

Those living with the rare condition SCD were supportive of collecting and sharing data to foster research and improve understanding and outcomes. However, specific requirements were identified to respect privacy and informational needs regarding future use of data. DHTs can be a valuable tool in improving understanding of the day-to-day impact of health conditions, but understanding patient needs is critical in ensuring involvement in the process, as not all data types are considered of equal value, benefit, or risk.

Co-producing digital mental health interventions: A systematic review

Objective

Smartphone apps (apps) are widely recognised as promising tools for improving access to mental healthcare. However, a key challenge is the development of digital interventions that are acceptable to end users. Co-production with providers and stakeholders is increasingly positioned as the gold standard for improving uptake, engagement, and healthcare outcomes. Nevertheless, clear guidance around the process of co-production is lacking. The objectives of this review were to: (i) present an overview of the methods and approaches to co-production when designing, producing, and evaluating digital mental health interventions; and (ii) explore the barriers and facilitators affecting co-production in this context.

Methods

A pre-registered (CRD42023414007) systematic review was completed in accordance with The Preferred Reporting Items for Systematic reviews and Meta-Analyses guidelines. Five databases were searched. A co-produced bespoke quality appraisal tool was developed with an expert by experience to assess the quality of the co-production methods and approaches. A narrative synthesis was conducted.

Results

Twenty-six studies across 24 digital mental health interventions met inclusion criteria. App interventions were rarely co-produced with end users throughout all stages of design, development, and evaluation. Co-producing digital mental health interventions added value by creating culturally sensitive and acceptable interventions. Reported challenges included resource issues exacerbated by the digital nature of the intervention, variability across stakeholder suggestions, and power imbalances between stakeholders and researchers.

Conclusions

Variation in approaches to co-producing digital mental health interventions is evident, with inconsistencies between stakeholder groups involved, stage of involvement, stakeholders' roles and methods employed.

Citizen science to improve patient and public involvement in GUideline Implementation in oral health and DEntistry (the GUIDE platform)

BACKGROUND

Citizen science is a way to democratise science by involving groups of citizens in the research process. Clinical guidelines are used to improve practice, but their implementation can be limited. Involving patients and the public can enhance guideline implementation, but there is uncertainty about the best approaches to achieve this. Citizen science is a potential way to involve patients and the public in improving clinical guideline implementation. We aimed to explore the application of citizen science methods to involve patients and the public in the dissemination and implementation of clinical guidelines in oral health and dentistry.

METHODS

We developed GUIDE (GUideline Implementation in oral health and DEntistry), a citizen science online platform, using a participatory approach with researchers, oral health professionals, guideline developers and citizens. Recruitment was conducted exclusively online. The platform focused on prespecified challenges related to oral health assessment guidelines, and asked citizens to generate ideas, as well as vote and comment on other citizens' ideas to improve those challenges. Citizens also shared their views via surveys and two online synchronous group meetings. Data were collected on participant's demographics, platform engagement and experience of taking part. The most promising idea category was identified by an advisory group based on engagement, feasibility and relevance. We presented quantitative data using descriptive statistics and analysed qualitative data using inductive and deductive thematic analysis.

RESULTS

The platform was open for 6 months and we recruited 189 citizens, from which over 90 citizens actively engaged with the platform. Most citizens were over 34 years (64%), female (58%) and had a university degree (50%). They generated 128 ideas, 146 comments and 248 votes. The challenge that led to most engagement was related to prevention and oral health self-care. To take this challenge forward, citizens generated a further 36 ideas to improve a pre-existing National Health Service oral care prevention leaflet. Citizens discussed motivations to take part in the platform (understanding, values, self-care), reasons to stay engaged (communication and feedback, outputs and impact, and relevance of topics discussed) and suggestions to improve future platforms.

CONCLUSION

Citizen science is an effective approach to generate and prioritise ideas from a group of citizens to improve oral health and dental services. Prevention and oral health self-care were of particular interest to citizens. More research is needed to ensure recruitment of a diverse group of citizens and to improve retention in citizen science projects.

PATIENT OR PUBLIC CONTRIBUTION

This project was inherently conducted with the input of public partners (citizen scientists) in all key aspects of its conduct and interpretation. In addition, two public partners were part of the research team and contributed to the design of the project, as well as key decisions related to its conduct, analysis, interpretation and dissemination and are co-authors of this manuscript.

Association Between the Characteristics of mHealth Apps and User Input During Development and Testing: Secondary Analysis of App Assessment Data

BACKGROUND

User involvement is increasingly acknowledged as a central part of health care innovation. However, meaningful user involvement during the development and testing of mobile health apps is often not fully realized.

OBJECTIVE

This study aims to examine in which areas user input is most prevalent and whether there is an association between user inclusion and compliance with best practices for mobile health apps.

METHODS

A secondary analysis was conducted on an assessment data set of 1595 health apps. The data set contained information on whether the apps had been developed or tested with user input and whether they followed best practices across several domains. Background information was also available regarding the apps' country of origin, targeted condition areas, subjective user ratings, download numbers, and risk (as per the National Institute for Health and Care Excellence Evidence Standards Framework [ESF]). Descriptive statistics, Mann-Whitney U tests, and Pearson chi-square analyses were applied to the data.

RESULTS

User involvement was reported by 8.71% (139/1595) of apps for only the development phase, by 33.67% (537/1595) of apps for only the testing phase, by 21.88% (349/1595) of apps for both phases, and by 35.74% (570/1595) of apps for neither phase. The highest percentage of health apps with reported user input during development was observed in Denmark (19/24, 79%); in the condition areas of diabetes (38/79, 48%), cardiology (15/32, 47%), pain management (20/43, 47%), and oncology (25/54, 46%); and for high app risk (ESF tier 3a; 105/263, 39.9%). The highest percentage of health apps with reported user input during testing was observed in Belgium (10/11, 91%), Sweden (29/34, 85%), and France (13/16, 81%); in the condition areas of neurodiversity (42/52, 81%), respiratory health (58/76, 76%), cardiology (23/32, 72%), and diabetes (56/79, 71%); and for high app risk (ESF tier 3a; 176/263, 66.9%). Notably, apps that reported seeking user input during testing demonstrated significantly more downloads than those that did not (P=.008), and user inclusion was associated with better compliance with best practices in clinical assurance, data privacy, risk management, and user experience.

CONCLUSIONS

The countries and condition areas in which the highest percentage of health apps with user involvement were observed tended to be those with higher digital maturity in health care and more funding availability, respectively. This suggests that there may be a trade-off between developers' willingness or ability to involve users and the need to meet challenges arising from infrastructure limitations and financial constraints. Moreover, the finding of a positive association between user inclusion and compliance with best practices indicates that, where no other guidance is available, users may benefit from prioritizing health apps developed with user input as the latter may be a proxy for broader app quality.

[Digital transformation as a strategy to strengthen essential public health functions in the AmericasTransformação digital como estratégia de fortalecimento das funções essenciais de saúde pública nas Américas]

This article systematizes the main actions taken to address the essential public health functions (EPHF) in the context of the digital transformation of health systems. A narrative review was conducted, in which the conceptual framework of the renewed EPHF was linked to the eight guiding principles of the digital transformation of the health sector.In the selected publications, the main actions in digital transformation included electronic health records, telemedicine, digital health legislation, digital literacy, patient portals, open-source technologies, and data governance. These actions make it possible to increase the quality and efficiency of health systems, promote accessibility, and improve health outcomes.

Developing a Women's Thought Collective methodology for health research: The roles and responsibilities of researchers in the reflexive co-production of knowledge

BACKGROUND

Co-produced research holds enormous value within the health sciences. Yet, there can be a heavy focus on what research participants think, do and know; while the researcher's responsibility to explore and re/work their own knowledge or praxis tends to escape from view. This is reflected in the limited use of co-production to explore broad structural distributions of health and risk(s). We argue this missed opportunity has the potential to unfold as what Berlant calls a 'cruel optimism', where something desirable becomes an obstacle to flourishing and/or produces harm. We explore challenges to involving lay populations meaningfully in health research amidst a neoliberal cultural landscape that tends to responsibilise people with problems they cannot solve.

METHODS AND FINDINGS

Drawing together principles from hermeneutic and feminist philosophy, we develop a novel methodology for co-producing research about determinants of health and health risk (using a case study of alcohol consumption as an example) that centres on what researchers do, know and think during research: Women's Thought Collectives.

DISCUSSION

Keeping the constructed nature of social systems-because they shape ideas of value, expertise and knowledge-in view during co-produced research illuminates the potential for cruel optimisms within it. Such reflexive awareness carves out starting points for researchers to engage with how social hierarchies might (tacitly) operate during the co-production of knowledge. Our work has broad utility for diverse population groups and provides important considerations around the roles and responsibilities for reflexive co-production of knowledge at all levels of health systems.

PATIENT OR PUBLIC CONTRIBUTION

The development of these ideas was sparked by working with lay participants during the Women's Thought Collectives for Kristen Foley's doctoral research 2021-2023, but undertaken without their direct involvement-in accordance with the responsibilities of researchers in the reflexive co-production of knowledge. Forthcoming publications will address the outcomes and processes of this work.

Needs and demands for mHealth cardiac health promotion among individuals with cardiac diseases: a patient-centred design approach

Aims

Cardiovascular diseases are one of the main contributors to disability and mortality worldwide. Meanwhile, risk factors can be modified by lifestyle changes. mHealth is an innovative and effective way to deliver cardiac health promotion. This study aims to examine the needs and demands regarding the design and contents of an mHealth intervention for cardiac health promotion among individuals with cardiac diseases. Different clusters were determined and analysed in terms of the intention to use an mHealth intervention.

Methods and results

A cross-sectional study was conducted via a web-based survey. Three hundred and four individuals with coronary artery diseases (CADs) and/or congestive heart failure (CHF) were included in the data analysis. Descriptive statistics were applied to evaluate needs and demands regarding an mHealth intervention. A k-medoids cluster analysis was performed. Individuals with CAD and CHF favoured an mHealth intervention that supports its users permanently and is easily integrated into everyday life. Handheld devices and content formats that involve active user participation and regular updates were preferred. Three clusters were observed and labelled high, moderate, and low burden, according to their psychometric properties. The high burden cluster indicated higher behavioural intention towards use of an mHealth intervention than the other clusters.

Conclusion

The results of the study are a valuable foundation for the development of an mHealth intervention for cardiac health promotion following a user-centred design approach. Individuals with cardiac diseases report positive attitudes in the form of high usage intention regarding mHealth. Highly burdened individuals report a high intention to use such interventions.

Measurement and outcomes of co-production in health and social care: a systematic review of empirical studies

BACKGROUND

Co-production is promoted as an effective way of improving the quality of health and social care but the diversity of measures used in individual studies makes their outcomes difficult to interpret.

OBJECTIVE

The objective is to explore how empirical studies in health and social care have described the outcomes of co-production projects and how those outcomes were measured.

DESIGN AND METHODS

A scoping review forms the basis for this systematic review. Search terms for the concepts (co-produc* OR coproduc* OR co-design* OR codesign*) and contexts (health OR 'public service* OR "public sector") were used in: CINAHL with Full Text (EBSCOHost), Cochrane Central Register of Controlled trials (Wiley), MEDLINE (EBSCOHost), PsycINFO (ProQuest), PubMed (legacy) and Scopus (Elsevier). There was no date limit. Papers describing the process, original data and outcomes of co-production were included. Protocols, reviews and theoretical, conceptual and psychometric papers were excluded. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses guideline was followed. The Mixed Methods Appraisal Tool underpinned the quality of included papers.

RESULTS

43 empirical studies were included. They were conducted in 12 countries, with the UK representing >50% of all papers. No paper was excluded due to the Mixed Methods Quality Appraisal screening and 60% of included papers were mixed methods studies. The extensive use of self-developed study-specific measures hampered comparisons and cumulative knowledge-building. Overall, the studies reported positive outcomes. Co-production was reported to be positively experienced and provided important learning.

CONCLUSIONS

The lack of common approaches to measuring co-production is more problematic than the plurality of measurements itself. Co-production should be measured from three perspectives: outputs of co-production processes, the experiences of participating in co-production processes and outcomes of co-production. Both self-developed study-specific measures and established measures should be used. The maturity of this research field would benefit from the development and use of reporting guidelines.

Readiness for implementation of novel digital health interventions for postoperative monitoring: a systematic review and clinical innovation network analysis

An increasing number of digital health interventions (DHIs) for remote postoperative monitoring have been developed and evaluated. This systematic review identifies DHIs for postoperative monitoring and evaluates their readiness for implementation into routine health care. Studies were defined according to idea, development, exploration, assessment, and long-term follow-up (IDEAL) stages of innovation. A novel clinical innovation network analysis used coauthorship and citations to examine collaboration and progression within the field. 126 DHIs were identified, with 101 (80%) being early stage innovations (IDEAL stage 1 and 2a). None of the DHIs identified had large-scale routine implementation. There is little evidence of collaboration, and there are clear omissions in the evaluation of feasibility, accessibility, and the health-care impact. Use of DHIs for postoperative monitoring remains at an early stage of innovation, with promising but generally low-quality supporting evidence. Comprehensive evaluation within high-quality, large-scale trials and real-world data are required to definitively establish readiness for routine implementation.

Research Buddy partnership in a MD-PhD program: lessons learned

BACKGROUND AND AIMS

There is increasing recognition of the importance of patient involvement in research. In recent years, there has also been growing interest in patient partnerships with doctoral studies students. However, it can be difficult to know where to start and how to go about such involvement activities. The purpose of this perspective piece was to share experiential insight of the experience of a patient involvement program such that others can learn from this experience. BODY: This is a co-authored perspective piece centred on the experience of MGH, a patient who has had hip replacement surgery, and DG, a medical student completing a PhD, participating in a Research Buddy partnership over the course of over 3 years. The context in which this partnership took place was also described to facilitate comparison with readers' own circumstances and contexts. DG and MGH met regularly to discuss, and work together on, various aspects of DG's PhD research project. Reflexive thematic analysis was conducted on reflections from DG and MGH regarding their experience in the Research Buddy program to synthesise nine lessons which were then corroborated with reference to published literature on patient involvement in research. These lessons were: learn from experience; tailor the program; get involved early; embrace uniqueness; meet regularly; build rapport; ensure mutual benefit; broad involvement; regularly reflect and review.

CONCLUSIONS

In this perspective piece, a patient and a medical student completing a PhD reflected upon their experience co-designing a Research Buddy partnership within a patient involvement program. A series of nine lessons was identified and presented to inform readers seeking to develop or enhance their own patient involvement programs. Researcher-patient rapport is foundational to all other aspects of the patient's involvement.

Digital technologies in routine palliative care delivery: an exploratory qualitative study with health care professionals in Germany

OBJECTIVE

To explore health care professionals' (HCPs) perspectives, experiences and preferences towards digital technology use in routine palliative care delivery.

METHODS

HCPs (n = 19) purposively selected from a sample of settings that reflect routine palliative care delivery (i.e. specialized outpatient palliative care, inpatient palliative care, inpatient hospice care in both rural and urban areas of the German states of Brandenburg and Berlin) participated in an explorative, qualitative study using semi-structured interviews. Interview data were analyzed using structured qualitative content analysis.

RESULTS

Digital technologies are widely used in routine palliative care and are well accepted by HCPs. Central functions of digital technologies as experienced in palliative care are coordination of work processes, patient-centered care, and communication. Especially in outpatient care, they facilitate overcoming spatial and temporal distances. HCPs attribute various benefits to digital technologies that contribute to better coordinated, faster, more responsive, and overall more effective palliative care. Simultaneously, participants preferred technology as an enhancement not replacement of care delivery. HCPs fear that digital technologies, if overused, will contribute to dehumanization and thus significantly reduce the quality of palliative care.

CONCLUSION

Digital technology is already an essential part of routine palliative care delivery. While generally perceived as useful by HCPs, digital technologies are considered as having limitations and carrying risks. Hence, their use and consequences must be carefully considered, as they should discreetly complement but not replace human interaction in palliative care delivery.