Design and evaluation in eHealth: challenges and implications for an interdisciplinary field

Designing digital patient experiences: The digital health design framework

BACKGROUND

Digital health (DH) brings considerable benefits, but it comes with potential risks. Human Factors (HF) play a critical role in providing high-quality and acceptable DH solutions. Consultation with designers is crucial for reflecting on and improving current DH design practices.

OBJECTIVES

We investigated the general DH design processes, challenges, and corresponding strategies that can improve the digital patient experience (PEx).

METHODS

A semi-structured interview study with 24 design professionals. All audio recordings were transcribed, deidentified, grammatically corrected, and imported into ATLAS.ti for data analysis. Three coders participated in data coding following the thematic analysis approach.

RESULTS

We identified eight DH design stages and grouped them into four phases: preparation, problem-thinking, problem-solving, and implementation. The analysis presented twelve design challenges associated with contextual, practical, managerial, and commercial aspects that can hinder the design process. We identified eight common strategies used by respondents to tackle these challenges.

CONCLUSIONS

We propose a Digital Health Design (DHD) framework to improve the digital PEx. It provides an overview of design deliverables, activities, stakeholders, challenges, and corresponding strategies for each design stage.

Identifying app components that promote physical activity: a group concept mapping study

Background

Digital interventions are a promising avenue to promote physical activity in healthy adults. Current practices recommend to include end-users early on in the development process. This study focuses on the wishes and needs of users regarding an a mobile health (mHealth) application that promotes physical activity in healthy adults, and on the differences between participants who do or do not meet the World Health Organization's recommendation of an equivalent of 150 minutes of moderate intensity physical activity.

Methods

We used a mixed-method design called Group Concept Mapping. In a first phase, we collected statements completing the prompt "In an app that helps me move more, I would like to see/ do/ learn the following…" during four brainstorming sessions with physically inactive individuals (n = 19). The resulting 90 statements were then sorted and rated by a new group of participants (n = 46). Sorting data was aggregated, and (dis)similarity matrices were created using multidimensional scaling. Hierarchical clustering was applied using Ward's method. Analyses were carried out for the entire group, a subgroup of active participants and a subgroup of inactive participants. Explorative analyses further investigated ratings of the clusters as a function of activity level, gender, age and education.

Results

Six clusters of statements were identified, namely 'Ease-of-use and Self-monitoring', 'Technical Aspects and Advertisement', 'Personalised Information and Support', 'Motivational Aspects', 'Goal setting, goal review and rewards', and 'Social Features'. The cluster 'Ease-of-use and Self-monitoring' was rated highest in the overall group and the active subgroup, whereas the cluster 'Technical Aspects and Advertisement' was scored as most relevant in the inactive subgroup. For all groups, the cluster 'Social Features' was scored the lowest. Explorative analysis revealed minor between-group differences.

Discussion

The present study identified priorities of users for an mHealth application that promotes physical activity. First, the application should be user-friendly and accessible. Second, the application should provide personalized support and information. Third, users should be able to monitor their behaviour and compare their current activity to their past performance. Fourth, users should be provided autonomy within the app, such as over which and how many notifications they would like to receive, and whether or not they want to engage with social features. These priorities can serve as guiding principles for developing mHealth applications to promote physical activity in the general population.

Design as a quality improvement strategy: The case for design expertise

Bad design in safety-critical environments like healthcare can lead to users being frustrated, excluded or injured. In contrast, good design can make it easier to use a service correctly, with impacts on both the safety and efficiency of healthcare delivery, as well as the experience of patients and staff. The participative dimension of design as an improvement strategy has recently gained traction in the healthcare quality improvement literature. However, the role of design expertise and professional design has been much less explored. Good design does not happen by accident: it takes expertise and the specific reasoning that expert designers develop through practical experience and training. Here, we define design, show why poor design can be disastrous and illustrate the benefits of good design. We argue for the recognition of distinctive design expertise and describe some of its characteristics. Finally, we discuss how design could be better promoted in healthcare improvement.

Action Opportunities to Pursue Responsible Digital Care for People With Intellectual Disabilities: Qualitative Study

BACKGROUND

Responsible digital care refers to any intentional systematic effort designed to increase the likelihood of a digital care technology developed through ethical decision-making, being socially responsible and aligned with the values and well-being of those impacted by it.

OBJECTIVE

We aimed to present examples of action opportunities for (1) designing "technology"; (2) shaping the "context" of use; and (3) adjusting the behavior of "users" to guide responsible digital care for people with intellectual disabilities.

METHODS

Three cases were considered: (1) design of a web application to support the preparation of meals for groups of people with intellectual disabilities, (2) implementation of an app to help people with intellectual disabilities regulate their stress independently, and (3) implementation of a social robot to stimulate interaction and physical activity among people with intellectual disabilities. Overall, 26 stakeholders participated in 3 multistakeholder workshops (case 1: 10/26, 38%; case 2: 10/26, 38%; case 3: 6/26, 23%) based on the "guidance ethics approach." We identified stakeholders' values based on bottom-up exploration of experienced and expected effects of using the technology, and we formulated action opportunities for these values in the specific context of use. Qualitative data were analyzed thematically.

RESULTS

Overall, 232 effects, 33 values, and 156 action opportunities were collected. General and case-specific themes were identified. Important stakeholder values included quality of care, autonomy, efficiency, health, enjoyment, reliability, and privacy. Both positive and negative effects could underlie stakeholders' values and influence the development of action opportunities. Action opportunities comprised the following: (1) technology: development of the technology (eg, user experience and customization), technology input (eg, recipes for meals, intervention options for reducing stress, and activities), and technology output (eg, storage and use of data); (2) context: guidelines, training and support, policy or agreements, and adjusting the physical environment in which the technology is used; and (3) users: integrating the technology into daily care practice, by diminishing (eg, "letting go" to increase the autonomy of people with intellectual disabilities), retaining (eg, face-to-face contact), and adding (eg, evaluation moments) certain behaviors of care professionals.

CONCLUSIONS

This is the first study to provide insight into responsible digital care for people with intellectual disabilities by means of bottom-up exploration of action opportunities to take account of stakeholders' values in designing technology, shaping the context of use, and adjusting the behavior of users. Although part of the findings may be generalized, case-specific insights and a complementary top-down approach (eg, predefined ethical frameworks) are essential. The findings represent a part of an ethical discourse that requires follow-up to meet the dynamism of stakeholders' values and further develop and implement action opportunities to achieve socially desirable, ethically acceptable, and sustainable digital care that improves the lives of people with intellectual disabilities.

Development of a digital intervention for psychedelic preparation (DIPP)

Psychedelic substances induce profound alterations in consciousness. Careful preparation is therefore essential to limit adverse reactions, enhance therapeutic benefits, and maintain user safety. This paper describes the development of a self-directed, digital intervention for psychedelic preparation. Drawing on elements from the UK Medical Research Council (MRC) framework for developing complex interventions, the design was informed by a four-factor model of psychedelic preparedness, using a person-centred approach. Our mixed-methods investigation consisted of two studies. The first involved interviews with 19 participants who had previously attended a 'high-dose' psilocybin retreat, systematically exploring their preparation behaviours and perspectives on the proposed intervention. The second study engaged 28 attendees of an ongoing psilocybin retreat in co-design workshops, refining the intervention protocol using insights from the initial interviews. The outcome is a co-produced 21-day digital course (Digital Intervention for Psychedelic Preparation (DIPP)), that is organised into four modules: Knowledge-Expectation, Psychophysical-Readiness, Safety-Planning, and Intention-Preparation. Fundamental components of the course include daily meditation practice, supplementary exercises tied to the weekly modules, and mood tracking. DIPP provides a comprehensive and scalable solution to enhance psychedelic preparedness, aligning with the broader shift towards digital mental health interventions.

From digital health to learning health systems: four approaches to using data for digital health design

Digital health technologies, powered by digital data, provide an opportunity to improve the efficacy and efficiency of health systems at large. However, little is known about different approaches to the use of data for digital health design, or about their possible relations to system-level dynamics. In this contribution, we identify four existing approaches to the use of data for digital health design, namely the silent, the overt, the data-enabled, and the convergent. After characterising the approaches, we provide real-life examples of each. Furthermore, we compare the approaches in terms of selected desirable characteristics of the design process, highlighting relative advantages and disadvantages. Finally, we reflect on the system-level relevance of the differentiation between the approaches and point towards future research directions. Overall, the contribution provides researchers and practitioners with a broad conceptual framework to examine data-related challenges and opportunities in digital health design.

Economic Evaluations of Digital Health Interventions for Children and Adolescents: Systematic Review

BACKGROUND

Digital health interventions (DHIs) are defined as digital technologies such as digital health applications and information and communications technology systems (including SMS text messages) implemented to meet health objectives. DHIs implemented using various technologies, ranging from electronic medical records to videoconferencing systems and mobile apps, have experienced substantial growth and uptake in recent years. Although the clinical effectiveness of DHIs for children and adolescents has been relatively well studied, much less is known about the cost-effectiveness of these interventions.

OBJECTIVE

This study aimed to systematically review economic evaluations of DHIs for pediatric and adolescent populations. This study also reviewed methodological issues specific to economic evaluations of DHIs to inform future research priorities.

METHODS

We conducted a database search in PubMed from 2011 to 2021 using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist. In total, 2 authors independently screened the titles and abstracts of the search results to identify studies eligible for full-text review. We generated a data abstraction procedure based on recommendations from the Panel on Cost-Effectiveness in Health and Medicine. The types of economic evaluations included in this review were cost-effectiveness analyses (costs per clinical effect), cost-benefit analyses (costs and effects expressed in monetary terms as net benefit), and cost-utility analyses (cost per quality-adjusted life year or disability-adjusted life year). Narrative analysis was used to synthesize the quantitative data because of heterogeneity across the studies. We extracted methodological issues related to study design, analysis framework, cost and outcome measurement, and methodological assumptions regarding the health economic evaluation.

RESULTS

We included 22 articles assessing the cost-effectiveness of DHI interventions for children and adolescents. Most articles (14/22, 64%) evaluated interventions delivered through web-based portals or SMS text messaging, most frequently within the health care specialties of mental health and maternal, newborn, and child health. In 82% (18/22) of the studies, DHIs were found to be cost-effective or cost saving compared with the nondigital standard of care. The key drivers of cost-effectiveness included population coverage, cost components, intervention effect size and scale-up, and study perspective. The most frequently identified methodological challenges were related to study design (17/22, 77%), costing (11/22, 50%), and economic modeling (9/22, 41%).

CONCLUSIONS

This is the first systematic review of economic evaluations of DHIs targeting pediatric and adolescent populations. We found that most DHIs (18/22, 82%) for children and adolescents were cost-effective or cost saving compared with the nondigital standard of care. In addition, this review identified key methodological challenges directly related to the conduct of economic evaluations of DHIs and highlighted areas where further methodological research is required to address these challenges. These included the need for measurement of user involvement and indirect effects of DHIs and the development of children-specific, generic quality-of-life outcomes.

Self-Administered Virtual Reality for Postsurgical Pain Management: A Qualitative Study of Hospital Patients' Reported Experiences

Virtual Reality (VR) has been shown to effectively reduce pain in patients with various pain conditions. However, questions arise on the use of VR in multimodal postsurgical pain management. Optimizing VR for pain management requires an understanding of intervention- and context-specific factors, based on patients' needs and expectations after major surgery. This substudy is part of a randomized controlled trial investigating the effects of three VR interventions as an add-on, self-administered treatment for postsurgical pain. Semi-structured interviews were conducted to evaluate VR effects, software, hardware, prescriptions, and factors affecting the implementation of VR. Experiences across interventions were compared to identify relevant factors for successful implementation. Patients benefitted from self-administered VR in postsurgical pain management in various aspects and without serious drawbacks. Participants preferred an intuitive, 3D, 360-degree VR device with a large choice of applications matching their interests. The preferred frequency and duration of VR use was 2-3 sessions a day for 10-15 min each. Adjusting the VR use to individuals' needs and contexts was reported to be key for successful implementation, with attention paid to improving the awareness of VR as a non-pharmacological means of promoting postsurgical recovery among patients and healthcare professionals.

Cocreation to Facilitate Communication and Collaboration Between Multidisciplinary Stakeholders in eHealth Research and Development: Case Study of the CARRIER (Coronary Artery Disease: Risk Estimations and Interventions for Prevention and Early Detection) Consortium

BACKGROUND

Collaboration with diverse stakeholders in eHealth research is fundamental yet complex. Stakeholders from various disciplines do not "speak the same language" and have different levels of power and interest, resulting in contrasting objectives, priorities, and expectations. An approach to constructive communication and collaboration is necessary to overcome this complex dynamic. Cocreation, known in the field of eHealth most often to involve end users, may also be suitable for facilitating stakeholder engagement and alignment.

OBJECTIVE

This paper provides insights into the application of cocreation, specifically in the early phases of research that focus on involving and aligning relevant stakeholders from different academic and professional backgrounds.

METHODS

The case for this study was a group discussion with members of a multidisciplinary consortium that works on developing a personalized eHealth intervention for atherosclerotic cardiovascular disease. Using stakeholder mapping, health and medicine experts, big data scientists, software developers, and an innovation manager (N=8) were invited to participate. The discussion was based on a user scenario and structured according to the Six Thinking Hats of de Bono, representing 6 different types of thinking. The discussion was recorded, transcribed verbatim, and analyzed thematically with the use of ATLAS.ti software.

RESULTS

First, informative and intuitive thinking served the preparatory purpose of familiarization with the project details and other participants. Second, positive and critical thinking constituted the body of the discussion and resulted in an in-depth conversation. Third, creative and organizational thinking were action oriented and focused on solutions and planning to safeguard future progress. The participants repeatedly reflected on various intervention-related themes, ranging from intervention content to technical functionalities and from legal requirements to implementation in practice. Moreover, project-related matters were discussed, including stakeholder management and time and budget constraints.

CONCLUSIONS

This paper demonstrates how cocreation can be of value for multidisciplinary stakeholder engagement and alignment. Based on stakeholder mapping (with whom to discuss), a dream user scenario (what to discuss), and the Six Thinking Hats of de Bono (how to discuss), the participants shared information, discussed differences, searched for solutions, and moved toward a collective approach regarding intervention development. The lessons learned may further improve the understanding of how cocreation can contribute to multidisciplinary collaboration.

A Computational Platform to Support the Detection, Follow-up, and Epidemiological Surveillance of Mental Health and Substance Use Disorders: Protocol for a Development and Evaluation Study

BACKGROUND

According to the World Health Organization, approximately 15% of the global population is affected by mental health or substance use disorders. These conditions contribute significantly to the global disease burden, which has worsened because of the direct and indirect effects of COVID-19. In Mexico, a quarter of the population between the ages of 18 and 65 years who reside in urban areas present a mental health condition. The presence of a mental or substance abuse disorder is behind a significant percentage of suicidal behaviors in Mexico, where only 1 in 5 of those who have these disorders receive any treatment.

OBJECTIVE

This study aims to develop, deploy, and evaluate a computational platform to support the early detection and intervention of mental and substance use disorders in secondary and high schools as well as primary care units. The platform also aims to facilitate monitoring, treatment, and epidemiological surveillance ultimately helping specialized health units at the secondary level of care.

METHODS

The development and evaluation of the proposed computational platform will run during 3 stages. In stage 1, the identification of the functional and user requirements and the implementation of the modules to support the screening, follow-up, treatment, and epidemiological surveillance will be performed. In stage 2, the initial deployment of the screening module will be carried out in a set of secondary and high schools, as well as the deployment of the modules to support the follow-up, treatment, and epidemiological surveillance processes in primary and secondary care health units. In parallel, during stage 2, patient applications to support early interventions and continuous monitoring will also be developed. Finally, during stage 3, the deployment of the complete platform will be performed jointly with a quantitative and qualitative evaluation.

RESULTS

The screening process has started, and 6 schools have been currently enrolled. As of February 2023, a total of 1501 students have undergone screening, and the referral of those students presenting a risk in mental health or substance use to primary care units has also started. The development, deployment, and evaluation of all the modules of the proposed platform are expected to be completed by late 2024.

CONCLUSIONS

The expected results of this study are to impact a better integration between the different levels of health care, from early detection to follow-up and epidemiological surveillance of mental and substance use disorders contributing to reducing the gap in the attention to these problems in the community.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/44607.

Using QR Codes as a Form of eHealth to Promote Health Among Women in a Pandemic: Cross-sectional Study

Background

QR codes have played an integral role during the pandemic in many sectors, but their use has been limited in the health care sector, especially by patients. Although some authors have stated that developing specific content for women on how to cope with health problems could be an effective way to prevent problems, especially during pandemics, there is little research regarding the use of QR codes to promote health during a pandemic, and even fewer studies are focused on women. Moreover, although the importance of assessing these interventions from the users’ perspective has been stated, research carried out from this point of view is still scarce.

Objective

This study aimed to assess the usefulness of using QR codes with information to promote women’s health in the context of a pandemic. We also sought to design and validate a questionnaire to assess this.

Methods

A cross-sectional study was conducted among women in the gynecology waiting rooms of a reference hospital. Exploratory factorial analysis with the split-half method and Cronbach α values was performed for questionnaire validation. Univariant and bivariant analyses were performed to analyze the data obtained.

Results

In total, 186 women took part in the study. Exploratory factor analysis identified 2 domains: usability and applicability in medical practice. The Cronbach α value was .81. Overall, 83.7% of the answers to the first domain and 56.4% of those to the second were favorable. Women with university education or those who had used QR codes before scored better in the usability domain, while no differences were observed in the applicability scores.

Conclusions

Using QR codes in the gynecology clinics’ waiting rooms can help promote women’s health during a pandemic, regardless of their education level or whether they have used QR codes before. The questionnaire developed herein is a helpful tool to assess this. These findings are important for clinical practice. This research can be performed in other ambits, specialties, or countries.

How Digital Therapeutics Are Urging the Need for a Paradigm Shift: From Evidence-Based Health Care to Evidence-Based Well-being

A scientific paradigm consists of a set of shared rules, beliefs, values, methods, and instruments for addressing scientific problems. Currently, health care embraces the paradigm of evidence-based health care (EBH). This paradigm prompts health care institutions to base decisions on the best available evidence, which is commonly generated in large-scale randomized controlled trials. We illustrate the application of EBH via the evaluation of drugs. We show how EBH is challenged when it is applied to the evaluation of digital therapeutics, which refers to technology and data to prevent, manage, or treat a medical disorder or disease. We conclude that amid the growing application of digital therapeutics, the paradigm of EBH is challenged in four domains: population, intervention, comparison, outcome. In the second part of this viewpoint, we argue for a paradigm shift in health care so we can optimally evaluate and implement digital therapeutics, and we sketch out the contours of this novel paradigm. We address the need for considering design in health care and evaluation processes, studying user values so that health care can move from a focus on health to well-being, focusing on individual experiences rather than the average, addressing the need for evaluation in authentic use contexts, and stressing the need for continuous evaluation of the dynamic relations between users, context, and digital therapeutics. We conclude that the transition from EBH toward evidence-based well-being would improve the successful implementation of digital technologies in health care.

Exploring the feasibility of a network of organizations for pain rehabilitation: What are the lessons learned?

BACKGROUND AND AIMS

Integration of care is lacking for chronic musculoskeletal pain patients. Network Pain Rehabilitation Limburg, a transmural health care network, has been designed to provide integrated rehabilitation care from a biopsychosocial perspective to improve patients' levels of functioning. This feasibility study aims to provide insight into barriers and facilitators for the development, implementation, and transferability.

METHODS

This study was conducted with a three-phase iterative and incremental design from October 2017 to October 2018. The network comprises two rehabilitation practices, and three local primary care networks, with a general practitioner together with, a mental health practice nurse, and a physiotherapist or exercise therapist. These stakeholders with a random sample of participating patients took part in evaluations, consisting of interviews, focus groups, and observations. Field notes and observations were recorded during meetings. The Consolidated Framework for Implementation Research guided data collection and analysis. Results were used to refine the next phase.

RESULTS

According to health care professionals, guidelines and treatment protocols facilitate consistency and transparency in collaboration, biopsychosocial language, and treatment. One mentioned barrier is the stigmatization of chronic pain by the general population. In regular care, approaches are often more biomedical than biopsychosocial, causing patients to resist participating. The current organization of health care acts as a barrier, complicating implementation between and within practices. Health care professionals were enthusiastic about the iterative, bottom-up development. A critical mass of participating organizations is needed for proper implementation.

CONCLUSION

Network Pain Rehabilitation Limburg is feasible in daily practice if barriers are overcome and facilitators of development, implementation, and transferability are promoted. These findings will be used to refine Network Pain Rehabilitation Limburg. A large-scale process and effect evaluation will be performed. Our implementation strategies and results may assist other health care organizations aspiring to implement a transmural network using a similar model.

TRAIL REGISTRATION

Registration number: NTR6654 or https://trialsearch.who.int/Trial2.aspx?TrialID=NTR6654.

Planning and developing a web-based intervention for active surveillance in prostate cancer: an integrated self-care programme for managing psychological distress

Objectives

To outline the planning, development and optimisation of a psycho-educational behavioural intervention for patients on active surveillance for prostate cancer. The intervention aimed to support men manage active surveillance-related psychological distress.

Methods

The person-based approach (PBA) was used as the overarching guiding methodological framework for intervention development. Evidence-based methods were incorporated to improve robustness. The process commenced with data gathering activities comprising the following four components:

• A systematic review and meta-analysis of depression and anxiety in prostate cancer

• A cross-sectional survey on depression and anxiety in active surveillance

• A review of existing interventions in the field

• A qualitative study with the target audience

The purpose of this paper is to bring these components together and describe how they facilitated the establishment of key guiding principles and a logic model, which underpinned the first draft of the intervention.

Results

The prototype intervention, named PROACTIVE, consists of six Internet-based sessions run concurrently with three group support sessions. The sessions cover the following topics: lifestyle (diet and exercise), relaxation and resilience techniques, talking to friends and family, thoughts and feelings, daily life (money and work) and information about prostate cancer and active surveillance. The resulting intervention has been trialled in a feasibility study, the results of which are published elsewhere.

Conclusions

The planning and development process is key to successful delivery of an appropriate, accessible and acceptable intervention. The PBA strengthened the intervention by drawing on target-user experiences to maximise acceptability and user engagement. This meticulous description in a clinical setting using this rigorous but flexible method is a useful demonstration for others developing similar interventions.

Trial registration and Ethical Approval

ISRCTN registered: ISRCTN38893965. NRES Committee South Central – Oxford A. REC reference: 11/SC/0355

Standardization of the assessment process within telerehabilitation in chronic diseases: a scoping meta-review

Background

Telerehabilitation (TR) interventions are receiving increasing attention. They have been evaluated in various scientific areas through systematic reviews. However, there is a lack of data on how to standardize assessment and report on their domains to guide researchers across studies and bring together the best evidence to assess TR for chronic diseases.

Aims and objectives

The aim of this study was to identify domains of assessment in TR and to qualitatively and quantitatively analyze how and when they are examined to gain an overview of assessment in chronic disease.

Methods

A scoping meta-review was carried out on 9 databases and gray literature from 2009 to 2019. The keyword search strategy was based on "telerehabilitation", “evaluation", “chronic disease" and their synonyms. All articles were subjected to qualitative analysis using the Health Technology Assessment (HTA) Core Model prior to further analysis and narrative synthesis.

Results

Among the 7412 identified articles, 80 studies met the inclusion criteria and addressed at least one of the noncommunicable diseases (NCD) categories of cardiovascular disease (cardiovascular accidents), cancer, chronic respiratory disease, diabetes, and obesity. Regarding the domains of assessment, the most frequently occurring were “social aspect” (n = 63, 79%) (e.g., effects on behavioral changes) and “clinical efficacy” (n = 53, 66%), and the least frequently occurring was “safety aspects” (n = 2, 3%). We also identified the phases of TR in which the assessment was conducted and found that it most commonly occurred in the pilot study and randomized trial phases and least commonly occurred in the design, pretest, and post-implementation phases.

Conclusions

Through the HTA model, this scoping meta-review highlighted 10 assessment domains which have not been studied with the same degree of interest in the recent literature. We showed that each of these assessment domains could appear at different phases of TR development and proposed a new cross-disciplinary and comprehensive method for assessing TR interventions. Future studies will benefit from approaches that leverage the best evidence regarding the assessment of TR, and it will be interesting to extend this assessment framework to other chronic diseases.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08370-y.

Developing a Smartphone Application That Promotes Responsible Short-Acting Beta2-Agonist Use in People with Asthma: A Participatory Design

Around 339 million people worldwide have asthma, and 50% have uncontrolled asthma. One trait of uncontrolled asthma, often seen in primary care, is short-acting β2-agonist (SABA) overuse, defined as using SABA more than twice a week. SABA overuse can cause adverse health effects. An application could help patients gain more insight into their SABA use. Engaging stakeholders during the development is important to maximize the usability of and adherence to an application. This study describes the development process of an application that promotes responsible SABA use in people with asthma, using a participatory design. Different stakeholder groups were involved in two iterative development cycles. In the first cycle, four end-users evaluated the app’s prototype. During the second cycle, five end-users were interviewed about the usability of the new version. Resulting in an app that allows patients to register SABA use, asthma symptoms, and symptom triggers. A graph shows how these factors are related, and end-users can show the graph to their physician to facilitate communication. Medication use is compared to the medical guidelines or, when applicable, to the advice given by the users’ healthcare professionals. End-users found the app helpful. Research into the usability and effectiveness of the app in a bigger sample will follow.

Maintaining the Ideals of Co-production During Rapid Digitalisation: A Comparative Case Study of Digital Restorative Services in Estonia, Finland, Ireland and Portugal

With the exceptional COVID-19 circumstances in early 2020, public service co-production went through a push towards digitalisation. Using normalisation process theory as the basis for analysis, the article looks at the immediate effects of digitalisation on restorative practices, which is a co-produced approach to delivering justice. A comparative case study conducted in Estonia, Finland, Ireland and Portugal showed that digitalisation meant a more directive role for the mediators and more responsibility for the citizens in organising the service context. The process became more business-like, which put some integral aspects of restorative justice at risk, such as trust building and feeling connected. The launch of digital restorative services depended more on service providers' readiness to try digital solutions and less on service experience before digitalisation.

Negotiating scientific knowledge in the development of an eHealth MOOC

Interdisciplinary team communication in eHealth development is challenging because all disciplines have unique, intrinsic discursive practices, theories and artefacts. Due to these factors, members of interdisciplinary teams can experience problems in communication and collaboration. Through a centered focus, members can benefit individually, inspire one another, and ultimately reach a timely delivery of their common pedagogical goal(s). Using the lens of dialogism, this paper aims to identify the conceptual considerations that arose during the development of a Massive Open Online Course (MOOC) for higher education in eHealth. Methods included auto-ethnography and interdisciplinary dialogue supported by literacy artefacts, including visual material. Results yielded a visual tool for meta-assessment of team communication, and an organizing principle for topics in the MOOC. A major implication is that especially for eHealth, scientific communicative competence of experts-while establishing a common understanding-can lead to a unique and meaningful delivery of high pedagogical quality.

Exploring the Equity Impact of Current Digital Health Design Practices: Protocol for a Scoping Review

BACKGROUND

The field of digital health has grown rapidly in part due to digital health tools' potential to reduce health inequities. However, such potential has not always been realized. The design approaches used in digital health are one of the known aspects that have an impact on health equity.

OBJECTIVE

The aim of our scoping review will be to understand how design approaches in digital health have an impact on health equity.

METHODS

A scoping review of studies that describe how design practices for digital health have an impact on health equity will be carried out. The scoping review will follow the methodologies laid out by Arksey and O'Malley, the Joanna Briggs Institute, and the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist. The PubMed, Embase, Web of Science, and ACM Digital Library databases will be searched for peer-reviewed papers. The ProQuest Dissertations and Theses and Global Index Medicus databases will be searched for gray literature. The results will be screened against our inclusion and exclusion criteria. Subsequently, the data extracted from the included studies will be analyzed.

RESULTS

As of March 2022, a preliminary search of the peer-reviewed databases has yielded over 4900 studies, and more are anticipated when gray literature databases are searched. We expect that after duplicates are removed and screening is completed, a much smaller number of studies will meet all of our inclusion criteria.

CONCLUSIONS

Although there has been much discussion about the importance of design for lowering barriers to digital health participation, the evidence base demonstrating its impacts on health equity is less obvious. We hope that our findings will contribute to a better understanding of the impact that design in digital health has on health equity and that these findings will translate into action that leads to stronger, more equitable health care systems.

The Syndemic of Inequity and COVID-19 in Virtual Care

The critical intersections of structural inequities and vulnerabilities of marginalized populations, particularly those engaging the social gradient of minority ethnic communities, are revealed in the syndemic approach to COVID-19. Although proposals for cultural interventions to improve virtual care provide relevant measures, they may not address the root cause of the disparate impacts of a pandemic on population subgroups. The common misperception of equality as synonymous with equity further impedes the efficacy of digital health in quality-of-care initiatives, as it systemically fails to acknowledge the disparate realities of marginalized populations, while intending to benefit all. This commentary suggests that an alignment of the health care system with Canada’s pluralist principles would support a paradigm shift in transforming virtual care into an equitable standard as envisioned by Pham and colleagues in their paper, “The Future of Virtual Care for Older Ethnic Adults Beyond the COVID-19 Pandemic.”

Consulting the Oracle: A Delphi study for determining parameters for a mental health user profile and personalization strategy for an online service to aid grieving older adults

While much effort has been devoted to the development of mental e-health interventions, the tailoring of these applications to user characteristics and needs is a comparatively novel field of research. The premise of personalizing mental e-health interventions is that personalization increases user motivation and (thereby) mitigates intervention dropout and enhances clinical effectiveness. In this study, we selected user profile parameters for personalizing a mental e-health intervention for older adults who lost their spouse. We conducted a three-round Delphi study involving an international and interdisciplinary expert panel (N = 16) with two objectives. The first aim was to elicit adaptation strategies that can be used to dynamically readjust the intervention to the user's needs. The second aim was to identify a set of meaningful indicators for monitoring the user from within the grief intervention to escalate from self-help to blended care, whenever advisable. This Delphi study used as starting point an evaluated, text-based grief intervention composed of ten modules, including psychoeducation about grief and cognitive-behavioral exercises to support the user in adjusting their lives after bereavement. Every user follows this grief intervention in a linear fashion from beginning to end. The resulting conceptual adaptation model encompasses dynamic adjustments, as well as one-time adjustments performed at the initialization of the service. On the level of the application structure, the adaptations affect when which topic module is presented to the user. The adaptations further provide strategies for adjusting the text-based content of individual intervention modules dependent on user characteristics and for selecting appropriate reactions to user input. Eighteen monitoring parameters were elicited and grouped into four categories: clinical, behavioral/emotional, interactive, and external. Parameters that were perceived as most urgent to attend to for escalation were Suicidality, Self-destructive behavior, Client-initiated escalation, Unresponsiveness and (Complicated) Grief symptoms.

Applying a socioecological framework to chronic disease management: implications for social informatics interventions in safety-net healthcare settings

Objective

Vulnerable populations face numerous barriers in managing chronic disease(s). As healthcare systems work toward integrating social risk factors into electronic health records and healthcare delivery, we need better understanding of the interrelated nature of social needs within patients' everyday lives to inform effective informatics interventions to advance health equity.

Materials and Methods

We conducted in-depth interviews, participant-led neighborhood tours, and clinic visit observations involving 10 patients with diabetes in underserved San Francisco neighborhoods and 10 community leaders serving those neighborhoods. We coded health barriers and facilitators using a socioecological framework. We also linked these qualitative data with early persona development, focusing on patients' experiences in these communities and within the healthcare system, as a starting place for our future informatics design.

Results

We identified social risk and protective factors across almost every socioecological domain and level-from physical disability to household context to neighborhood environment. We then detailed the complex interplay across domains and levels within two critical aspects of patients' lives: housing and food. Finally, from these data we generated 3 personas that capture the intersectional nature of these determinants.

Conclusion

Drawing from different disciplines, our study provides a socioecological approach to understanding health promotion for patients with chronic disease in a safety-net healthcare system, using multiple methodologies. Future digital health research should center the lived experiences of marginalized patients to effectively design and implement informatics solutions for this audience.

Meeting Users Where They Are: User-centered Design of an Automated Text Messaging Tool to Support the Mental Health of Young Adults

Young adults have high rates of mental health conditions, but most do not want or cannot access formal treatment. We therefore recruited young adults with depression or anxiety symptoms to co-design a digital tool for self-managing their mental health concerns. Through study activities-consisting of an online discussion group and a series of design workshops-participants highlighted the importance of easy-to-use digital tools that allow them to exercise independence in their self-management. They described ways that an automated messaging tool might benefit them by: facilitating experimentation with diverse concepts and experiences; allowing variable depth of engagement based on preferences, availability, and mood; and collecting feedback to personalize the tool. While participants wanted to feel supported by an automated tool, they cautioned against incorporating an overtly human-like motivational tone. We discuss ways to apply these findings to improve the design and dissemination of digital mental health tools for young adults.

User-Centric Design Methodology for mHealth Apps. The PainApp Paradigm for Chronic Pain

The paper presents a user-centric methodology in order to design successful mobile health (mHealth) applications. In addition to the theoretical background, such an example is presented with an application targeting chronic pain. The pain domain was decided due to its significance in many aspects: its complexity, dispersion in the population, the financial burden it causes, etc. The paper presents a step-by-step plan in order to build mobile health applications. Participatory design and interdisciplinarity are only some of the critical issues towards the desired result. In the given example (development of the PainApp), a participatory design was followed with a team of seventeen stakeholders that drove the design and development phases. Three physicians, one behavioral scientist, three IT and UX experts, and ten patients collaborated together to develop the final solution. The several features implemented in the PainApp solution are presented in details. The application is threefold: it supports the management, reporting, and treatment effectiveness monitoring. The paper is giving details on the methodological approach while presenting insights on the actual plan and the steps followed for having a patient-centric solution. Key success factors and barriers to mobile health applications that support the need for such an approach are also presented.

Web-Based Structured Education for Type 2 Diabetes: Interdisciplinary User-Centered Design Approach

BACKGROUND

Digital health research encompasses methods from human-computer interaction and health research.

OBJECTIVE

This paper aims to describe how these methods were combined to develop HeLP-Diabetes: Starting Out, a web-based structured education program for people newly diagnosed with type 2 diabetes.

METHODS

The development process consisted of three phases: initial design for effectiveness, optimization for usability, and in the wild testing in the National Health Service with people newly diagnosed with type 2 diabetes, and further revisions. We adopted an iterative user-centered approach and followed steps from the human-computer interaction design life cycle and the Medical Research Council guidelines on developing and evaluating complex interventions.

RESULTS

The initial design process resulted in an 8-session program containing information and behavior change techniques targeting weight loss, being more active, and taking medication. The usability testing was highlighted at an early stage, where changes needed to be made to the language and layout of the program. The in the wild testing provided data on uptake of and barriers to use. The study suggested low uptake and completion of the program, but those who used it seemed to benefit from it. The qualitative findings suggested that barriers to use included an expectation that the program would take too long. This informed refinements to the program.

CONCLUSIONS

The use of interdisciplinary methods resulted in an iterative development process and refinements to the program that were based on user needs and data on uptake. The final intervention was more suitable for a definitive evaluation than the initial version. The description of our approach informs other digital health researchers on how to make interventions more sensitive to user needs.

Toward an Understanding of How Post- Deployment User- Developer Interactions Influence System Utilization

Although initial adoption of an information system has been shown to influence system success, further value can be obtained when end-users move beyond adoption, utilizing more features of the system and integrating it into their work routines. Organizations can increase the post-deployment utilization of their systems by emphasizing continued interaction between developers and end-users. In this study, we develop a research model investigating the influence of shared understanding, faithfulness of appropriation, and consensus on spirit on post-deployment system utilization. Using a sample from a healthcare organization, we show that increased end-user postdeployment interaction with developers supports a shared understanding between the two groups, which ultimately impacts both the routinization and infusion of a system. This study provides a contribution by demonstrating the impact of developer/user interaction in the post-implementation phase of systems development.

The multidisciplinary, theory-based co-design of a new digital health intervention supporting the care of oesophageal cancer patients

Objective

Oesophageal cancer patients have complex care needs. Cancer clinical nurse specialists play a key role in coordinating their care but often have heavy workloads. Digital health interventions can improve patient care but there are few examples for oesophageal cancer. This paper aims to describe the multidisciplinary co-design process of a digital health intervention to improve the experience of care and reduce unmet needs among patients with oesophageal cancer.

Methods

A theory-based, multi-disciplinary, co-design approach was used to inform the developmental process of the digital health intervention. Key user needs were elicited using mixed methodology from systematic reviews, focus groups and interviews and holistic need assessments. Overarching decisions were discussed among a core team of patients, carers, health care professionals including oncologists and cancer clinical nurse specialists, researchers and digital health providers. A series of workshops incorporating a summary of findings of key user needs resulted in the development of a minimum viable product. This was further refined after a pilot study based on feedback from end users.

Results

The final digital health intervention consists of a mobile app feature for patients and carers connected to a dashboard with supporting additional features for clinical nurse specialist. It contains a one-way messaging function for clinical nurse specialists to communicate with patients, functions for patients to record weight and holistic need assessment results which could be viewed by their clinical nurse specialists as well as a library of informative articles.

Conclusions

The multidisciplinary co-design of a digital health intervention providing support for oesophageal cancer patients and health care professionals has been described. Future studies to establish its impact on patient outcomes are planned.

Introduction of Systematized Nomenclature of Medicine-Clinical Terms Coding Into an Electronic Health Record and Evaluation of its Impact: Qualitative and Quantitative Study

BACKGROUND

This study describes the conversion within an existing electronic health record (EHR) from the International Classification of Diseases, Tenth Revision coding system to the SNOMED-CT (Systematized Nomenclature of Medicine-Clinical Terms) for the collection of patient histories and diagnoses. The setting is a large acute hospital that is designing and building its own EHR. Well-designed EHRs create opportunities for continuous data collection, which can be used in clinical decision support rules to drive patient safety. Collected data can be exchanged across health care systems to support patients in all health care settings. Data can be used for research to prevent diseases and protect future populations.

OBJECTIVE

The aim of this study was to migrate a current EHR, with all relevant patient data, to the SNOMED-CT coding system to optimize clinical use and clinical decision support, facilitate data sharing across organizational boundaries for national programs, and enable remodeling of medical pathways.

METHODS

The study used qualitative and quantitative data to understand the successes and gaps in the project, clinician attitudes toward the new tool, and the future use of the tool.

RESULTS

The new coding system (tool) was well received and immediately widely used in all specialties. This resulted in increased, accurate, and clinically relevant data collection. Clinicians appreciated the increased depth and detail of the new coding, welcomed the potential for both data sharing and research, and provided extensive feedback for further development.

CONCLUSIONS

Successful implementation of the new system aligned the University Hospitals Birmingham NHS Foundation Trust with national strategy and can be used as a blueprint for similar projects in other health care settings.

The Association Between Patients' eHealth Literacy and Satisfaction With Shared Decision-making and Well-being: Multicenter Cross-sectional Study

Background

Although previous studies have shown that a high level of health literacy can improve patients’ ability to engage in health-related shared decision-making (SDM) and improve their quality of life, few studies have investigated the role of eHealth literacy in improving patient satisfaction with SDM (SSDM) and well-being.

Objective

This study aims to assess the relationship between patients’ eHealth literacy and their socioeconomic determinants and to investigate the association between patients’ eHealth literacy and their SSDM and well-being.

Methods

The data used in this study were obtained from a multicenter cross-sectional survey in China. The eHealth Literacy Scale (eHEALS) and Investigating Choice Experiments Capability Measure for Adults were used to measure patients’ eHealth literacy and capability well-being, respectively. The SSDM was assessed by using a self-administered questionnaire. The Kruskal-Wallis one-way analysis of variance and Wilcoxon signed-rank test were used to compare the differences in the eHEALS, SSDM, and Investigating Choice Experiments Capability Measure for Adults scores of patients with varying background characteristics. Ordinary least square regression models were used to assess the relationship among eHealth literacy, SSDM, and well-being adjusted by patients’ background characteristics.

Results

A total of 569 patients completed the questionnaire. Patients who were male, were highly educated, were childless, were fully employed, were without chronic conditions, and indicated no depressive disorder reported a higher mean score on the eHEALS. Younger patients (SSDM_{≥61 years}=88.6 vs SSDM_{16-30 years}=84.2) tended to show higher SSDM. Patients who were rural residents and were well paid were more likely to report good capability well-being. Patients who had a higher SSDM and better capability well-being reported a significantly higher level of eHealth literacy than those who had lower SSDM and poorer capability well-being. The regression models showed a positive relationship between eHealth literacy and both SSDM (β=.22; P<.001) and well-being (β=.26; P<.001) after adjusting for patients’ demographic, socioeconomic status, lifestyle, and health status variables.

Conclusions

This study showed that patients with a high level of eHealth literacy are more likely to experience optimal SDM and improved capability well-being. However, patients’ depressive status may alter the relationship between eHealth literacy and SSDM.

Evaluation and Refinement of a Bank of SMS Text Messages to Promote Behavior Change Adherence Following a Diabetes Prevention Program: Survey Study

Background

SMS text messaging is a low-cost and far-reaching modality that can be used to augment existing diabetes prevention programs and improve long-term diet and exercise behavior change adherence. To date, little research has been published regarding the process of SMS text message content development. Understanding how interventions are developed is necessary to evaluate their evidence base and to guide the implementation of effective and scalable mobile health interventions in public health initiatives and in future research.

Objective

This study aims to describe the development and refinement of a bank of SMS text messages targeting diet and exercise behavior change to be implemented following a diabetes prevention program.

Methods

A bank of 124 theory-based SMS text messages was developed using the Behaviour Change Wheel and linked to active intervention components (behavior change techniques [BCTs]). The Behaviour Change Wheel is a theory-based framework that provides structure to intervention development and can guide the use of evidence-based practices in behavior change interventions. Once the messages were written, 18 individuals who either participated in a diabetes prevention program or were a diabetes prevention coach evaluated the messages on their clarity, utility, and relevance via survey using a 5-point Likert scale. Messages were refined according to participant feedback and recoded to obtain an accurate representation of BCTs in the final bank.

Results

76/124 (61.3%) messages were edited, 4/124 (3.2%) were added, and 8/124 (6.5%) were removed based on participant scores and feedback. Of the edited messages, 43/76 (57%) received minor word choice and grammar alterations while retaining their original BCT code; the remaining 43% (33/76, plus the 4 newly written messages) were recoded by a reviewer trained in BCT identification.

Conclusions

This study outlines the process used to develop and refine a bank of SMS text messages to be implemented following a diabetes prevention program. This resulted in a bank of 120 theory-based, user-informed SMS text messages that were overall deemed clear, useful, and relevant by both individuals who will be receiving and delivering them. This formative development process can be used as a blueprint in future SMS text messaging development to ensure that message content is representative of the evidence base and is also grounded in theory and evaluated by key knowledge users.

The role of Design Science Research Methodology in developing pharmacy eHealth services

The increasing focus on efficiency of care has prompted health systems to look for innovative solutions that yield maximum value for care. Integration of care and eHealth are seen as the most promising solutions in the high technological environment of the coming decades. Pharmacy services have been developed to a point where the face of community pharmacy has changed dramatically. Thus, service design and implementation has become an area of increased attention by Pharmacy practice researchers, and the arrival of eHealth concepts to Pharmacy is driving the need to find alternative ways to design new services. Moreover, known barriers and challenges remain when securing integration of pharmacy services with the health systems. In this paper, Design Science Research Methodology (DSRM), a user-centered alternative methodology to the design, development and implementation of health services, especially eHealth services, is presented. This alternative, originally from the Information Sciences field, has been adopted as a service design methodology in diverse settings, including health care. Here, case studies are used to explain how a DSRM process should be conducted in a health care setting, illustrating what methods to choose in each step of the process. Finally, the advantages of DSRM compared to other user-centered methodologies for service design are presented, hopefully prompting the discussion on the use of DSRM for the study of the implementation and sustainability of pharmacy services.

A Smartphone-Based Self-management Intervention for Bipolar Disorder (LiveWell): User-Centered Development Approach

BACKGROUND

Bipolar disorder is a serious mental illness that results in significant morbidity and mortality. Pharmacotherapy is the primary treatment for bipolar disorder; however, adjunctive psychotherapy can help individuals use self-management strategies to improve outcomes. Yet access to this therapy is limited. Smartphones and other technologies have the potential to increase access to therapeutic strategies that enhance self-management while simultaneously providing real-time user feedback and provider alerts to augment care.

OBJECTIVE

This paper describes the user-centered development of LiveWell, a smartphone-based self-management intervention for bipolar disorder, to contribute to and support the ongoing improvement and dissemination of technology-based mental health interventions.

METHODS

Individuals with bipolar disorder first participated in a field trial of a simple smartphone app for self-monitoring of behavioral targets. To develop a complete technology-based intervention for bipolar disorder, this field trial was followed by design sessions, usability testing, and a pilot study of a smartphone-based self-management intervention for bipolar disorder. Throughout all phases of development, intervention revisions were made based on user feedback.

RESULTS

The core of the LiveWell intervention consists of a daily self-monitoring tool, the Daily Check-in. This self-monitoring tool underwent multiple revisions during the user-centered development process. Daily Check-in mood and thought rating scales were collapsed into a single wellness rating scale to accommodate user development of personalized scale anchors. These anchors are meant to assist users in identifying early warning signs and symptoms of impending episodes to take action based on personalized plans. When users identified personal anchors for the wellness scale, the anchors most commonly reflected behavioral signs and symptoms (40%), followed by cognitive (25%), mood (15%), physical (10%), and motivational (7%) signs and symptoms. Changes to the Daily Check-in were also made to help users distinguish between getting adequate sleep and keeping a regular routine. At the end of the pilot study, users reported that the Daily Check-in made them more aware of early warning signs and symptoms and how much they were sleeping. Users also reported that they liked personalizing their anchors and plans and felt this process was useful. Users experienced some difficulties with developing, tracking, and achieving target goals. Users also did not consistently follow up with app recommendations to contact providers when Daily Check-in data suggested they needed additional assistance. As a result, the human support roles for the technology were expanded beyond app use support to include support for self-management and clinical care communication. The development of these human support roles was aided by feedback on the technology's usability from the users and the coaches who provided the human support.

CONCLUSIONS

User input guided the development of intervention content, technology, and coaching support for LiveWell. Users valued the provision of monitoring tools and the ability to personalize plans for staying well, supporting the role of monitoring and personalization as important features of digital mental health technologies. Users also valued human support of the technology in the form of a coach, and user difficulties with aspects of self-management and care-provider communication led to an expansion of the coach's support roles. Obtaining feedback from both users and coaches played an important role in the development of both the LiveWell technology and human support. Attention to all stakeholders involved in the use of mental health technologies is essential for optimizing intervention development.

An Ecological Momentary Intervention for people with social anxiety: A descriptive case study

This study describes the development and pilot evaluation of a smartphone- delivered Ecological Momentary Intervention (EMI) for people with social anxiety symptoms. Using a software engineering framework (agile modeling, model-driven development, bottom-up development), mental health experts and software developers collaborated to develop a 4-module EMI app designed to reduce social anxiety in real-time. Fifty-five participants with social anxiety were randomly allocated to the EMI or a wait-list control arm. App downloads, usage and user satisfaction data were collected and mental health outcomes assessed at baseline and post-intervention. Software development practices allowed mental health experts to distil core elements of a psychological intervention into discrete software components but there were challenges in engaging mental health experts in the process. Relative to control there was no significant reduction in social anxiety among the EMI participants in the pilot trial. However, post-test data were available for only 4 intervention and 10 control participants and only 2 (4.0%) of the EMI participants downloaded the app. The two participants who both accessed the app and completed the post-test reported being satisfied with the intervention. Future research should address managing resources and providing additional training to support ongoing engagement with key stakeholders.

The Effect of Innovation Capabilities of Health Care Organizations on the Quality of Health Information Technology: Model Development With Cross-sectional Data

Background

Large health organizations often struggle to build complex health information technology (HIT) solutions and are faced with ever-growing pressure to continuously innovate their information systems. Limited research has been conducted that explores the relationship between organizations’ innovative capabilities and HIT quality in the sense of achieving high-quality support for patient care processes.

Objective

The aim of this study is to explain how core constructs of organizational innovation capabilities are linked to HIT quality based on a conceptual sociotechnical model on innovation and quality of HIT, called the IQ_HIT model, to help determine how better information provision in health organizations can be achieved.

Methods

We designed a survey to assess various domains of HIT quality, innovation capabilities of health organizations, and context variables and administered it to hospital chief information officers across Austria, Germany, and Switzerland. Data from 232 hospitals were used to empirically fit the model using partial least squares structural equation modeling to reveal associations and mediating and moderating effects.

Results

The resulting empirical IQ_HIT model reveals several associations between the analyzed constructs, which can be summarized in 2 main insights. First, it illustrates the linkage between the constructs measuring HIT quality by showing that the professionalism of information management explains the degree of HIT workflow support (R²=0.56), which in turn explains the perceived HIT quality (R²=0.53). Second, the model shows that HIT quality was positively influenced by innovation capabilities related to the top management team, the information technology department, and the organization at large. The assessment of the model’s statistical quality criteria indicated valid model specifications, including sufficient convergent and discriminant validity for measuring the latent constructs that underlie the measures of HIT quality and innovation capabilities.

Conclusions

The proposed sociotechnical IQ_HIT model points to the key role of professional information management for HIT workflow support in patient care and perceived HIT quality from the viewpoint of hospital chief information officers. Furthermore, it highlights that organizational innovation capabilities, particularly with respect to the top management team, facilitate HIT quality and suggests that health organizations establish this link by applying professional information management practices. The model may serve to stimulate further scientific work in the field of HIT adoption and diffusion and to provide practical guidance to managers, policy makers, and educators on how to achieve better patient care using HIT.

A Study of eHealth from the Perspective of Social Sciences

The field of social sciences has become increasingly important in eHealth. Patients currently engage more proactively with health services. This means that eHealth is linked to many different areas of Social Sciences. The main purpose of this research is to analyze the state-of-the-art research on eHealth from the perspective of social sciences. To this end, a bibliometric analysis was conducted using the Web of Science database. The main findings show the evolution of publications, the most influential countries, the most relevant journals and papers, and the importance of the different areas of knowledge. Although there are some studies on eHealth within social sciences, most of them focus on very specific aspects and do not develop a holistic analysis. Thus, this paper contributes to academia by analyzing the state-of-the-art of research, as well as identifying the most relevant trends and proposing future lines of research such as the potential of eHealth as a professional training instrument, development of predictive models in eHealth, analysis of the eHealth technology acceptance model (TAM), efficient integration of eHealth within public systems, efficient budget management, or improvement in the quality of service for patients.

Global Interest in Telehealth During COVID-19 Pandemic: An Analysis of Google Trends™

Background

Since the outbreak, healthcare systems across the globe are overcrowded with coronavirus disease (COVID-19) patients. To sustain the response towards the pandemic, many hospitals have adapted to virtual healthcare and telemedicine. Google™ has become the most widely used search engine over the years. Google Trends™ can be used to depict the public interest over a certain topic. The output of the Google Trends™ is displayed as relative search volume (RSV) which is the proportionate search volume regarding a specific topic comparative to the total search volume in a specific time and region. The primary aim of this study was to evaluate the relationship between the daily reported number of new COVID-19 cases and deaths and the corresponding changes in Google Trends™ RSV of telehealth over six months.

Methods

A retrospective study was conducted from January 21, 2020 to July 21, 2020. About 17 countries that reported the total number of cases greater than 200,000 in the situation report of July 21, 2020 were selected to be a part of this study. The daily reported new cases and deaths globally and of the selected countries were extracted from the World Health Organization (WHO) situation reports. The combination of keywords used for obtaining the RSV data through Google Trends™ was “telehealth”, “telemedicine”, “mHealth”, and “eHealth”. These words were used with the “+” feature of Google Trends™ with “1/21/2020 to 7/21/2020” as time range, “all categories” for the category, and “web search” for the type of search. The worldwide RSV as well as the RSVs of the selected countries were obtained from the Google Trends™ website. Spearman’s correlation coefficient (ρ) was used to determine the strength of the relationship between new cases or deaths and RSVs related to telehealth.

Results

A positive fair correlation was established between the global interest in telehealth and the new cases (ρ=0.307, p-value<0.001) and deaths (ρ=0.469, p-value<0.001) reported worldwide. The United States of America (USA), India, and Bangladesh were found to have a positive fair correlation between the public interest regarding telehealth and the emerging new COVID-19 cases and deaths. The United Kingdom (UK) and Italy demonstrated a positive poor correlation between the rising new cases or deaths and RSV. Similar statistics were noted for the daily new cases of Chile. For Turkey, a positive fair correlation between new deaths and RSV while a positive poor correlation between new cases and RSV was observed. No significant correlation was observed for the rest of the selected countries.

Conclusion

This study highlights the steadily rising public interest in telehealth during the COVID-19 pandemic. Telemedicine can provide the necessary remote consultation and healthcare for patients in the current situation. However, previous studies have shown that the majority of the countries are inadequately equipped for the digitization of the healthcare system. Therefore, it has become necessary to incorporate telemedicine into the healthcare system to combat any possible pandemic in the future.

Promoting medication adherence from the perspective of adolescent and young adult kidney transplant recipients, parents, and health care professionals: A TAKE-IT TOO study

Medication non-adherence is an important factor limiting allograft survival after kidney transplantation in AYA. Some interventions, including the TAKE-IT, showed some success in promoting adherence but the potential for scalability and use in routine clinical practice is limited. We applied user-centered design to gather the perspectives of recipients, parents, and health professionals concerning their needs, challenges, and potential intervention strategies to design an optimal, multi-component medication adherence intervention. The qualitative study was conducted at four Canadian and three American kidney transplant programs. Separate focus groups for recipients, parents, and health professionals were convened to explore these stakeholders' perspectives. Directed content analysis was employed to identify themes that were shared vs distinct across stakeholders. All stakeholder groups reported challenges related to taking medications on time in the midst of their busy schedules and the demands of transitioning toward independence during adolescence. The stakeholders also made suggestions for the multi-component behavioral intervention, including an expanded electronic pillbox and companion website, education materials, and customized digitized features to support shared responsibility and communication among recipients, parents, and health professionals. Several suggestions regarding the functionality and features of the potential intervention reported in this early stage will be explored in more depth as the iterative process unfolds. Our approach to actively involve all stakeholders in the process increases the likelihood of designing an adherence intervention that is truly user-informed and fit for the clinical setting.

Untold Stories in User-Centered Design of Mobile Health: Practical Challenges and Strategies Learned From the Design and Evaluation of an App for Older Adults With Heart Failure

Background

User-centered design (UCD) is a powerful framework for creating useful, easy-to-use, and satisfying mobile health (mHealth) apps. However, the literature seldom reports the practical challenges of implementing UCD, particularly in the field of mHealth.

Objective

This study aims to characterize the practical challenges encountered and propose strategies when implementing UCD for mHealth.

Methods

Our multidisciplinary team implemented a UCD process to design and evaluate a mobile app for older adults with heart failure. During and after this process, we documented the challenges the team encountered and the strategies they used or considered using to address those challenges.

Results

We identified 12 challenges, 3 about UCD as a whole and 9 across the UCD stages of formative research, design, and evaluation. Challenges included the timing of stakeholder involvement, overcoming designers’ assumptions, adapting methods to end users, and managing heterogeneity among stakeholders. To address these challenges, practical recommendations are provided to UCD researchers and practitioners.

Conclusions

UCD is a gold standard approach that is increasingly adopted for mHealth projects. Although UCD methods are well-described and easily accessible, practical challenges and strategies for implementing them are underreported. To improve the implementation of UCD for mHealth, we must tell and learn from these traditionally untold stories.

Supporting Self-Management of Cardiovascular Diseases Through Remote Monitoring Technologies: Metaethnography Review of Frameworks, Models, and Theories Used in Research and Development

Background

Electronic health (eHealth) is a rapidly evolving field informed by multiple scientific disciplines. Because of this, the use of different terms and concepts to explain the same phenomena and lack of standardization in reporting interventions often leaves a gap that hinders knowledge accumulation. Interventions focused on self-management support of cardiovascular diseases through the use of remote monitoring technologies are a cross-disciplinary area potentially affected by this gap. A review of the underlying frameworks, models, and theories that have informed projects at this crossroad could advance future research and development efforts.

Objective

This research aimed to identify and compare underlying approaches that have informed interventions focused on self-management support of cardiovascular diseases through the use of remote monitoring technologies. The objective was to achieve an understanding of the distinct approaches by highlighting common or conflicting principles, guidelines, and methods.

Methods

The metaethnography approach was used to review and synthesize researchers’ reports on how they applied frameworks, models, and theories in their projects. Literature was systematically searched in 7 databases: Scopus, Web of Science, EMBASE, CINAHL, PsycINFO, Association for Computing Machinery Digital Library, and Cochrane Library. Included studies were thoroughly read and coded to extract data for the synthesis. Studies were mainly related by the key ingredients of the underlying approaches they applied. The key ingredients were finally translated across studies and synthesized into thematic clusters.

Results

Of 1224 initial results, 17 articles were included. The articles described research and development of 10 different projects. Frameworks, models, and theories (n=43) applied by the projects were identified. Key ingredients (n=293) of the included articles were mapped to the following themes of eHealth development: (1) it is a participatory process; (2) it creates new infrastructures for improving health care, health, and well-being; (3) it is intertwined with implementation; (4) it integrates theory, evidence, and participatory approaches for persuasive design; (5) it requires continuous evaluation cycles; (6) it targets behavior change; (7) it targets technology adoption; and (8) it targets health-related outcomes.

Conclusions

The findings of this review support and exemplify the numerous possibilities in the use of frameworks, models, and theories to guide research and development of eHealth. Participatory, user-centered design, and integration with empirical evidence and theoretical modeling were widely identified principles in the literature. On the contrary, less attention has been given to the integration of implementation in the development process and supporting novel eHealth-based health care infrastructures. To better integrate theory and evidence, holistic approaches can combine patient-centered studies with consolidated knowledge from expert-based approaches.

Trial Registration

PROSPERO CRD42018104397; https://tinyurl.com/y8ajyajt

International Registered Report Identifier (IRRID)

RR2-10.2196/13334

British South Asian Patients' Perspectives on the Relevance and Acceptability of Mobile Health Text Messaging to Support Medication Adherence for Type 2 Diabetes: Qualitative Study

BACKGROUND

The prevalence of type 2 diabetes (T2D) is greater in South Asian populations and health outcomes are poorer compared with other ethnic groups. British South Asians are up to six times more likely to have T2D than the general population, to develop the condition at a younger age, and to experience diabetes-related complications. Interventions to support people in managing their condition can potentially reduce debilitating complications. Evidence to support the use of digital devices in T2D management, including mobile phones, has shown positive impacts on glycemic control. There is increasing recognition that health interventions that are culturally adapted to the needs of specific groups are more likely to be relevant and acceptable, but evidence to support the effectiveness of adapted interventions is limited and inconclusive.

OBJECTIVE

This formative study aimed to explore the perceptions and views of British South Asian patients with T2D on mobile health SMS text messaging to support medication adherence, aimed at the general UK population.

METHODS

Eight exploratory focus groups were conducted in Leicester, the United Kingdom, between September 2017 and March 2018. A diverse sample of 67 adults took part.

RESULTS

British South Asian people with T2D who use digital devices, including mobile phones, felt that short messages to support medication adherence would be acceptable and relevant, but they also wanted messages that would support other aspects of self-management too. Participants were particularly interested in content that met their information needs, including information about South Asian foods, commonly used herbs and spices, natural and herbal approaches used in the United Kingdom and in South Asia, and religious fasting. Short messages delivered in English were perceived to be acceptable, often because family members could translate for those unable to read or understand the messages. Suggestions to support patients unable to understand short messages in English included having them available in different formats, and disseminated in face-to-face groups for those who did not use digital devices.

CONCLUSIONS

Exploring the views of British South Asian patients about SMS text messaging aimed at the general UK population is important in maximizing the potential of such an intervention. For such a digital system to meet the needs of UK South Asian populations, it may also have to include culturally relevant messages sent to those who opt to receive them. It is equally important to consider how to disseminate message content to patients who do not use digital devices to help reduce health inequalities.

Iterative four-phase development of a theory-based digital behaviour change intervention to reduce occupational sedentary behaviour

Introduction

As high amounts of occupational sitting have been associated with negative health consequences, designing workplace interventions to reduce sedentary behaviour (SB) is of public health interest. Digital technology may serve as a cost-effective and scalable platform to deliver such an intervention. This study describes the iterative development of a theory-based, digital behaviour change intervention to reduce occupational SB.

Methods

The behaviour change wheel and The Behaviour Change Technique Taxonomy were used to guide the intervention design process and form a basis for selecting the intervention components. The development process consisted of four phases: phase 1 – preliminary research, phase 2 – consensus workshops, phase 3 – white boarding and phase 4 – usability testing.

Results

The process led to the development and refinement of a smartphone application – Worktivity. The core component was self-monitoring and feedback of SB at work, complemented by additional features focusing on goal setting, prompts and reminders to break up prolonged periods of sitting, and educational facts and tips. Key features of the app included simple data entry and personalisation based on each individual’s self-reported sitting time. Results from the ‘think-aloud’ interviews (n=5) suggest Worktivity was well accepted and that users were positive about its features.

Conclusion

This study led to the development of Worktivity, a theory-based and user-informed mobile app intervention to reduce occupational SB. It is the first app of its kind developed with the primary aim of reducing occupational SB using digital self-monitoring. This paper provides a template to guide others in the development and evaluation of technology-supported behaviour change interventions.

Identifying Frameworks for Validation and Monitoring of Consensual Behavioral Intervention Technologies: Narrative Review

BACKGROUND

Changing health behaviors, such as smoking, unhealthy eating, inactivity, and alcohol abuse, may have a greater impact on population health than any curative strategy. One of the suggested strategies is the use of behavioral intervention technologies (BITs). They open up new opportunities in the area of prevention and therapy and have begun to show benefits in the durable change of health behaviors in patients or those at risk. A consensual and international paradigm was adopted by health authorities for drugs 50 years ago. It guides their development from research units to their authorization and surveillance. BITs' generalization brings into question their upstream evaluation before being placed on the market and their downstream monitoring once on the market; this is especially the case in view of the marketing information provided by manufacturers and the scarcity and methodological limits of scientific studies on these tools.

OBJECTIVE

This study aims to identify and categorize the frameworks for the validation and monitoring of BITs proposed in the literature.

METHODS

We conducted a narrative literature review using MEDLINE, PsycINFO, and Web of Science. The review items included the following: name, publication year, name of the creator (ie, first author), country, funding organization, health focus, target group, and design (ie, linear, iterative, evolutive, and/or concurrent). The frameworks were then categorized based on (1) translational research thanks to a continuum of steps and (2) the three paradigms that may have inspired the frameworks: biomedical, engineering, and/or behavioral.

RESULTS

We identified 46 frameworks besides the classic US Food and Drug Administration (FDA) five-phase drug development model. A total of 57% (26/46) of frameworks were created in the 2010s and 61% (28/46) involved the final user in an early and systematic way. A total of 4% (2/46) of frameworks had a linear-only sequence of their phases, 37% (17/46) had a linear and iterative structure, 33% (15/46) added an evolutive structure, and 24% (11/46) were associated with a parallel process. Only 12 out of 46 (26%) frameworks covered the continuum of steps and 12 (26%) relied on the three paradigms.

CONCLUSIONS

To date, 46 frameworks of BIT validation and surveillance coexist, besides the classic FDA five-phase drug development model, without the predominance of one of them or convergence in a consensual model. Their number has increased exponentially in the last three decades. Three dangerous scenarios are possible: (1) anarchic continuous development of BITs that depend on companies amalgamating health benefits and usability (ie, user experience, data security, and ergonomics) and limiting implementation to several countries; (2) the movement toward the type of framework for drug evaluation centered on establishing its effectiveness before marketing authorization to guarantee its safety for users, which is heavy and costly; and (3) the implementation of a framework reliant on big data analysis based on a posteriori research and an autoregulation of a market, but that does not address the safety risk for the health user, as the market will not regulate safety or efficacy issues. This paper recommends convergence toward an international validation and surveillance framework based on the specificities of BITs, not equivalent to medical devices, to guarantee their effectiveness and safety for users.

An empirical study to investigate the efficacy of collaborative immersive virtual reality systems for designing information architecture of software systems

The ability of Immersive Virtual Reality (IVR) systems to mimic the real world has made it possible to use this technology to create environments for remote collaborative work. This study aimed to understand the feasibility of immersive virtual reality when conducting a collaborative Information Architecture (IA) design task-card sorting, with geographically dispersed participants. Using a between-subjects experimental design, thirty groups of two individuals each completed a card sorting activity using conventional in-person, video screen-sharing method or immersive virtual reality methods. The dependent measures included total time, percentage match with master card set, usability, presence and perceived workload. Overall usability was found to be significantly higher for the immersive virtual reality condition when compared to conventional in-person card sorting. In addition, the new immersive virtual reality technology performed as well as the other two conditions for other dependent variables. Qualitative data from the participants also indicated a positive reaction to the use of immersive virtual reality for this task. Overall, the participants felt they were productive and enjoyed the IVR condition, indicating the potential of IVR-based approaches as an alternative to conventional approaches for IA design.

Human-centered design for global health equity

As digital technologies play a growing role in healthcare, human-centered design is gaining traction in global health. Amid concern that this trend offers little more than buzzwords, our paper clarifies how human-centered design matters for global health equity. First, we contextualize how the design discipline differs from conventional approaches to research and innovation in global health, by emphasizing craft skills and iterative methods that reframe the relationship between design and implementation. Second, while there is no definitive agreement about what the 'human' part means, it often implies stakeholder participation, augmenting human skills, and attention to human values. Finally, we consider the practical relevance of human-centered design by reflecting on our experiences accompanying health workers through over seventy digital health initiatives. In light of this material, we describe human-centered design as a flexible yet disciplined approach to innovation that prioritizes people's needs and concrete experiences in the design of complex systems.

Diffusion dynamics of electronic health records: A longitudinal observational study comparing data from hospitals in Germany and the United States

BACKGROUND

While aiming for the same goal of building a national eHealth Infrastructure, Germany and the United States pursued different strategic approaches - particularly regarding the role of promoting the adoption and usage of hospital Electronic Health Records (EHR).

OBJECTIVE

To measure and model the diffusion dynamics of EHRs in German hospital care and to contrast the results with the developments in the US.

MATERIALS AND METHODS

All acute care hospitals that were members of the German statutory health system were surveyed during the period 2007-2017 for EHR adoption. Bass models were computed based on the German data and the corresponding data of the American Hospital Association (AHA) from non-federal hospitals in order to model and explain the diffusion of innovation.

RESULTS

While the diffusion dynamics observed in the US resembled the typical s-shaped curve with high imitation effects (q = 0.583) but with a relatively low innovation effect (p = 0.025), EHR diffusion in Germany stagnated with adoption rates of approx. 50% (imitation effect q = -0.544) despite a higher innovation effect (p = 0.303).

DISCUSSION

These findings correlate with different governmental strategies in the US and Germany of financially supporting EHR adoption. Imitation only seems to work if there are financial incentives, e.g. those of the HITECH Act in the US. They are lacking in Germany, where the government left health IT adoption strategies solely to the free market and the consensus among all of the stakeholders.

CONCLUSION

Bass diffusion models proved to be useful for distinguishing the diffusion dynamics in German and US non-federal hospitals. When applying the Bass model, the imitation parameter needs a broader interpretation beyond the network effects, including driving forces such as incentives and regulations, as was demonstrated by this study.

Design Guidelines for a Technology-Enabled Nutrition Education Program to Support Overweight and Obese Adolescents: Qualitative User-Centered Design Study

Background

Childhood overweight and obesity are major health challenges in the United States. One of the recommendations to combat obesity is to maintain a healthy diet, which is often best supported by eating home-cooked meals to control cooking methods, ingredients, and portions. Diet control through home cooking is challenged because of the decline in culinary skills in the population and a paucity of effective culinary nutrition education (CNE) programs. Providing technology-enabled CNE (CNE-tech) to overweight and obese adolescents can equip them with life skills that can assist them in the future. Such skills can facilitate saving money, eating healthier, and creating social environments. In addition, CNE builds cooking confidence and food literacy that in turn can build adolescent self-efficacy, particularly toward managing their health behaviors.

Objective

This study aimed to inform functionalities, design requirements, and the context of use for CNE-tech that could enhance overweight and obese adolescents’ healthy food literacy, cooking confidence, and general self-efficacy with regard to self-management to ultimately promote healthy lifestyle management.

Methods

The design science study was completed in 2 distinct phases engaging overweight and obese adolescents, parents of overweight and obese adolescents, and the health care providers that treat adolescents with these conditions. Phase 2, our primary source of data, involved user-centered design methods including the following: (1) early stage prototype usability analysis, (2) semistructured interviews with 70 overweight or obese adolescents engaged in a healthy behavior program, and (3) semistructured interviews with 10 health care providers. Data were analyzed using constant comparison analysis to identify functionalities, design requirements, and inform the context of use of CNE-tech.

Results

Data revealed specific desired functionalities for the CNE-tech related to building cooking skills, populating a healthy recipe database, suggesting healthy alternatives, supporting the construction of a healthy plate, and the ability to share healthy recipes and cooking accomplishments. Moreover, the adolescents provided design requirements pertaining to the presentation (eg, vivid colors, semirealistic images, and cooking sounds), use of multimedia, and gaming. Data further revealed contextual factors, such as shared experiences with family members and enhanced continued use.

Conclusions

We demonstrate the potentiality of creating CNE-tech that could effectively lead to better self-care and induce sustainable behavioral change as it facilitates skill building, self-efficacy, and a pathway that enables overweight and obese adolescents to influence cooking habits in their family home and future dwellings. Our CNE-tech–proposed solution aligns with the goals of overweight and obese adolescents and also reflects existing theories about behavioral change.