The development and feasibility of a personal health-optimization system for people with bipolar disorder

Quality assessment of mHealth apps: a scoping review

Introduction

The number of mHealth apps has increased rapidly during recent years. Literature suggests a number of problems and barriers to the adoption of mHealth apps, including issues such as validity, usability, as well as data privacy and security. Continuous quality assessment and assurance systems might help to overcome these barriers. Aim of this scoping review was to collate literature on quality assessment tools and quality assurance systems for mHealth apps, compile the components of the tools, and derive overarching quality dimensions, which are potentially relevant for the continuous quality assessment of mHealth apps.

Methods

Literature searches were performed in Medline, EMBASE and PsycInfo. Articles in English or German language were included if they contained information on development, application, or validation of generic concepts of quality assessment or quality assurance of mHealth apps. Screening and extraction were carried out by two researchers independently. Identified quality criteria and aspects were extracted and clustered into quality dimensions.

Results

A total of 70 publications met inclusion criteria. Included publications contain information on five quality assurance systems and further 24 quality assessment tools for mHealth apps. Of these 29 systems/tools, 8 were developed for the assessment of mHealth apps for specific diseases, 16 for assessing mHealth apps for all fields of health and another five are not restricted to health apps. Identified quality criteria and aspects were extracted and grouped into a total of 14 quality dimensions, namely "information and transparency", "validity and (added) value", "(medical) safety", "interoperability and compatibility", "actuality", "engagement", "data privacy and data security", "usability and design", "technology", "organizational aspects", "social aspects", "legal aspects", "equity and equality", and "cost(-effectiveness)".

Discussion

This scoping review provides a broad overview of existing quality assessment and assurance systems. Many of the tools included cover only a few dimensions and aspects and therefore do not allow for a comprehensive quality assessment or quality assurance. Our findings can contribute to the development of continuous quality assessment and assurance systems for mHealth apps.

Systematic Review Registration

https://www.researchprotocols.org/2022/7/e36974/, International Registered Report Identifier, IRRID (DERR1-10.2196/36974).

"The challenge is the complexity" - A qualitative study about decision-making in advanced lung cancer treatment

INTRODUCTION

The value of shared decision-making and decision aids (DA) has been well documented yet remain difficult to integrate into clinical practice. We wanted to investigate needs and challenges regarding decision-making about advanced lung cancer treatment after first-line therapy, focusing on DA applicability.

METHODS

Qualitative data from separate, semi-structured focus groups with patients/relatives and healthcare professionals were analysed using systematic text condensation. 12 patients with incurable lung cancer, seven relatives, 12 nurses and 18 doctors were recruited from four different hospitals in Norway.

RESULTS

The participants described the following needs and challenges affecting treatment decisions: 1) Continuity of clinician-patient-relationships as a basic framework for decision-making; 2) barriers to information exchange; 3) negotiation of autonomy; and 4) assessment of uncertainty and how to deal with it. Some clinicians feared DA would steal valuable time and disrupt consultations, arguing that such tools could not incorporate the complexity and uncertainty of decision-making. Patients and relatives reported a need for more information and the possibility both to decline or continue burdensome therapy. Participants welcomed interventions supporting information exchange, like communicative techniques and organizational changes ensuring continuity and more time for dialogue. Doctors called for tools decreasing uncertainty about treatment tolerance and futile therapy.

CONCLUSION

Our study suggests it is difficult to develop an applicable DA for advanced lung cancer after first-line therapy that meets the composite requirements of stakeholders. Comprehensive decision support interventions are needed to address organizational structures, communication training including scientific and existential uncertainty, and assessment of frailty and treatment toxicity.

Ready for SDM- evaluation of an interprofessional training module in shared decision making - A cluster randomized trial

OBJECTIVE

Ready for SDM was developed in Norway as a comprehensive modularized curriculum for health care providers (HCP). The current study evaluated the efficacy of one of the modules, a 2-hour interprofessional SDM training designed to enhance SDM competencies.

METHODS

A cluster randomized controlled trial was conducted with eight District Psychiatric Centres randomized to wait-list control (CG) or intervention group (IG). Participants and trainers were not blinded to their allocation. The IG received a 2-hour didactic and interactive training, using video examples. The primary outcome was the agreement between the participants' and an expert assessment of patient involvement in a video recorded consultation. The SDM-knowledge score was a secondary outcome.

RESULTS

Compared to the CG (n = 65), the IG (n = 69) judged involvement behavior in a communication example more accurately (mean difference of weighted T, adjusted for age and gender:=-0.098, p = 0.028) and demonstrated better knowledge (mean difference=-0.58; p = 0.014). A sensitivity analysis entering a random effect for cluster turned out not significant.

CONCLUSION

The interprofessional group training can improve HCPs' SDM-competencies.

PRACTICE IMPLICATIONS

Addressing interprofessional teams using SDM communication training could supplement existing SDM training approaches. More research is needed to evaluate the training module's effects as a component of large-scale implementation of SDM.

New status report from Norway: Implementation of patient involvement in Norwegian health care

In Norway, shared decision-making (SDM) is on the top of the priorities announced by the health authorities. Accountability for implementing this priority has been delegated to the four health regions, and from there into particular departments, hospital trusts, working groups or SDM coordinators. Using abundant public funding, different approaches to producing and implementing patient decision aids have been developed. However, none of these is implemented by any Norwegian services on a regular basis, while the accessible decision aids on the national health platform are not quality approved and in very little use. An ongoing new project is aimed to resolve this dilemma. Health professional training has been developed as a meta-curriculum with multiple modules, adaptive to setting and user group, and designed as an open-source learning platform, based upon the experience of "SDM Ambassadors" delivering the training. Most of the modules are already implemented on a regular basis in the South-Eastern Health Region, and 5000 health care professionals have already graduated from the training modules. However, in the standard patient pathways, and in most of the national medical guidelines, the patient is still considered to be a passive receiver of directives or recommendations, rather than an active participant in their own health decisions. Considerable structural implementation has been done in the education guidelines of all health professions on all levels to embed SDM principles. Teaching in SDM skills, quality of information and evidence-based nursing has become standard in most of the programs at Norwegian universities. Nevertheless, we currently still have no reliable estimate on the degree to which patients are actually involved in their own health decision-making. Further efforts in the process of implementing the patient's choice in the health system should involve the municipal services, follow a research-based strategy, include monitoring and consider the quality level of the informational environment of health-related decisions.

Considerations of diversity, equity, and inclusion in mental health apps: A scoping review of evaluation frameworks

Mental health applications or apps are a promising approach to reduce the pervasive unmet mental health need observed among marginalized groups. However, these groups face unique challenges to engage in and benefit from these interventions, and apps that consider issues of diversity, equity, and inclusion (DEI) may be better positioned to reach them. App evaluation frameworks emerge as crucial tools for researchers, clinicians, and users to select evidence-based apps. Nevertheless, it is unclear the extent to which existing assessment tools capture DEI factors. The present scoping review identified 68 studies that employed one or more assessment tools to evaluate a mental health app, leading to 44 unique app evaluation frameworks. Results showed that most frameworks were developed after 2015, and only 58% of them considered at least one DEI criterion. Frameworks that performed exceptionally well were those that combined multiple standardized and validated measures. This lack of consideration for DEI variables may limit the ability of app-based interventions to serve marginalized communities, or even worse, create new disparities. Therefore, we provide recommendations to improve current app evaluation frameworks' cultural robustness and clinical utility, maximizing their effectiveness when working with individuals from marginalized communities.

What Helps People Make Values-Congruent Medical Decisions? Eleven Strategies Tested across 6 Studies

Background. High-quality health decisions are often defined as those that are both evidence informed and values congruent. A values-congruent decision aligns with what matters to those most affected by the decision. Values clarification methods are intended to support values-congruent decisions, but their effects on values congruence are rarely evaluated. Methods. We tested 11 strategies, including the 3 most commonly used values clarification methods, across 6 between-subjects online randomized experiments in demographically diverse US populations ( n1 = 1346, n2 = 456, n3 = 840, n4 = 1178, n5 = 841, n6 = 2033) in the same hypothetical decision. Our primary outcome was values congruence. Decisional conflict was a secondary outcome in studies 3 to 6. Results. Two commonly used values clarification methods (pros and cons, rating scales) reduced decisional conflict but did not encourage values-congruent decisions. Strategies using mathematical models to show participants which option aligned with what mattered to them encouraged values-congruent decisions and reduced decisional conflict when assessed. Limitations. A hypothetical decision was necessary for ethical reasons, as we believed some strategies may harm decision quality. Later studies used more outcomes and covariates. Results may not generalize outside US-based adults with online access. We assumed validity and stability of values during the brief experiments. Conclusions. Failing to explicitly support the process of aligning options with values leads to increased proportions of values-incongruent decisions. Methods representing more than half of values clarification methods commonly in use failed to encourage values-congruent decisions. Methods that use models to explicitly show people how options align with their values offer more promise for helping people make decisions aligned with what matters to them. Decisional conflict, while arguably an important outcome in and of itself, is not an appropriate proxy for values congruence.

Ready for shared decision making: Pretesting a training module for health professionals on sharing decisions with their patients

INTRODUCTION

While shared decision-making (SDM) training programmes for health professionals have been developed in several countries, few have been evaluated. In Norway, a comprehensive curriculum, "klar for samvalg" (ready for SDM), for interprofessional health-care teams was created using generic didactic methods and guidance to tailor training to various contexts. The programmes adapted didactic methods from an evidence-based German training programmes (doktormitSDM). The overall aim was to evaluate two particular SDM modules on facilitating SDM implementation into clinical practice.

METHOD

A descriptive mixed methods study using questionnaires and a focus group guided by the Medical Research Council Complex Interventions Framework. The training was provided as two different applications (module AB [introduction and SDM-basics] and module ABC [introduction, SDM-basics and interactive training]) with differing learning objectives, extent of interactivity, and duration (1 vs 2 hours). Groups of participants were recruited consecutively based on requests for health professional SDM training in university/college- and hospital-settings. By a focus group and a self-administered questionnaire comprehensibility, relevance and acceptance were assessed and qualitative feedback collected after the training. Data passed descriptive and content analysis, respectively. Knowledge was assessed twice using five multiple-choice items and analysed using paired t-tests.

RESULTS

In 11 (six AB and five ABC) training sessions, 357/429 (296 AB and 133 ABC) eligible nurses, physicians and health professional students with varying clinical backgrounds and previous levels of SDM-knowledge participated. SDM-knowledge increased from 25-78% (range pretest) to 85-95% (range post-test) (P ≤ .001). The training was rated easy to understand, acceptable and relevant for practice. Findings to improve the education suggest higher emphasis on interprofessional teaching methods.

CONCLUSIONS

The two SDM training modules met the basic requirements for use in a broader SDM implementation strategy and can even improve knowledge.

Rapid methods including network meta-analysis to produce evidence in clinical decision support: a decision analysis

BACKGROUND

Conducting systematic reviews is time-consuming but crucial to construct evidence-based patient decision aids, clinical practice guidelines and decision analyses. New methods might enable developers to produce a knowledge base more rapidly. However, trading off scientific rigour for speed when creating a knowledge base is controversial, and the consequences are insufficiently known. We developed and applied faster methods including systematic reviews and network meta-analyses, assessed their feasibility and compared them to a gold standard approach. We also assessed the feasibility of using decision analysis to perform this comparison.

METHODS

Long-term treatment in bipolar disorder was our testing field. We developed two new methods: an empirically based, rapid network meta-analysis (NMA) and an expert NMA, and conducted a patient survey. We applied these methods to collect effect estimates for evidence-based treatments on outcomes important to patients. The relative importance of outcomes was obtained from patients using a stated preference method. We used multi-criteria decision analysis to compare a gold standard NMA with the rapid NMA in terms of the ability of the gold standard NMA to change the ranking and expected values of treatments for individual patients.

RESULTS

Using rapid methods, it was feasible to identify evidence addressing outcomes important to patients. We found that replacing effect estimates from our rapid NMA with estimates from the gold standard NMA resulted in relatively small changes in the ranking and expected value of treatments. The rapid method sufficed to estimate the effects of nine out of ten options. To produce a ranking of treatments accurate for more than 95% of patients, it was necessary to supplement systematic with rapid methods and to use relative importance weights in the analysis. Integrating estimates of the outcome "treatment burden" had a larger impact on rankings than replacing rapid with gold standard methods. Using patients' importance weights only modestly affected results.

CONCLUSIONS

The transfer of knowledge to practice could benefit from faster systematic reviewing methods. The results in this preliminary assessment suggest that an improved rapid NMA approach might replace gold standard NMAs. Decision analysis could be used to compare evidence summarisation methods.

Design and evaluation of a mobile application to assist the self-monitoring of the chronic kidney disease in developing countries

Background

The chronic kidney disease (CKD) is a worldwide critical problem, especially in developing countries. CKD patients usually begin their treatment in advanced stages, which requires dialysis and kidney transplantation, and consequently, affects mortality rates. This issue is faced by a mobile health (mHealth) application (app) that aims to assist the early diagnosis and self-monitoring of the disease progression.

Methods

A user-centered design (UCD) approach involving health professionals (nurse and nephrologists) and target users guided the development process of the app between 2012 and 2016. In-depth interviews and prototyping were conducted along with healthcare professionals throughout the requirements elicitation process. Elicited requirements were translated into a native mHealth app targeting the Android platform. Afterward, the Cohen’s Kappa coefficient statistics was applied to evaluate the agreement between the app and three nephrologists who analyzed test results collected from 60 medical records. Finally, eight users tested the app and were interviewed about usability and user perceptions.

Results

A mHealth app was designed to assist the CKD early diagnosis and self-monitoring considering quality attributes such as safety, effectiveness, and usability. A global Kappa value of 0.7119 showed a substantial degree of agreement between the app and three nephrologists. Results of face-to-face interviews with target users indicated a good user satisfaction. However, the task of CKD self-monitoring proved difficult because most of the users did not fully understand the meaning of specific biomarkers (e.g., creatinine).

Conclusion

The UCD approach provided mechanisms to develop the app based on the real needs of users. Even with no perfect Kappa degree of agreement, results are satisfactory because it aims to refer patients to nephrologists in early stages, where they may confirm the CKD diagnosis.

Systemic challenges in bipolar disorder management: A patient-centered approach

OBJECTIVES

As part of a series of Patient-Centered Outcomes Research Institute-funded large-scale retrospective observational studies on bipolar disorder (BD) treatments and outcomes, we sought the input of patients with BD and their family members to develop research questions. We aimed to identify systemic root causes of patient-reported challenges with BD management in order to guide subsequent studies and initiatives.

METHODS

Three focus groups were conducted where patients and their family members (total n = 34) formulated questions around the central theme, "What do you wish you had known in advance or over the course of treatment for BD?" In an affinity mapping exercise, participants clustered their questions and ranked the resulting categories by importance. The research team and members of our patient partner advisory council further rated the questions by expected impact on patients. Using a Theory of Constraints systems thinking approach, several causal models of BD management challenges and their potential solution were developed with patients using the focus group data.

RESULTS

A total of 369 research questions were mapped to 33 categories revealing 10 broad themes. The top priorities for patient stakeholders involved pharmacotherapy and treatment alternatives. Analysis of causal relationships underlying 47 patient concerns revealed two core conflicts: for patients, whether or not to take pharmacotherapy, and for mental health services, the dilemma of care quality vs quantity.

CONCLUSIONS

To alleviate the core conflicts identified, BD management requires a coordinated multidisciplinary approach including: improved access to mental health services, objective diagnostics, sufficient provider visit time, evidence-based individualized treatment, and psychosocial support.

Status report from Norway: Implementation of patient involvement in Norwegian health care

Norway has traditionally high standards regarding civil rights particularly emphasizing equal access to societal resources including health care. This background and the health care system's centralized national organization make it perfectly suited for implementation of shared decision making (SDM). In recent years, great efforts have been made by policy- makers, regional health authorities and not least the patients to facilitate a process of change in health communication culture. SDM is currently even given highest priority in health care strategies on all system levels. SDM has been structurally implemented, e.g. by including corresponding guidance in the standard patient pathways. Moreover, SDM is established as an element of service on the national health portal hosting a constantly increasing number of decision aids. Essentially the Norwegian Knowledge Center for Health Services contributes by searching and providing information for use in decision aids. Implementation is now being rolled out unit by unit for a list of medical problems as a series production of SDM using decision aids and health professional training. Importantly, production of SDM begins and succeeds as a soundly structured communication with both clinical environments and patients. However, as communication training has not been implemented before now, there are no data demonstrating sufficient realization of SDM in current health care. Beyond making reasonable use of scientific achievements, the Norwegian movement's secret of success is the simultaneous commitment of all actors of the health system to a common idea.