Early assessment of innovation in a healthcare setting

Innovation bundles and platforms - a qualitative analysis of health system responses to the COVID-19 pandemic

BACKGROUND

Health systems underwent substantial changes to respond to COVID-19. Learning from the successes and failures of health system COVID-19 responses may help us understand how future health service responses can be designed to be both effective and sustainable. This study aims to identify the role that innovation played in crafting health service responses during the COVID-19 pandemic.

METHODS

Semi-structured interviews were conducted online, exploring 19 health professionals' experiences in responding to COVID-19 in a large State health system in Australia. The data were collected from April to September 2022 and analysed utilising constant comparative analysis. The degree of innovation in health service responses was assessed by comparing them to pre-pandemic services using 5 categories adopted from the IMPISCO (Investigators, Methods, Population, Intervention, Setting, Comparators and Outcomes) framework, which classifies interventional fidelity as: 1/ Identical: No differences are found between health services; 2/ Substitution with alternatives that perform the same function, 3/ In-class replacement with elements that delivers roughly the same functionality, 4/ Augmentation with new functions, 5/ Creation of new elements. Services were decomposed into bundles and fidelity labels were assigned to individual bundle elements.

RESULTS

New services were typically created by reconfiguring existing ones rather than being created de novo. The presence of pre-existing infrastructure (foundational technologies) was seen as critical in mounting fast health service responses. Absence of infrastructure was associated with delays and impaired system responses.

CONCLUSIONS

The need to reconfigure rapidly and use infrastructure to support this suggests we reconceive health services as a platform (a general-purpose service upon which other elements can be added for specific functions), where a common core service (such as a primary care practice) can be extended by adding specialised functions using mediators which facilitate the connection (such as virtual service capabilities). Innovation can be costly and time consuming in crises, and during the COVID-19 pandemic, innovations were typically patched together from pre-existing services. The notion of platforms seems a promising way to prepare the health system for future shocks.

Early practice of use of video consultations in rehabilitation of hand injuries in children and adults: Content, acceptability, and cost-effectiveness

BACKGROUND

Video consultation was implemented as a new service in a hospital hand therapy setting.

PURPOSE

To describe the first year's practice of video consultations in the rehabilitation of upper extremity injuries, evaluate the acceptability, and investigate economic effects.

STUDY DESIGN

Iterative design including economic evaluation.

METHODS

Using the framework early health technology assessment, 13 hand therapists described characteristics of 99 video consultations, under predefined headlines: the patients' municipally, adult vs child, time use, technical, content, and usefulness compared to physical consultations. The text was coded and categorized according to 22 techniques or tools used by hand therapists, and challenges were identified. Acceptability was assessed on a three-graded adjectival scale. To illustrate the costs associated with video vs physical consultations, we drafted different scenarios based on the data and stakeholder insights.

RESULTS

Of 99 planned video consultations (16 with children), 88 were completed. Techniques or tools most frequently used were the performance of exercises (n = 55), orthoses (n = 26), and daily activities (n = 23). Technical challenges were common, and observation of children could be difficult. Eleven of the completed consultations were rated as not acceptable and 77 as acceptable and as either useful (n = 28) or very useful (n = 49). Four drafted scenarios showed cost savings of video consultations for the health institution and society, highest at longer travel distances and in other cases where the patient could claim refunds related to travel and time away from work and home.

CONCLUSIONS

The results show therapeutic possibilities and points to areas for improvements and illustrate settings where the use of video may save costs for the health institution and society.

The effect of employment support integrated in substance use treatment: A health economic cost-effectiveness simulation of three different interventions

Background: Unemployment rates for individuals in treatment for substance use disorder (SUD) are high, with Norwegian estimates in the range of 81%–89%. Although Individual Placement and Support (IPS) represents a promising method to improved vocational outcome, cross-disciplinary investigations are needed to document implementation benefits and address reimbursements needs. The aim of this study was to model the potential socioeconomic value of employment support integrated in SUD treatment. Methods: Based on scientific publications, an ongoing randomised controlled trial (RCT) on employment support integrated in SUD treatment, and publicly available economy data, we made qualified assumptions about costs and socioeconomic gain for the different interventions targeting employment for patients with SUD: (1) treatment as usual (TAU); (2) TAU and a self-help guide and a workshop; and (3) TAU and IPS. For each intervention, we simulated three different outcome scenarios based on 100 patients. Results: Assuming a 40% employment rate and full-time employment (100%) for 10 years following IPS, we found a 10-year socioeconomic effect of €18,732,146. The corresponding effect for the more conservative TAU + IPS simulation assuming 40% part-time positions (25%) for five years, was €2,519,906. Compared to the two alternative interventions, IPS was cost-effective and more beneficial after six months to two years. Discussion: This concept evaluation study suggests that integrating employment support in the health services is socioeconomically beneficial. Our finding is relevant for decision makers within politics and health. Once employment rates from our ongoing RCT is available, real-life data will be applied to adjust model assumptions and socioeconomic value assumptions.

Methods for Early Assessment of the Societal Value of Health Technologies: A Scoping Review and Proposal for Classification

OBJECTIVES

Early assessments of health technologies help to better align and integrate their development and assessment. Such assessments can take many forms and serve different purposes, hampering users in their selection of the most appropriate method for a specific goal. The aim of this scoping review was to structure the large set of methods according to their specific goal.

METHODS

A scoping review was conducted using PubMed and reference lists of retrieved articles, to identify review studies with a methodological focus. From the included reviews, all individual methods were listed. Based on additional literature and examples, we extracted the specific goal of each method. All goals were clustered to derive a set of subclasses and methods were grouped into these subclasses.

RESULTS

Of the 404 screened, 5 reviews were included, and 1 was added when searching reference lists. The reviews described 56 methods, of which 43 (77%) were included and classified as methods to (1) explore the nature and magnitude of the problem, (2) estimate the nature and magnitude of the expected (societal) value, (3) identify conditions for the potential value to materialize, and (4) help develop and design the type of research that is needed.

CONCLUSIONS

The wide range of methods for exploring the societal value of health technologies at an early stage of development can be subdivided into a limited number of classes, distinguishing methods according to their specific objective. This facilitates selection of appropriate methods, depending on the specific needs and aims.

A toolkit of methods of development-focused health technology assessment

Health technology assessment conducted to inform decisions during technology development (development-focused or DF-HTA) has a number of distinct features compared with HTA conducted to inform reimbursement and usage decisions. In particular, there are a broad range of decisions to be informed related to the development of a technology; multiple markets and decision makers to be considered; a limited (and developing) evidence base; and constrained resources for analysis. These features impact upon methods adopted by analysts. In this paper, we (i) set out methods of DF-HTA against a timeline of technology development; (ii) provide examples of the methods’ use; and (iii) explain how they have been adapted as a result of the features of DF-HTA. We present a toolkit of methods for analysts working with developers of medical technologies. Three categories of methods are described: literature review, stakeholder consultation, and decision analytic modeling. Literature review and stakeholder consultation are often used to fill evidence gaps. Decision analytic modeling is used to synthesize available evidence alongside plausible assumptions to inform developers about price or performance requirements. Methods increase in formality and complexity as the development and evidence base progresses and more resources are available for assessment. We hope this toolkit will be used in conjunction with the framework of features of DF-HTA presented in our earlier article in order to improve the clarity and appropriateness of methods of HTA used in DF-HTA. We also seek to contribute to a continuing dialogue about the nature of, and the best approach to, DF-HTA.

Enabling Guidelines for the Adoption of eHealth Solutions: Scoping Review

BACKGROUND

Globally, public health care is under increasing pressure, an economic burden currently amplified by the COVID-19 outbreak. With the recognition that universal health coverage improves the health of a population and reduces health inequalities, universal health coverage has been acknowledged as a priority goal. To meet the global needs in a population with increased chronic illness and longer life expectancy, the health care system is in dire need of new, emerging technologies. eHealth solutions as a method of delivery may have an impact on quality of care and health care costs. As such, it is important to study methods previously used to avoid suboptimal implementation and promote general guidelines to further develop eHealth solutions.

OBJECTIVE

This study aims to explore and thematically categorize a selected representation of early phase studies on eHealth technologies, focusing on papers that are under development or undergoing testing. Further, we want to assess enablers and barriers in terms of usability, scaling, and data management of eHealth implementation. The aim of this study to explore early development phase and feasibility studies was an intentional effort to provide applicable guidelines for evaluation at different stages of implementation.

METHODS

A structured search was performed in PubMed, MEDLINE, and Cochrane to identify and provide insight in current eHealth technology and methodology under development and gain insight in the future potential of eHealth technologies.

RESULTS

In total, 27 articles were included in this review. The clinical studies were categorized thematically by illness comparing 4 technology types deemed relevant: apps/web-based technology, sensor technology, virtual reality, and television. All eHealth assessment and implementation studies were categorized by their focus point: usability, scaling, or data management. Studies assessing the effect of eHealth were divided into feasibility studies, qualitative studies, and heuristic assessments. Studies focusing on usability (16/27) mainly addressed user involvement and learning curve in the adoption of eHealth, while the majority of scaling studies (6/27) focused on strategic and organizational aspects of upscaling eHealth solutions. Studies focusing on data management (5/27) addressed data processing and data sensitivity in adoption and diffusion of eHealth. Efficient processing of data in a secure manner, as well as user involvement and feedback, both throughout small studies and during upscaling, were the important enablers considered for successful implementation of eHealth.

CONCLUSIONS

eHealth interventions have considerable potential to improve lifestyle changes and adherence to treatment recommendations. To promote efficient implementation and scaling, user involvement to promote user-friendliness, secure and adaptable data management, and strategical considerations needs to be addressed early in the development process. eHealth should be assessed during its development into health services. The wide variation in interventions and methodology makes comparison of the results challenging and calls for standardization of methods.

Identifying Persuasive Design Principles and Behavior Change Techniques Supporting End User Values and Needs in eHealth Interventions for Long-Term Weight Loss Maintenance: Qualitative Study

BACKGROUND

An increasing number of eHealth interventions aim to support healthy behaviors that facilitate weight loss. However, there is limited evidence of the effectiveness of the interventions and little focus on weight loss maintenance. Knowledge about end user values and needs is essential to create meaningful and effective eHealth interventions, and to identify persuasive system design (PSD) principles and behavior change techniques (BCTs) that may contribute to the behavior change required for successful long-term weight loss maintenance.

OBJECTIVE

This study aimed to provide insight into the design of eHealth interventions supporting behavior change for long-term weight maintenance. The study sought to identify the values and needs of people with obesity aiming to maintain weight after weight loss, and to identify PSD principles, BCTs, and design requirements that potentially enable an eHealth intervention to meet end user values and needs.

METHODS

This study presents the concept of integrating PSD principles and BCTs into the design process of eHealth interventions to meet user values and needs. In this study, individual interviews and focus groups were conducted with people with obesity (n=23) and other key stakeholders (n=27) to explore end user values and needs related to weight loss maintenance. Design thinking methods were applied during the focus group sessions to identify design elements and to explore how eHealth solutions can support the needs to achieve sustainable weight loss maintenance. The PSD model and behavior change taxonomy by Michie were used to identify PSD principles and BCT clusters to meet end user values and needs.

RESULTS

A total of 8 key end user values were identified, reflecting user needs for weight loss maintenance support: self-management, personalized care, autonomy, feel supported, positive self-image, motivation, happiness, and health. Goals and planning, feedback and monitoring, repetition and substitution, shaping knowledge, social support, identity, and self-belief were some of the BCT clusters identified to address these concepts, together with PSD principles such as personalization, tailoring, self-monitoring, praise, and suggestions.

CONCLUSIONS

The process of translating end user values and needs into design elements or features of eHealth technologies is an important part of the design process. To our knowledge, this is the first study to explore how PSD principles and BCTs can be integrated when designing eHealth self-management interventions for long-term weight loss maintenance. End users and other key stakeholders highlighted important factors to be considered in the design of eHealth interventions supporting sustained behavior change. The PSD principles and BCTs identified provide insights and suggestions about design elements and features to include for supporting weight loss maintenance. The findings indicate that a combination of BCTs and PSD principles may be needed in evidence-based eHealth interventions to stimulate motivation and adherence to support healthy behaviors and sustained weight loss maintenance.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04537988; https://clinicaltrials.gov/ct2/show/NCT04537988.

On the integration of early health technology assessment in the innovation process: reflections from five stakeholders

Early health technology assessment (HTA), which includes all methods used to inform industry and other stakeholders about the potential value of new medical products in development, including methods to quantify and manage uncertainty, has seen many applications in recent years. However, it is still unclear how such early value assessments can be integrated into the technology innovation process. This commentary contributes to the discussion on the purposes early HTA can serve. Similarities and differences in the perspectives of five stakeholders (i.e., the hospital, the patient, the assessor, the medical device industry, and the policy maker) on the purpose, value, and potential challenges of early HTA are described. All five stakeholders agreed that integrating early HTA in the innovation process has the possibility to shape and refine an innovation, and inform research and development decisions. The early assessment, using a variety of methodologies, can provide insights that are relevant for all stakeholders but several challenges, for example, feasibility and responsibility, need to be addressed before early HTA can become standard practice. For early evaluations to be successful, all relevant stakeholders including patients need to be involved. Also, nimble, flexible assessment methods are needed that fit the dynamics of medical technology. Best practices should be shared to optimize both the innovation process and the methods to perform an early value assessment.

Determining the cost-effectiveness requirements of an exoskeleton preventing second hip fractures using value of information

Background

Falls may lead to hip fractures, which have a detrimental effect on the prognosis of patients as well as a considerable impact on healthcare expenditures. Since a secondary hip fracture (SHF) may lead to even higher costs than primary fractures, the development of innovative services is crucial to limit falls and curb costs in high-risk patients. An early economic evaluation assessed which patients with a second hip fracture could benefit most from an exoskeleton preventing falls and whether its development is feasible.

Methods

The life-course of hip fractured patients presenting with dementia or cardiovascular diseases was simulated using a Markov model relying on the United Kingdom administrative data and complemented by published literature. A group of experts provided the exoskeleton parameters. Secondary analyses included a threshold analysis to identify the exoskeleton requirements (e.g. minimum impact of the exoskeleton on patients’ quality of life) leading to a reimbursable incremental cost-effectiveness ratio. Similarly, the uncertainty around these requirements was modelled by varying their standard errors and represented alongside population Expected Value of Perfect Information (EVPI).

Results

Our base-case found the exoskeleton cost-effective when providing a statistically significant reduction in SHF risk. The secondary analyses identified 286 cost-effective combinations of the exoskeleton requirements. The uncertainty around these requirements was explored producing further 22,880 scenarios, which showed that this significant reduction in SHF risk was not necessary to support the exoskeleton adoption in clinical practice. Conversely, a significant improvement in women quality of life was crucial to obtain an acceptable population EVPI regardless of the cost of the exoskeleton.

Conclusions

Our study identified the exoskeleton requisites to be cost-effective and the value of future research. Decision-makers could use our analyses to assess not only whether the exoskeleton could be cost-effective but also how much further research and development of the exoskeleton is worth to be pursued.

Leveraging service design for healthcare transformation: toward people-centered, integrated, and technology-enabled healthcare systems

Purpose

This paper explores how service design can contribute to the evolution of health service systems, moving them toward people-centered, integrated and technology-enabled care; the paper develops a research agenda to leverage service design research for healthcare transformation.

Design/methodology/approach

This conceptual study starts by analyzing healthcare challenges in terms of demographic trends and economic constraints, along with the problems of lack of people-centricity, dispersion of care and slowness in incorporating emerging technologies. Then, it examines the theoretical underpinnings of service design to develop a framework for exploring how a human-centered, transformative and service systems approach can contribute to addressing healthcare challenges, with illustrative cases of service design research in healthcare being given.

Findings

The proposed framework explores how a human-centered service design approach can leverage the potential of technology and advance healthcare systems toward people-centered care; how a transformative service design approach can go beyond explanatory research of healthcare phenomena to develop innovative solutions for healthcare change and wellbeing; and how a service systems perspective can address the complexity of healthcare systems, hence moving toward integrated care.

Originality/value

This paper systematizes and develops a framework for how service design can contribute to healthcare transformation. It identifies key healthcare application areas for future service design research and pathways for advancing service design in healthcare by using new interdisciplinary bridges, methodological developments and theoretical foundations.

A Web-Based Communication Platform to Improve Home Care Services in Norway (DigiHelse): Pilot Study

Background

Home care service in Norway is struggling to meet the increasing demand for health care under restricted budget constraints, although one-fourth of municipal budgets are dedicated to health services. The integration of Web-based technology in at-home care is expected to enhance communication and patient involvement, increase efficiency and reduce cost. DigiHelse is a Web-based platform designed to reinforce home care service in Norway and is currently undergoing a development process to meet the predefined needs of the country’s municipalities. Some of the main features of the platform are digital messages between residents and the home care service, highlighting information on planned and completed visits, the opportunity to cancel visits, and notifications for completed visits.

Objective

This study aimed to test the usability and economic feasibility of adopting DigiHelse in four districts in Oslo by applying registry and behavioral data collected throughout a one-year pilot study. Early health technology assessment was used to estimate the potential future value of DigiHelse, including the predictive value of behavior data.

Methods

Outcome measures identified by stakeholder insights and scenario drafting in the project’s concept phase were used to assess potential socioeconomic benefits. Aggregated data were collected to assess changes in health consumption at baseline, and then 15 and 52 weeks after DigiHelse was implemented. The present value calculation was updated with data from four intervention groups and one control group. A quasi-experimental difference-in-difference design was applied to estimate the causal effect. Descriptive behavioral data from the digital platform was applied to assess the usability of the platform.

Results

Over the total study period (52 weeks), rates increased for all outcome estimates: the number of visits (rate ratio=1.04; P=.10), unnecessary trips (rate ratio=1.37; P=.26), and phone calls (rate ratio=1.24; P=.08). A significant gap was found between the estimated value of DigiHelse in the concept phase and after the one-year pilot. In the present pilot assessment, costs are expected to exceed potential savings by €67 million (US $75 million) over ten years, as compared to the corresponding concept estimates of a potential gain of €172.6 million (US $193.6 million). Interestingly, behavioral data from the digital platform revealed that only 3.55% (121/3405) of recipients actively used the platform after one year.

Conclusions

Behavioral data provides a valuable source for assessing usability. In this pilot study, the low adoption rate may, at least in part, explain the inability of DigiHelse to perform as expected. This study points to an early assessment of behavioral data as an opportunity to identify inefficiencies and direct digital development. For DigiHelse, insight into why the recipients in Oslo have not made greater use of the Web-based platform seems to be the next step in ensuring the right improvement measures for the home care service.