Seeking Meaningful Innovation: Lessons Learned Developing, Evaluating, and Implementing the Electronic Patient-Reported Outcome Tool

Digitally mediated relationships: How social representation in technology influences the therapeutic relationship in primary care

Relationships, built on trust, knowledge, regard, and loyalty, have been demonstrated to be fundamental to health care delivery. Strong relationships between patients and providers have been linked to more compassionate care delivery, and better patient experience and outcomes, and may be particularly important in primary care. The rapid adoption of digital technologies since the onset of COVID-19 has led health care systems to seriously consider a "digital-first" primary care delivery model. Questions remain regarding what impact this transformation will have on the therapeutic relationship. Using a rapid ethnographic approach this study explores how patient and provider understandings of therapeutic relationships and digital health technologies may influence relationship-building or maintenance between patients with complex care needs and their care providers. Three team-based primary care sites in Toronto, Ontario, Canada were included in the study. Across the three sites 9 patients with chronic health conditions, 1 caregiver, and 10 healthcare providers (including family physicians, family medicine residents, social workers, and nurse practitioners) participated. Interviews were conducted with all participants and 8 observations of virtual clinical encounters (phone and video visits) were conducted. Using social representation theory as a lens, analysis revealed that participants' constructions of therapeutic relationships and digital technologies were informed by their identities, experiences, and expectations. For participants to see technologies as enabling to the therapeutic relationship, there needed to be alignment between how participants viewed the role of technology in care and in their lives, and how they recognized (or constructed) a good therapeutic relationship. This exploratory work suggests the need to think about how both patients' and providers' views of technology may determine whether digital technologies can be leveraged to meet patient needs while maintaining, or building, strong therapeutic relationships.

A Novel Hospital-to-Home System for Children With Medical Complexities: Usability Testing Study

Background

Children with medical complexity (CMC) are a group of young people who have severe complex chronic conditions, substantial family-identified service needs, functional limitations, and high health care resource use. Technology-enabled hospital-to-home interventions designed to deliver comprehensive care in the home setting are needed to ease CMC family stress, provide proactive and comprehensive care to this fragile population, and avoid hospital admissions, where possible.

Objective

In this usability testing study, we aimed to assess areas of strength and opportunity within the DigiComp Kids system, a hospital-to-home intervention for CMC and their families and care providers.

Methods

Hospital-based clinicians, family members of medically complex children, and home-based clinicians participated in DigiComp Kids usability testing. Participants were recorded and tasked to think aloud while completing usability testing tasks. Participants were scored on the metrics of effectiveness, efficiency, and satisfaction, and the total usability score was calculated using the Single Usability Metric. Participants also provided insights into user experiences during the postusability testing interviews.

Results

A total of 15 participants (5 hospital-based clinicians, 6 family members, and 4 home-based clinicians) participated in DigiComp Kids usability testing. The participants were able to complete all assigned tasks independently. Error-free rates for tasks ranged from 58% to 100%; the average satisfaction rating across groups was ≥80%, as measured by the Single Ease Question. Task times of participants were variable compared with the task times of an expert DigiComp Kids user. Single Usability Metric scores ranged from 80.5% to 89.5%. In qualitative interviews, participants stressed the need to find the right fit between user needs and the effort required to use the system. Interviews also revealed that the value of the DigiComp Kids system was in its ability to create a digital bridge between hospital and home, enabling participants to foster and maintain connections across boundaries.

Conclusions

Usability testing revealed strong scores across the groups. Insights gained include the importance of tailoring the implementation of the system to match individual user needs, streamlining key system features, and consideration of the meaning attached to system use by participants to allow for insight into system adoption and sustainment.

Developing a Mobile Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events Administration System to Capture Postradiation Toxicity in Oncology: Usability and Feasibility Study

Background

Accurate self-reported symptomatic toxicity documentation via the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) is essential throughout cancer treatment to ensure safety and understand therapeutic efficacy. However, the capture of accurate toxicities from patients undergoing radiation therapy is challenging because this is generally provided only at the time of scheduled visits.

Objective

This study seeks to establish the usability and feasibility of a mobile PRO-CTCAE Administration System (mPROS) to capture toxicities related to radiation therapy.

Methods

English-speaking adult patients who were undergoing radiation therapy for cancer were enrolled and given a brief demonstration of the Say All Your Symptoms (SAYS) and Symptom Tracking Entry Program (STEP) interfaces of the mPROS app, followed by a patient-use phase where patient actions were observed as they navigated mPROS to enter toxicities. Patient feedback was captured via a semistructured interview and brief questionnaire.

Results

We enrolled 25 patients (age: mean 60.7 years; females: n=13, 52%; White patients: n=13; 52%; non-Hispanic patients: n=19, 76%; college graduates: n=17, 68%). Patients almost equally preferred the SAYS (n=14, 56%) or STEP (n=11, 44%) interfaces, with 21 patients (84%) agreeing that they would use mPROS to report their symptoms to their health care team and 19 patients (76%) agreeing that they would recommend mPROS to others.

Conclusions

The mPROS app is usable and feasible for facilitating the patient reporting of radiation therapy–related symptomatic toxicities. A revised version of mPROS that incorporates patient input and includes electronic health record integration is being developed and validated as part of a multicenter trial.

Information Technology Ambidexterity-Driven Patient Agility, Patient Service- and Market Performance: A Variance and fsQCA Approach

Modern hospitals are on the brink of a monumental change. They are currently exploring their options to digitally transform their clinical procedures and overall patient engagement. This work thoroughly investigates how hospital departments in the Netherlands can simultaneously leverage their strategic exploration of new IT resources and practices and exploit their current IT practices, i.e., IT ambidexterity, to drive digital transformation. Specifically, we investigate IT ambidexterity’s role in shaping patient agility at the departmental level, i.e., the ability to sense patients’ needs and respond accordingly. In this study, we use the dynamic capability view as our theoretical lens to develop a theoretical model with associated hypotheses and test it using cross-sectional survey data from 90 clinical hospital departments in the Netherlands. We use partial least squares (PLS) structural equation modeling (SEM) and a Fuzzy-set qualitative comparative analysis (fsQCA) approach for our analyses. This study shows that IT ambidexterity positively influences patient agility, providing a foundation for the achievement of high patient service and market performance. Furthermore, this study’s outcomes show that IT ambidexterity is present in each configuration following the fsQCA analyses, showcasing the vital role of a dual strategic approach to IT practices. The study outcomes support the theorized model and the subsequently developed IT-driven patient agility framework and illuminate how to transform clinical practice and drive patient agility.

Towards an effective framework for integrating patient-reported outcomes in electronic health records

Background

In the past decade, electronic modalities are increasingly deployed to integrate patient-reported outcomes into electronic health records. Most popularly, patient portals are used for remote questionnaires, and tablets are provided to patients in-office in case they need help. They are both useful. But some barriers are still in the way, which place burdens on patients and clinicians in the process of routine data collection.

Objective

This study aims to describe a portable and scalable framework which can simplify the patient-reported outcome integration by mitigating the related burdens.

Methods

A framework was proposed to use a modular approach to replace the tethered approach. The framework was open-sourced on GitHub. After development and testing, it was evaluated on an instrument with 24 questions in a real clinical setting. Patients were randomly selected in every modality-based group. For objective analysis, completion time and response rate were collected. No-show data was collected and analyzed. For subjective analysis, the NASA Task Load Index was used to measure workload, and the Net Promoter Score was used to assess user satisfaction.

Results

The model could contain 46,656 questions. A quick response code could store 1120 encoded items. For remote visits, the response rate was improved compared to the portal group (76.6% vs. 61.1%). The completion time was reduced by 37.5% when compared to the tablet group and was reduced by 43.4% when compared to the portal group. The workload for clinicians and patients was both reduced significantly (p < 0.001). A higher Net Promoter Score was rated by both clinicians (89.3%) and patients (86.5%). Compared to the portal group, the no-show rate was reduced (11.7% vs. 8.6%).

Conclusions

Collecting patient-reported outcomes over a quick response code appears to be an alternative modality to enable a simplified integration. This study provides new insights to collect patient-reported outcomes with interoperability and substitutability in mind.

Information Technology Ambidexterity, Digital Dynamic Capability, and Knowledge Processes as Enablers of Patient Agility: Empirical Study

BACKGROUND

There is a limited understanding of information technology's (IT) role as an enabler of patient agility and the department's ability to respond to patients' needs and wishes adequately.

OBJECTIVE

This study aims to contribute to the insights of the validity of the hypothesized relationship among IT resources, practices and capabilities, and hospital departments' knowledge processes, and the department's ability to adequately sense and respond to patient needs and wishes (ie, patient agility).

METHODS

This study conveniently sampled data from 107 clinical hospital departments in the Netherlands and used structural equation modeling for model assessment.

RESULTS

IT ambidexterity positively enhanced the development of a digital dynamic capability (β=.69; t4999=13.43; P<.001). Likewise, IT ambidexterity also positively impacted the hospital department's knowledge processes (β=.32; t4999=2.85; P=.005). Both digital dynamic capability (β=.36; t4999=3.95; P<.001) and knowledge processes positively influenced patient agility (β=.33; t4999=3.23; P=.001).

CONCLUSIONS

IT ambidexterity promotes taking advantage of IT resources and experiments to reshape patient services and enhance patient agility.

Assessing the Implementation and Effectiveness of the Electronic Patient-Reported Outcome Tool for Older Adults With Complex Care Needs: Mixed Methods Study

Background

Goal-oriented care is being adopted to deliver person-centered primary care to older adults with multimorbidity and complex care needs. Although this model holds promise, its implementation remains a challenge. Digital health solutions may enable processes to improve adoption; however, they require evaluation to determine feasibility and impact.

Objective

This study aims to evaluate the implementation and effectiveness of the electronic Patient-Reported Outcome (ePRO) mobile app and portal system, designed to enable goal-oriented care delivery in interprofessional primary care practices. The research questions driving this study are as follows: Does ePRO improve quality of life and self-management in older adults with complex needs? What mechanisms are likely driving observed outcomes?

Methods

A multimethod, pragmatic randomized controlled trial using a stepped-wedge design and ethnographic case studies was conducted over a 15-month period in 6 comprehensive primary care practices across Ontario with a target enrollment of 176 patients. The 6 practices were randomized into either early (3-month control period; 12-month intervention) or late (6-month control period; 9-month intervention) groups. The primary outcome measure of interest was the Assessment of Quality of Life-4D (AQoL-4D). Data were collected at baseline and at 3 monthly intervals for the duration of the trial. Ethnographic data included observations and interviews with patients and providers at the midpoint and end of the intervention. Outcome data were analyzed using linear models conducted at the individual level, accounting for cluster effects at the practice level, and ethnographic data were analyzed using qualitative description and framework analysis methods.

Results

Recruitment challenges resulted in fewer sites and participants than expected; of the 176 target, only 142 (80.6%) patients were identified as eligible to participate because of lower-than-expected provider participation and fewer-than-expected patients willing to participate or perceived as ready to engage in goal-setting. Of the 142 patients approached, 45 (32%) participated. Patients set a variety of goals related to self-management, mental health, social health, and overall well-being. Owing to underpowering, the impact of ePRO on quality of life could not be definitively assessed; however, the intervention group, ePRO plus usual care (mean 15.28, SD 18.60) demonstrated a nonsignificant decrease in quality of life (t₂₄=−1.20; P=.24) when compared with usual care only (mean 21.76, SD 2.17). The ethnographic data reveal a complex implementation process in which the meaningfulness (or coherence) of the technology to individuals’ lives and work acted as a key driver of adoption and tool appraisal.

Conclusions

This trial experienced many unexpected and significant implementation challenges related to recruitment and engagement. Future studies could be improved through better alignment of the research methods and intervention to the complex and diverse clinical settings, dynamic goal-oriented care process, and readiness of provider and patient participants.

Trial Registration

ClinicalTrials.gov NCT02917954; https://clinicaltrials.gov/ct2/show/NCT02917954

Hype, evidence gaps and digital divides: Telehealth blind spots in rural Australia

Despite high unmet demand for health services across rural Australia, uptake of telehealth has been slow, piecemeal and ad hoc. We argue that widespread failure to understand telehealth as a socio-technical practice is key to understanding this slow progress. To develop this argument, we explore how technocentric approaches to telehealth have contributed to critical blind spots. First, the 'hype' associated with the technological possibilities of telehealth discourages thoughtful consideration of the unanticipated consequences when technologies are rolled out into complex social fields. Second, it contributes to critical gaps in the telehealth evidence base, and particularly a paucity of analyses focussing on the experiences of service users and patients. A third blind spot concerns the limited attention paid to the social determinants of health and digital divides in rural areas. The final blind spot we consider is an apparent reluctance to engage community stakeholders in co-designing and coproducing telehealth services. We used an iterative approach to identify studies and commentary from a range of academic fields to explain the significance of the telehealth blind spots and how they might be addressed. Insights suggest how expanding understanding of the social dimensions of telehealth could enhance its accessibility, effectiveness and responsiveness to community needs and contexts.

"It's no good but at least I've always got it round my neck": A postphenomenological analysis of reassurance in assistive technology use by older people

The provision of reassurance is seen as a goal and benefit of the use of assistive technology (AT) in supporting people to manage their health and care needs at a distance. Conceptually, reassurance in health and care settings remains under-theorised with the benefits of experiencing reassurance through technology use assumed rather than understood. UK health and social care service goals of managing safety and risk have largely been equated with providing reassurance to users of AT and their carers. What has not been explored is how reassurance is experienced variably by users of different types of technology-enabled care. We present data from 3 case studies of different technologies in use in health and social care provision, analysed through a postphenomenology and sociomaterial lens. Our findings point to reassurance as an important facet of AT provision but the intended functions and uses of technological devices alone did not account for people's experiences of reassurance. Participant narratives referred variously to the comfort of being monitored, having their illness/wellness verified by the device, feeling reassured by the promise of help if needed, and imbuing the device with symbolic meaning (when the user associated the device with meanings and functions other than its technical capabilities). The different ways in which reassurance was experienced provides a useful way of understanding the potential tensions with AT policy goals as well as the positive meaning attributed to devices in some cases. This study reaffirms the importance of AT implementation being anchored in what matters to the user.

Biosimilars in chronic inflammatory diseases: facts and remaining questions 5 years after their introduction in Europe

INTRODUCTION

Five years after the launch of the first infliximab biosimilar, biologics have found their place in the treatment of chronic inflammatory conditions, but there are remaining questions. This is a review of the introduction of antibody biosimilars in Europe; the reasons for their success and how biosimilar hesitancy was quailed.

AREAS COVERED

We provide an overview of the concepts of biosimilarity, extrapolation, and interchangeability, using examples in rheumatology and gastroenterology for illustration. A review of the evidence collected from switching studies using robust designs is included. Remaining questions such as 'inter-switching' are also discussed.

EXPERT OPINION

Biosimilars have democratized access to powerful medicines. Efficacy and safety studies provided reassuring data, but knowledge gaps persist. The availability of so-called 'bio-betters' might open new avenues and change clinical practice.