Stroke patients' utilisation of extrinsic feedback from computer-based technology in the home: a multiple case study realistic evaluation

Behavior Change Approaches in Digital Technology-Based Physical Rehabilitation Interventions Following Stroke: Scoping Review

BACKGROUND

Digital health technologies (DHTs) are increasingly used in physical stroke rehabilitation to support individuals in successfully engaging with the frequent, intensive, and lengthy activities required to optimize recovery. Despite this, little is known about behavior change within these interventions.

OBJECTIVE

This scoping review aimed to identify if and how behavior change approaches (ie, theories, models, frameworks, and techniques to influence behavior) are incorporated within physical stroke rehabilitation interventions that include a DHT.

METHODS

Databases (Embase, MEDLINE, PsycINFO, CINAHL, Cochrane Library, and AMED) were searched using keywords relating to behavior change, DHT, physical rehabilitation, and stroke. The results were independently screened by 2 reviewers. Sources were included if they reported a completed primary research study in which a behavior change approach could be identified within a physical stroke rehabilitation intervention that included a DHT. Data, including the study design, DHT used, and behavior change approaches, were charted. Specific behavior change techniques were coded to the behavior change technique taxonomy version 1 (BCTTv1).

RESULTS

From a total of 1973 identified sources, 103 (5%) studies were included for data charting. The most common reason for exclusion at full-text screening was the absence of an explicit approach to behavior change (165/245, 67%). Almost half (45/103, 44%) of the included studies were described as pilot or feasibility studies. Virtual reality was the most frequently identified DHT type (58/103, 56%), and almost two-thirds (65/103, 63%) of studies focused on upper limb rehabilitation. Only a limited number of studies (18/103, 17%) included a theory, model, or framework for behavior change. The most frequently used BCTTv1 clusters were feedback and monitoring (88/103, 85%), reward and threat (56/103, 54%), goals and planning (33/103, 32%), and shaping knowledge (33/103, 32%). Relationships between feedback and monitoring and reward and threat were identified using a relationship map, with prominent use of both of these clusters in interventions that included virtual reality.

CONCLUSIONS

Despite an assumption that DHTs can promote engagement in rehabilitation, this scoping review demonstrates that very few studies of physical stroke rehabilitation that include a DHT overtly used any form of behavior change approach. From those studies that did consider behavior change, most did not report a robust underpinning theory. Future development and research need to explicitly articulate how including DHTs within an intervention may support the behavior change required for optimal engagement in physical rehabilitation following stroke, as well as establish their effectiveness. This understanding is likely to support the realization of the transformative potential of DHTs in stroke rehabilitation.

The use of home-based digital technology to support post-stroke upper limb rehabilitation: A scoping review

OBJECTIVE

To identify, map and synthesize the extent and nature of existing studies on the use of home-based digital technology to support post-stroke upper limb rehabilitation.

DATA SOURCES

A comprehensive literature search was completed between 30 May 2022 and 05 April 2023, from seven online databases (CINAHL, Cochrane Library, PubMed, ScienceDirect, IEEExplore, Web of Science and PEDro), Google Scholar and the reference lists of already identified articles.

METHODS

A scoping review was conducted according to Arksey and O'Malley (2005), and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews. All English-language studies reporting on the use of home-based digital technology to support upper limb post-stroke rehabilitation were eligible for inclusion.

RESULTS

The search generated a total of 1895 records, of which 76 articles met the inclusion criteria. Of these, 52 were experimental studies and the rest, qualitative, case series and case studies. Of the overall 2149 participants, 2028 were stroke survivors with upper limb impairment. The majority of studies were aimed at developing, designing and/or assessing the feasibility, acceptability and efficacy of a digital system for poststroke upper limb rehabilitation in home settings. The thematic analysis found six major categories: Tele-rehabilitation (n = 29), games (n = 45), virtual reality (n = 26), sensor (n = 22), mobile technology (n = 22), and robotics (n = 8).

CONCLUSION

The digital technologies used in post-stroke upper limb rehabilitation were multimodal, and system-based comprising telerehabilitation, gamification, virtual reality, mobile technology, sensors and robotics. Furthermore, future research should focus to determine the effectiveness of these modalities.

B-Spline Modeling of Inertial Measurements for Evaluating Stroke Rehabilitation Effectiveness

Patients who experience upper-limb paralysis after stroke require continual rehabilitation. Rehabilitation must be evaluated for appropriate treatment adjustment; such evaluation can be performed using inertial measurement units (IMUs) instead of standard scales or subjective evaluations. However, IMUs produce large quantities of discretized data, and using these data directly is challenging. In this study, B-splines were used to estimate IMU trajectory data for objective evaluations of hand function and stability by using machine learning classifiers and mathematical indices. IMU trajectory data from a 2018 study on upper-limb rehabilitation were used to validate the proposed method. Features extracted from B -spline trajectories could be used to classify individuals in the 2018 study with high accuracy, and the proposed indices revealed differences between these groups. Compared with conventional rehabilitation evaluation methods, the proposed method is more objective and effective.

Methods in realist evaluation: A mapping review

Realist evaluation is becoming increasingly popular as an evaluation methodology. Its main objective is to uncover the mechanisms that lead to observed outcomes following an intervention and the contextual conditions that enabled this. The focus is on explaining why, for whom and in what circumstances an intervention works. It is a theory-driven approach and is explicitly method neutral, meaning that both quantitative and qualitative data collection methods can be used to unearth the underlying mechanisms that cause the intervention outcomes. In this review, we aim to map the methods used in realist evaluation studies, to draw lessons from the findings and to reflect on ways forward. We found that qualitative methods and interviews specifically are most commonly used in realist evaluations; that theory is often absent behind the methods and sampling techniques used; and that more innovative methods remain underexplored. We conclude the review by proposing four ways forward: (1) developing realist surveys, (2) exploring the relevance of innovative methods, (3) increasing the attention paid to sampling procedures and (4) strengthening the theory-driven nature of method. We believe that these four action points can strengthen the practice of realist evaluation and its outcomes.

Factors that influence the provision of home-based rehabilitation services for people needing rehabilitation: a qualitative evidence synthesis

BACKGROUND

To increase people's access to rehabilitation services, particularly in the context of the COVID-19 pandemic, we need to explore how the delivery of these services can be adapted. This includes the use of home-based rehabilitation and telerehabilitation. Home-based rehabilitation services may become frequently used options in the recovery process of patients, not only as a solution to accessibility barriers, but as a complement to the usual in-person inpatient rehabilitation provision. Telerehabilitation is also becoming more viable as the usability and availability of communication technologies improve.

OBJECTIVES

To identify factors that influence the organisation and delivery of in-person home-based rehabilitation and home-based telerehabilitation for people needing rehabilitation.

SEARCH METHODS

We searched PubMed, Global Health, the VHL Regional Portal, Epistemonikos, Health Systems Evidence, and EBM Reviews as well as preprints, regional repositories, and rehabilitation organisations websites for eligible studies, from database inception to search date in June 2022.  SELECTION CRITERIA: We included studies that used qualitative methods for data collection and analysis; and that explored patients, caregivers, healthcare providers and other stakeholders' experiences, perceptions and behaviours about the provision of in-person home-based rehabilitation and home-based telerehabilitation services responding to patients' needs in different phases of their health conditions.   DATA COLLECTION AND ANALYSIS: We used a purposive sampling approach and applied maximum variation sampling in a four-step sampling frame. We conducted a framework thematic analysis using the CFIR (Consolidated Framework for Implementation Research) framework as our starting point. We assessed our confidence in the findings using the GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative research) approach.  MAIN RESULTS: We included 223 studies in the review and sampled 53 of these for our analysis. Forty-five studies were conducted in high-income countries, and eight in low-and middle-income countries. Twenty studies addressed in-person home-based rehabilitation, 28 studies addressed home-based telerehabilitation services, and five studies addressed both modes of delivery. The studies mainly explored the perspectives of healthcare providers, patients with a range of different health conditions, and their informal caregivers and family members.  Based on our GRADE-CERQual assessments, we had high confidence in eight of the findings, and moderate confidence in five, indicating that it is highly likely or likely respectively that these findings are a reasonable representation of the phenomenon of interest. There were two findings with low confidence. High and moderate confidence findings Home-based rehabilitation services delivered in-person or through telerehabilitation  Patients experience home-based services as convenient and less disruptive of their everyday activities. Patients and providers also suggest that these services can encourage patients' self-management and can make them feel empowered about the rehabilitation process. But patients, family members, and providers describe privacy and confidentiality issues when services are provided at home. These include the increased privacy of being able to exercise at home but also the loss of privacy when one's home life is visible to others.  Patients and providers also describe other factors that can affect the success of home-based rehabilitation services. These include support from providers and family members, good communication with providers, the requirements made of patients and their surroundings, and the transition from hospital to home-based services. Telerehabilitation specifically Patients, family members and providers see telerehabilitation as an opportunity to make services more available. But providers point to practical problems when assessing whether patients are performing their exercises correctly. Providers and patients also describe interruptions from family members.  In addition, providers complain of a lack of equipment, infrastructure and maintenance and patients refer to usability issues and frustration with digital technology. Providers have different opinions about whether telerehabilitation is cost-efficient for them. But many patients see telerehabilitation as affordable and cost-saving if the equipment and infrastructure have been provided. Patients and providers suggest that telerehabilitation can change the nature of their relationship. For instance, some patients describe how telerehabilitation leads to easier and more relaxed communication. Other patients describe feeling abandoned when receiving telerehabilitation services.  Patients, family members and providers call for easy-to-use technologies and more training and support. They also suggest that at least some in-person sessions with the provider are necessary. They feel that telerehabilitation services alone can make it difficult to make meaningful connections. They also explain that some services need the provider's hands. Providers highlight the importance of personalising the services to each person's needs and circumstances.

AUTHORS' CONCLUSIONS

This synthesis identified several factors that can influence the successful implementation of in-person home-based rehabilitation and telerehabilitation services. These included factors that facilitate implementation, but also factors that can challenge this process. Healthcare providers, program planners and policymakers might benefit from considering these factors when designing and implementing programmes.

Toward the Value Sensitive Design of eHealth Technologies to Support Self-management of Cardiovascular Diseases: Content Analysis

BACKGROUND

eHealth can revolutionize the way self-management support is offered to chronically ill individuals such as those with a cardiovascular disease (CVD). However, patients' fluctuating motivation to actually perform self-management is an important factor for which to account. Tailoring and personalizing eHealth to fit with the values of individuals promises to be an effective motivational strategy. Nevertheless, how specific eHealth technologies and design features could potentially contribute to values of individuals with a CVD has not been explicitly studied before.

OBJECTIVE

This study sought to connect a set of empirically validated, health-related values of individuals with a CVD with existing eHealth technologies and their design features. The study searched for potential connections between design features and values with the goal to advance knowledge about how eHealth technologies can actually be more meaningful and motivating for end users.

METHODS

Undertaking a technical investigation that fits with the value sensitive design framework, a content analysis of existing eHealth technologies was conducted. We matched 11 empirically validated values of CVD patients with 70 design features from 10 eHealth technologies that were previously identified in a systematic review. The analysis consisted mainly of a deductive coding stage performed independently by 3 members of the study team. In addition, researchers and developers of 6 of the 10 reviewed technologies provided input about potential feature-value connections.

RESULTS

In total, 98 connections were made between eHealth design features and patient values. This meant that some design features could contribute to multiple values. Importantly, some values were more often addressed than others. CVD patients' values most often addressed were related to (1) having or maintaining a healthy lifestyle, (2) having an overview of personal health data, (3) having reliable information and advice, (4) having extrinsic motivators to accomplish goals or health-related activities, and (5) receiving personalized care. In contrast, values less often addressed concerned (6) perceiving low thresholds to access health care, (7) receiving social support, (8) preserving a sense of autonomy over life, and (9) not feeling fear, anxiety, or insecurity about health. Last, 2 largely unaddressed values were related to (10) having confidence and self-efficacy in the treatment or ability to achieve goals and (11) desiring to be seen as a person rather than a patient.

CONCLUSIONS

Positively, existing eHealth technologies could be connected with CVD patients' values, largely through design features that relate to educational support, self-monitoring support, behavior change support, feedback, and motivational incentives. Other design features such as reminders, prompts or cues, peer-based or expert-based human support, and general system personalization were also connected with values but in narrower ways. In future studies, the inferred feature-value connections must be validated with empirical data from individuals with a CVD or similar chronic conditions.

The role of a virtual avatar in attention and memory tasks in Rett syndrome

Background

Since subjects with Rett syndrome (RTT) focus their attention mainly on the faces of people with whom they interact, in this study the role of a human-like smart interactive agent (an avatar) in enhancing cognitive processes is examined. More in depth, this study aimed to understand if, and to what extent, the use of an avatar can improve attention and memory abilities in subjects with RTT.

Method

Thirty-six subjects with RTT participated in the study. All participants performed over-selectivity and memory tasks, for a total of six trials. These trials were randomly presented in two different conditions: with and without virtual avatar.

Results

The results indicated that the participants improved their attention and memory abilities when they performed the tasks with the avatar. There were no improvements when they performed the tasks without the avatar.

Discussion

The results were discussed considering the relationship between motivation, attention and memory in RTT.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12883-021-02212-w.

Perseverance with technology-facilitated home-based upper limb practice after stroke: a systematic mixed studies review

Background

Technology is being increasingly investigated as an option to allow stroke survivors to exploit their full potential for recovery by facilitating home-based upper limb practice. This review seeks to explore the factors that influence perseverance with technology-facilitated home-based upper limb practice after stroke.

Methods

A systematic mixed studies review with sequential exploratory synthesis was undertaken. Studies investigating adult stroke survivors with upper limb disability undertaking technology-facilitated home-based upper limb practice administered ≥ 3 times/week over a period of ≥ 4 weeks were included. Qualitative outcomes were stroke survivors’ and family members’ perceptions of their experience utilising technology to facilitate home-based upper limb practice. Quantitative outcomes were adherence and dropouts, as surrogate measures of perseverance. The Mixed Methods Appraisal Tool was used to assess quality of included studies.

Results

Forty-two studies were included. Six studies were qualitative and of high quality; 28 studies were quantitative and eight were mixed methods studies, all moderate to low quality. A conceptual framework of perseverance with three stages was formed: (1) getting in the game; (2) sticking with it, and; (3) continuing or moving on. Conditions perceived to influence perseverance, and factors mediating these conditions were identified at each stage. Adherence with prescribed dose ranged from 13 to 140%. Participants were found to be less likely to adhere when prescribed sessions were more frequent (6–7 days/week) or of longer duration (≥ 12 weeks).

Conclusion

From the mixed methods findings, we propose a framework for perseverance with technology-facilitated home-based upper limb practice. The framework offers opportunities for clinicians and researchers to design strategies targeting factors that influence perseverance with practice, in both the clinical prescription of practice and technology design. To confirm the clinical utility of this framework, further research is required to explore perseverance and the factors influencing perseverance.

Registration: PROSPERO CRD42017072799—https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=72799

Guideline Development for Technological Interventions for Children and Young People to Self-Manage Attention Deficit Hyperactivity Disorder: Realist Evaluation

BACKGROUND

Attention deficit hyperactivity disorder (ADHD) is a complex neurodevelopmental disorder characterized by inattention, hyperactivity, and impulsivity. ADHD can affect the individual, the individual's family, and the community. ADHD is managed using pharmacological and nonpharmacological treatments, which principally involves others helping children and young people (CAYP) manage their ADHD rather than learning self-management strategies themselves. Over recent years, technological developments have meant that technology has been harnessed to create interventions to facilitate the self-management of ADHD in CAYP. Despite a clear potential to improve the effectiveness and personalization of interventions, there are currently no guidelines based on existing evidence or theories to underpin the development of technologies that aim to help CAYP self-manage their ADHD.

OBJECTIVE

The aim of this study was to create evidence-based guidelines with key stakeholders who will provide recommendations for the future development of technological interventions, which aim to specifically facilitate the self-management of ADHD.

METHODS

A realist evaluation (RE) approach was adopted over 5 phases. Phase 1 involved identifying propositions (or hypotheses) outlining what could work for such an intervention. Phase 2 involved the identification of existing middle-range theories of behavior change to underpin the propositions. Phase 3 involved the identification and development of context mechanism outcome configurations (CMOCs), which essentially state which elements of the intervention could be affected by which contexts and what the outcome of these could be. Phase 4 involved the validation and refinement of the propositions from phase 1 via interviews with key stakeholders (CAYP with ADHD, their parents and specialist clinicians). Phase 5 involved using information gathered during phases 1 to 4 to develop the guidelines.

RESULTS

A total of 6 specialist clinicians, 8 parents, and 7 CAYP were recruited to this study. Overall, 7 key themes were identified: (1) positive rewarding feedback, (2) downloadable gaming resources, (3) personalizable and adaptable components, (4) psychoeducation component, (5) integration of self-management strategies, (6) goal setting, and (7) context (environmental and personal). The identified mechanisms interacted with the variable contexts in which a complex technological intervention of this nature could be delivered.

CONCLUSIONS

Complex intervention development for complex populations such as CAYP with ADHD should adopt methods such as RE, to account for the context it is delivered in, and co-design, which involves developing the intervention in partnership with key stakeholders to increase the likelihood that the intervention will succeed. The development of the guidelines outlined in this paper could be used for the future development of technologies that aim to facilitate self-management in CAYP with ADHD.

Stroke Patients' Acceptance of a Smart Garment for Supporting Upper Extremity Rehabilitation

The objective is to evaluate to which extent that Zishi a garment equipped with sensors that can support posture monitoring can be used in upper extremity rehabilitation training of stroke patients. Seventeen stroke survivors (mean age: 55 years old, SD =13.5) were recruited in three hospitals in Shanghai. Patients performed 4 tasks (analytical shoulder flexion, functional shoulder flexion placing a cooking pot, analytical flexion in the scapular plane, and functional flexion in the scapular plane placing a bottle of water) with guided feedback on a tablet that was provided through inertial sensors embedded in the Zishi system at the scapula and the thoracic spine region. After performing the training tasks, patients completed four questionnaires for assessing their motivation, their acceptance of the system, its credibility, and usability. The study participants were highly motivated to train with Zishi and the system was rated high usability, while the subjects had moderate confidence with technology supported training in comparison with the training with therapists. The patients respond positively to using Zishi to support rehabilitation training in a clinical setting. Further developments need to address more on engaging and adaptive feedback. This paper paves the way for larger scale effectiveness studies.

Quality and reporting standards, resources, training materials and information for realist evaluation: the RAMESES II project

Background

Many of the problems confronting policy- and decision-makers, evaluators and researchers today are complex, as are the interventions designed to tackle them. Their success depends both on individuals’ responses and on the wider context of people’s lives. Realist evaluation tries to make sense of these complex interventions. It is a form of theory-driven evaluation, based on realist philosophy, that aims to understand why these complex interventions work, how, for whom, in what context and to what extent.

Objectives

Our objectives were to develop (a) quality standards, (b) reporting standards, (c) resources and training materials, (d) information and resources for patients and other lay participants and (e) to build research capacity among those interested in realist evaluation.

Methods

To develop the quality and reporting standards, we undertook a thematic review of the literature, supplemented by our content expertise and feedback from presentations and workshops. We synthesised findings into briefing materials for realist evaluations for the Delphi panel (a structured method using experts to develop consensus). To develop our resources and training materials, we drew on our experience in developing and delivering education materials, feedback from the Delphi panel, the RAMESES JISCMail e-mail list, training workshops and feedback from training sessions. To develop information and resources for patients and other lay participants in realist evaluation, we convened a group consisting of patients and the public. We built research capacity by running workshops and training sessions.

Results

Our literature review identified 152 realist evaluations, and when 37 of these had been analysed we were able to develop our briefing materials for the Delphi panel. The Delphi panel comprised 35 members from 27 organisations across six countries and five disciplines. Within three rounds, the panels had reached a consensus on 20 key reporting standards. The quality standards consist of eight criteria for realist evaluations. We developed resources and training materials for 15 theoretical and methodological topics. All resources are available online (www.ramesesproject.org). We provided methodological support to 17 projects and presentations or workshops to help build research capacity in realist evaluations to 29 organisations. Finally, we produced a generic patient information leaflet for lay participants in realist evaluations.

Limitations

Our project had ambitious goals that created a substantial workload, leading to the need to prioritise objectives. For example, we truncated the literature review and focused on standards and training material development.

Conclusions

Although realist evaluation holds much promise, misunderstandings and misapplications of it are common. We hope that our project’s outputs and activities will help to address these problems. Our resources are the start of an iterative journey of refinement and development of better resources for realist evaluations. The RAMESES II project seeks not to produce the last word on these issues, but to capture current expertise and establish an agreed state of the science. Much methodological development is needed in realist evaluation but this can take place only if there is a sufficient pool of highly skilled realist evaluators. Capacity building is the next key step in realist evaluation.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

Interactive wearable systems for upper body rehabilitation: a systematic review

Background

The development of interactive rehabilitation technologies which rely on wearable-sensing for upper body rehabilitation is attracting increasing research interest. This paper reviews related research with the aim: 1) To inventory and classify interactive wearable systems for movement and posture monitoring during upper body rehabilitation, regarding the sensing technology, system measurements and feedback conditions; 2) To gauge the wearability of the wearable systems; 3) To inventory the availability of clinical evidence supporting the effectiveness of related technologies.

Method

A systematic literature search was conducted in the following search engines: PubMed, ACM, Scopus and IEEE (January 2010–April 2016).

Results

Forty-five papers were included and discussed in a new cuboid taxonomy which consists of 3 dimensions: sensing technology, feedback modalities and system measurements. Wearable sensor systems were developed for persons in: 1) Neuro-rehabilitation: stroke (n = 21), spinal cord injury (n = 1), cerebral palsy (n = 2), Alzheimer (n = 1); 2) Musculoskeletal impairment: ligament rehabilitation (n = 1), arthritis (n = 1), frozen shoulder (n = 1), bones trauma (n = 1); 3) Others: chronic pulmonary obstructive disease (n = 1), chronic pain rehabilitation (n = 1) and other general rehabilitation (n = 14). Accelerometers and inertial measurement units (IMU) are the most frequently used technologies (84% of the papers). They are mostly used in multiple sensor configurations to measure upper limb kinematics and/or trunk posture. Sensors are placed mostly on the trunk, upper arm, the forearm, the wrist, and the finger. Typically sensors are attachable rather than embedded in wearable devices and garments; although studies that embed and integrate sensors are increasing in the last 4 years. 16 studies applied knowledge of result (KR) feedback, 14 studies applied knowledge of performance (KP) feedback and 15 studies applied both in various modalities. 16 studies have conducted their evaluation with patients and reported usability tests, while only three of them conducted clinical trials including one randomized clinical trial.

Conclusions

This review has shown that wearable systems are used mostly for the monitoring and provision of feedback on posture and upper extremity movements in stroke rehabilitation. The results indicated that accelerometers and IMUs are the most frequently used sensors, in most cases attached to the body through ad hoc contraptions for the purpose of improving range of motion and movement performance during upper body rehabilitation. Systems featuring sensors embedded in wearable appliances or garments are only beginning to emerge. Similarly, clinical evaluations are scarce and are further needed to provide evidence on effectiveness and pave the path towards implementation in clinical settings.

A Personalized Self-Management Rehabilitation System for Stroke Survivors: A Quantitative Gait Analysis Using a Smart Insole

BACKGROUND

In the United Kingdom, stroke is the single largest cause of adult disability and results in a cost to the economy of £8.9 billion per annum. Service needs are currently not being met; therefore, initiatives that focus on patient-centered care that promote long-term self-management for chronic conditions should be at the forefront of service redesign. The use of innovative technologies and the ability to apply these effectively to promote behavior change are paramount in meeting the current challenges.

OBJECTIVE

Our objective was to gain a deeper insight into the impact of innovative technologies in support of home-based, self-managed rehabilitation for stroke survivors. An intervention of daily walks can assist with improving lower limb motor function, and this can be measured by using technology. This paper focuses on assessing the usage of self-management technologies on poststroke survivors while undergoing rehabilitation at home.

METHODS

A realist evaluation of a personalized self-management rehabilitation system was undertaken in the homes of stroke survivors (N=5) over a period of approximately two months. Context, mechanisms, and outcomes were developed and explored using theories relating to motor recovery. Participants were encouraged to self-manage their daily walking activity; this was achieved through goal setting and motivational feedback. Gait data were collected and analyzed to produce metrics such as speed, heel strikes, and symmetry. This was achieved using a "smart insole" to facilitate measurement of walking activities in a free-living, nonrestrictive environment.

RESULTS

Initial findings indicated that 4 out of 5 participants performed better during the second half of the evaluation. Performance increase was evident through improved heel strikes on participants' affected limb. Additionally, increase in performance in relation to speed was also evident for all 5 participants. A common strategy emerged across all but one participant as symmetry performance was sacrificed in favor of improved heel strikes. This paper evaluates compliance and intensity of use.

CONCLUSION

Our findings suggested that 4 out of the 5 participants improved their ability to heel strike on their affected limb. All participants showed improvements in their speed of gait measured in steps per minute with an average increase of 9.8% during the rehabilitation program. Performance in relation to symmetry showed an 8.5% average decline across participants, although 1 participant improved by 4%. Context, mechanism, and outcomes indicated that dual motor learning and compensatory strategies were deployed by the participants.

Assessing Walking Strategies Using Insole Pressure Sensors for Stroke Survivors

Insole pressure sensors capture the different forces exercised over the different parts of the sole when performing tasks standing up such as walking. Using data analysis and machine learning techniques, common patterns and strategies from different users to achieve different tasks can be automatically extracted. In this paper, we present the results obtained for the automatic detection of different strategies used by stroke survivors when walking as integrated into an Information Communication Technology (ICT) enhanced Personalised Self-Management Rehabilitation System (PSMrS) for stroke rehabilitation. Fourteen stroke survivors and 10 healthy controls have participated in the experiment by walking six times a distance from chair to chair of approximately 10 m long. The Rivermead Mobility Index was used to assess the functional ability of each individual in the stroke survivor group. Several walking strategies are studied based on data gathered from insole pressure sensors and patterns found in stroke survivor patients are compared with average patterns found in healthy control users. A mechanism to automatically estimate a mobility index based on the similarity of the pressure patterns to a stereotyped stride is also used. Both data gathered from stroke survivors and healthy controls are used to evaluate the proposed mechanisms. The output of trained algorithms is applied to the PSMrS system to provide feedback on gait quality enabling stroke survivors to self-manage their rehabilitation.

RAMESES II reporting standards for realist evaluations

BACKGROUND

Realist evaluation is increasingly used in health services and other fields of research and evaluation. No previous standards exist for reporting realist evaluations. This standard was developed as part of the RAMESES II project. The project's aim is to produce initial reporting standards for realist evaluations.

METHODS

We purposively recruited a maximum variety sample of an international group of experts in realist evaluation to our online Delphi panel. Panel members came from a variety of disciplines, sectors and policy fields. We prepared the briefing materials for our Delphi panel by summarising the most recent literature on realist evaluations to identify how and why rigour had been demonstrated and where gaps in expertise and rigour were evident. We also drew on our collective experience as realist evaluators, in training and supporting realist evaluations, and on the RAMESES email list to help us develop the briefing materials. Through discussion within the project team, we developed a list of issues related to quality that needed to be addressed when carrying out realist evaluations. These were then shared with the panel members and their feedback was sought. Once the panel members had provided their feedback on our briefing materials, we constructed a set of items for potential inclusion in the reporting standards and circulated these online to panel members. Panel members were asked to rank each potential item twice on a 7-point Likert scale, once for relevance and once for validity. They were also encouraged to provide free text comments.

RESULTS

We recruited 35 panel members from 27 organisations across six countries from nine different disciplines. Within three rounds our Delphi panel was able to reach consensus on 20 items that should be included in the reporting standards for realist evaluations. The overall response rates for all items for rounds 1, 2 and 3 were 94 %, 76 % and 80 %, respectively.

CONCLUSION

These reporting standards for realist evaluations have been developed by drawing on a range of sources. We hope that these standards will lead to greater consistency and rigour of reporting and make realist evaluation reports more accessible, usable and helpful to different stakeholders.

Virtual rehabilitation: What are the practical barriers for home-based research?

Virtual reality technologies are becoming increasingly accessible and affordable to deliver, and consequently the interest in applying virtual reality within rehabilitation is growing. This has resulted in the emergence of research exploring the utility of virtual reality and interactive video gaming interventions for home use by patients. The aim of this paper is to highlight the practical factors and difficulties that may be encountered in research in this area, and to make recommendations for addressing these. Whilst this paper focuses on examples drawn mainly from stroke rehabilitation research, many of the issues raised are relevant to other conditions where virtual reality approaches have the potential to be applied to home-based rehabilitation.

Coaching or gaming? Implications of strategy choice for home based stroke rehabilitation

Background

The enduring aging of the world population and prospective increase of age-related chronic diseases urge the implementation of new models for healthcare delivery. One strategy relies on ICT (Information and Communications Technology) home-based solutions allowing clients to pursue their treatments without institutionalization. Stroke survivors are a particular population that could strongly benefit from such solutions, but is not yet clear what the best approach is for bringing forth an adequate and sustainable usage of home-based rehabilitation systems. Here we explore two possible approaches: coaching and gaming.

Methods

We performed trials with 20 healthy participants and 5 chronic stroke survivors to study and compare execution of an elbow flexion and extension task when performed within a coaching mode that provides encouragement or within a gaming mode. For each mode we analyzed compliance, arm movement kinematics and task scores. In addition, we assessed the usability and acceptance of the proposed modes through a customized self-report questionnaire.

Results

In the healthy participants sample, 13/20 preferred the gaming mode and rated it as being significantly more fun (p < .05), but the feedback delivered by the coaching mode was subjectively perceived as being more useful (p < .01). In addition, the activity level (number of repetitions and total movement of the end effector) was significantly higher (p < .001) during coaching. However, the quality of movements was superior in gaming with a trend towards shorter movement duration (p = .074), significantly shorter travel distance (p < .001), higher movement efficiency (p < .001) and higher performance scores (p < .001). Stroke survivors also showed a trend towards higher activity levels in coaching, but with more movement quality during gaming. Finally, both training modes showed overall high acceptance.

Conclusions

Gaming led to higher enjoyment and increased quality in movement execution in healthy participants. However, we observed that game mechanics strongly determined user behavior and limited activity levels. In contrast, coaching generated higher activity levels. Hence, the purpose of treatment and profile of end-users has to be considered when deciding on the most adequate approach for home based stroke rehabilitation.

A Personalized Self-Management Rehabilitation System with an Intelligent Shoe for Stroke Survivors: A Realist Evaluation

BACKGROUND

In the United Kingdom, stroke is the most significant cause of adult disability. Stroke survivors are frequently left with physical and psychological changes that can profoundly affect their functional ability, independence, and social participation. Research suggests that long-term, intense, task- and context-specific rehabilitation that is goal-oriented and environmentally enriched improves function, independence, and quality of life after a stroke. It is recommended that rehabilitation should continue until maximum recovery has been achieved. However, the increasing demand on services and financial constraints means that needs cannot be met through traditional face-to-face delivery of rehabilitation. Using a participatory design methodology, we developed an information communication technology-enhanced Personalized Self-Managed rehabilitation System (PSMrS) for stroke survivors with integrated insole sensor technology within an "intelligent shoe.". The intervention model was based around a rehabilitation paradigm underpinned by theories of motor relearning and neuroplastic adaptation, motivational feedback, self-efficacy, and knowledge transfer.

OBJECTIVE

To understand the conditions under which this technology-based rehabilitation solution would most likely have an impact on the motor behavior of the user, what would work for whom, in what context, and how. We were interested in what aspects of the system would work best to facilitate the motor behavior change associated with self-managed rehabilitation and which user characteristics and circumstances of use could promote improved functional outcomes.

METHODS

We used a Realist Evaluation (RE) framework to evaluate the final prototype PSMrS with the assumption that the intervention consists of a series of configurations that include the Context of use, the underlying Mechanisms of change and the potential Outcomes or impacts (CMOs). We developed the CMOs from literature reviews and engagement with clinicians, users, and caregivers during a series of focus groups and home visits. These CMOs were then tested in five in-depth case studies with stroke survivors and their caregivers.

RESULTS

While two new propositions emerged, the second importantly related to the self-management aspects of the system. The study revealed that the system should also encourage independent use and the setting of personalized goals or activities.

CONCLUSIONS

Information communication technology that purports to support the self-management of stroke rehabilitation should give significant consideration to the need for motivational feedback that provides quantitative, reliable, accurate, context-specific, and culturally sensitive information about the achievement of personalized goal-based activities.

The SMART personalised self-management system for congestive heart failure: results of a realist evaluation

BACKGROUND

Technology has the potential to provide support for self-management to people with congestive heart failure (CHF). This paper describes the results of a realist evaluation of the SMART Personalised Self-Management System (PSMS) for CHF.

METHODS

The PSMS was used, at home, by seven people with CHF. Data describing system usage and usability as well as questionnaire and interview data were evaluated in terms of the context, mechanism and outcome hypotheses (CMOs) integral to realist evaluation.

RESULTS

The CHF PSMS improved heart failure related knowledge in those with low levels of knowledge at baseline, through providing information and quizzes. Furthermore, participants perceived the self-regulatory aspects of the CHF PSMS as being useful in encouraging daily walking. The CMOs were revised to describe the context of use, and how this influences both the mechanisms and the outcomes.

CONCLUSIONS

Participants with CHF engaged with the PSMS despite some technological problems. Some positive effects on knowledge were observed as well as the potential to assist with changing physical activity behaviour. Knowledge of CHF and physical activity behaviour change are important self-management targets for CHF, and this study provides evidence to direct the further development of a technology to support these targets.

Stroke patients' utilisation of extrinsic feedback from computer-based technology in the home: a multiple case study realistic evaluation

Background

Evidence indicates that post − stroke rehabilitation improves function, independence and quality of life. A key aspect of rehabilitation is the provision of appropriate information and feedback to the learner.

Advances in information and communications technology (ICT) have allowed for the development of various systems to complement stroke rehabilitation that could be used in the home setting. These systems may increase the provision of rehabilitation a stroke survivor receives and carries out, as well as providing a learning platform that facilitates long-term self-managed rehabilitation and behaviour change. This paper describes the application of an innovative evaluative methodology to explore the utilisation of feedback for post-stroke upper-limb rehabilitation in the home.

Methods

Using the principles of realistic evaluation, this study aimed to test and refine intervention theories by exploring the complex interactions of contexts, mechanisms and outcomes that arise from technology deployment in the home. Methods included focus groups followed by multi-method case studies (n = 5) before, during and after the use of computer-based equipment. Data were analysed in relation to the context-mechanism-outcome hypotheses case by case. This was followed by a synthesis of the findings to answer the question, ‘what works for whom and in what circumstances and respects?’

Results

Data analysis reveals that to achieve desired outcomes through the use of ICT, key elements of computer feedback, such as accuracy, measurability, rewarding feedback, adaptability, and knowledge of results feedback, are required to trigger the theory-driven mechanisms underpinning the intervention. In addition, the pre-existing context and the personal and environmental contexts, such as previous experience of service delivery, personal goals, trust in the technology, and social circumstances may also enable or constrain the underpinning theory-driven mechanisms.

Conclusions

Findings suggest that the theory-driven mechanisms underpinning the utilisation of feedback from computer-based technology for home-based upper-limb post-stroke rehabilitation are dependent on key elements of computer feedback and the personal and environmental context. The identification of these elements may therefore inform the development of technology; therapy education and the subsequent adoption of technology and a self-management paradigm; long-term self-managed rehabilitation; and importantly, improvements in the physical and psychosocial aspects of recovery.