mHealth technologies for osteoarthritis self-management and treatment: A systematic review

Development of the intelligent knee osteoarthritis lifestyle app: a person-based approach

BACKGROUND

Knee osteoarthritis is one of the most prevalent long term health conditions globally. Exercise and physical activity are now widely recognised to significantly reduce joint pain, improve physical function and quality of life in patients with knee osteoarthritis. However, prescribed exercise without regular contact with a healthcare professional often results in lower adherence and poorer health outcomes. Digital mobile health (mHealth) technologies offer great potential to support people with long-term conditions such as knee osteoarthritis more efficiently and effectively and with relatively lower cost than existing interventions. However, there are currently very few mHealth interventions for the self-management of knee osteoarthritis. The aim of the present study was to describe the development process of a mHealth app to extend the support for physical activity and musculoskeletal health beyond short-term, structured rehabilitation through self-management, personalised physical activity, education, and social support.

METHODS

The development of the intelligent knee osteoarthritis lifestyle application intervention involved an iterative and interconnected process comprising intervention 'planning' and 'optimisation' informed by the person-based approach framework for the development of digital health interventions. The planning phase involved a literature review and collection of qualitative data obtained from focus groups with individuals with knee osteoarthritis (n = 26) and interviews with relevant physiotherapists (n = 5) to generate 'guiding principles' for the intervention. The optimisation phase involved usability testing (n = 7) and qualitative 'think aloud' sessions (n = 6) with potential beneficiaries to refine the development of the intervention.

RESULTS

Key themes that emerged from the qualitative data included the need for educational material, modifying activities to suit individual abilities and preferences as well as the inclusion of key features such as rehabilitation exercises. Following a user-trial further changes were made to improve the usability of the application.

CONCLUSIONS

Using a systematic person-based, development approach, we have developed the intelligent knee osteoarthritis lifestyle application to help people maintain physical activity behaviour. The app extends the support for physical activity and musculoskeletal health beyond short-term, structured rehabilitation through personalised physical activity guidance, education, and social support.

Influence of the intelligent knee osteoarthritis lifestyle app (iKOALA) on knee joint pain

BACKGROUND

The intelligent knee osteoarthritis lifestyle app (iKOALA) has been co-developed with target users to extend the support for physical activity (PA) and musculoskeletal health, beyond short-term structured rehabilitation, using personalised PA guidance, education, and social support. The purpose of this study was to assess the preliminary effectiveness and usability of the iKOALA digital intervention on indices of musculoskeletal (MSK) health, symptoms, and physical activity levels in a broad range of individuals with knee osteoarthritis (KOA) over 12 weeks to inform the design of a larger randomised controlled trial.

METHODS

Thirty-eight (33 female) participants living in the UK with a mean (SD) age of 58 (± 9) years diagnosed radiographically or clinically with KOA completed a 12-week user trial of the iKOALA. Participants completed an in-app physical activity questionnaire which intelligently recommended suitable strengthening and aerobic based activities to individuals. Throughout the trial, participants wore a physical activity monitor and were given access to functions within the app (physical activity (PA) reminders, information and education, symptom and PA tracking as well as social support forums) to support them in maintaining their PA plan. Participants completed a MSK questionnaire for chronic symptoms and quality of life (MSK-HQ) as well as an acute iKOALA symptoms questionnaire (confidence, fatigue, mood, pain during the day/night, sleep and ability to walk) in the week prior to starting and following completion of the trial.

RESULTS

Physical activity levels were consistent over the 12 weeks with total daily steps of 9102 (± 3514) in week 1, 9576 (± 4214) in week 6 and 9596 (± 3694) in week 12. Group mean changes in all iKOALA MSK symptom scores and the total MSK-HQ (pre 33.1 (7.6) vs. post 40.2 (7.6)) score improved significantly (p < .001, 95% CI [-8.89, -5.16]) over the 12-week period.

CONCLUSIONS

Physical activity levels were maintained at a high level throughout the 12 weeks. Significant improvements in mean MSK symptom scores and the total MSK-HQ score were also observed. Efforts to ensure more generalised reach amongst sex and socioeconomic status of the digital intervention in a randomised controlled clinical trial are warranted.

Efficacy of a Novel Telehealth Application in Health Behavior Modification and Symptomology in Military Service Members at Risk for Post-traumatic Osteoarthritis

INTRODUCTION

Mobile applications (apps) may be beneficial to promote self-management strategies to mitigate the risk of developing post-traumatic osteoarthritis in military members following a traumatic knee injury. This study investigated the efficacy of a mobile app in facilitating behavior modification to improve function and symptomology among military members.

MATERIALS AND METHODS

This is a preliminary pre and post hoc analysis of a randomized control trial. The MARX scale, Intermittent and Constant Osteoarthritis Pain (ICOAP) questionnaire, and the Knee Injury and Osteoarthritic Outcome Score Readiness to Manage Osteoarthritis Questionnaire were completed at baseline, 6-week, 6-month, and 12-month follow-up. Participants in the treatment arm completed the System Usability Scale. Data were analyzed using descriptive statistics, the Wilcoxon sum of ranks test, the Wilcoxon signed-rank test, and Cohen's d effect size.

RESULTS

A total of 28 participants were included. Between-group differences for baseline and 6-week follow-up were significantly improved in the injured knee ICOAP constant pain score for the treatment group (treatment: -4.2 ± 12, 95% CI: -11.5, 3.1; control: 5.5 ± 9.9, 95% CI: 0.9, 10.1; P = .035, effect size = 0.905). Within-group differences for baseline and 6-week follow-up demonstrated a significant decline in the injured knee ICOAP constant pain score among the control group (signed-rank: 16.0, P = .031, Cohen's d = 0.339). No other significant differences were observed. A good System Usability Scale score for usability was found (76.6 ± 8.8).

CONCLUSIONS

These results indicate that the mobile app is easy to use and may contribute to improved constant pain symptomology for patients at risk for post-traumatic osteoarthritis.

mHealth for the Self-management of Knee Osteoarthritis: Scoping Review

BACKGROUND

Educating patients on the self-management of knee osteoarthritis (OA) reportedly reduces pain, improves activities of daily living, and even reduces health care costs.

OBJECTIVE

This scoping review will summarize the current evidence on mobile health (mHealth) and smartphone app-based disease self-management for patients with knee OA.

METHODS

PubMed, Web of Science, the Cochrane Central Register of Controlled Trials, and CINAHL were systematically searched in May 2021 using the keywords "knee osteoarthritis," "mobile health," and "self-management." Studies that investigated patients with knee OA based on radiography or clinical diagnosis were included. The following criteria were applied to the mobile phone apps included in the search-derived studies: the ability to (1) record and manage symptoms, (2) provide patient education, and (3) guide and record activities of daily living. Studies eligible for inclusion in this scoping review were interventional trials or observational studies published in English.

RESULTS

This scoping review included 8 reports, of which 3 were randomized controlled trials and 1 was a conference abstract. Most studies provided data on the outcomes of pain, physical function, and quality of life.

CONCLUSIONS

An increasing number of reports are addressing the effectiveness of mHealth in patients with knee OA, and the data suggest that mHealth efficacy is similar to conventional management of health.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.17504/protocols.io.buuxnwxn.

The use of mobile health technology in the management of osteoarthritis: A scoping review with scientometric analyses

INTRODUCTION

Although mHealth technology is an emerging approach for enabling self-management/education of hip/knee osteoarthritis (OA) that may reduce burdens in primary and secondary care, no scoping review has been conducted to comprehensively review the scope of mHealth technology in managing hip/knee OA. This scoping review and scientometric analyses aimed to summarize the current state of research on the use of mHealth technology (mobile applications/web-based interventions) for self-management/education of adults with hip/knee OA, identify key research activities, and provide future directions on the development/usage of mHealth technology.

METHODS

The Arksey and O'Malley methodological framework was employed, augmented with scientometric analyses. Six databases were searched from inception to 31 May 2021. Findings were reported according to the PRISMA extension for scoping review. Co-word, co-author, and co-citation scientometric analyses were conducted to examine the social and intellectual connections of the research field (e.g., research hotspots and researcher collaborations).

RESULTS

Twenty mHealth programs for promoting self-management of hip/knee OA were identified. The programs mainly included exercises or directives on performance of exercises. Compared to no interventions, mHealth technology was usable and might be more effective in improving pain, physical function, and quality of life in individuals with OA. The scientometric analyses identified multiple co-occurring keywords that reflected conceptual properties of this research domain. Although some intellectual connections among authors, research articles, and journals were noted, there were insufficient international collaborations in this field.

DISCUSSION

While individual small-scale studies highlighted promising short-term effects of mHealth technology in self-managing hip/knee OA, many mHealth technologies were developed without clinicians' and/or patients' contributions. Future mHealth programs should be developed based on a strong theoretical background and professional inputs. The long-term benefits and cost-effectiveness of mHealth technologies, user experience, as well as cross-cultural adaptation of these technologies should be evaluated.

Development of a mobile application to improve exercise accuracy and quality of life in knee osteoarthritis patients: a randomized controlled trial

INTRODUCTION

Knee Osteoarthritis (OA) is a degenerative joint disease that needs consistent exercise and an accurate understanding of the condition for long-term maintenance. While the accessibility of outpatient care is essential for disease management, many patients lack the resources to receive adequate healthcare. To address this challenge, we developed a not-for-profit interactive mobile application that provides a disease-specific educational background and a structured exercise regimen to patients.

MATERIAL AND METHODS

"Rak Kao" (English translation: Love-Your-Knee) mobile application was designed to analyze the questionnaire data to assess the stage of knee OA and generate a personalized recommendation of treatment and exercise type using rule-based and Artificial Intelligence (AI) techniques. A single-blinded study was conducted with patients (n = 82) who were randomly assigned to the mobile application group (M-group) and the handout group (H-group). Patient groups were controlled for age, gender, BMI, onset of pain, grade of disease, education level, and occupation. Accuracy in performance of three prescribed knee exercises (catch-bend-down, stretch-touch-feet, and sit-stretch-hold) was evaluated. Clinical outcomes were evaluated before and after the 4-weeks program to assess the range of motion, symptoms, pain, physical activity, and quality of life via the KOOS and KSS scores.

RESULTS

Completion of the study led to significantly more overall exercise accuracy in the M-group (76.2%) than the H-group (52.5%). Activities of daily life, quality of life, ability to do sports and recreational activities were significantly more improved in the M-group than the H-group (p < .01). No difference in the range of motion between groups. Satisfaction of patients' experience was higher in the M-group than the H-group (p = .001) after the 4-week regimen.

CONCLUSIONS

With the better accuracy and outcomes for rehabilitation in the M-group than the H-group, we strongly recommend using our mobile application as a better alternative than handouts for exercises and information for patients with knee OA.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT03666585.

Assessment of Mobile Health Applications for Management of Knee and/or Hip Osteoarthritis Using the Mobile Application Rating Scale

BACKGROUND

Mobile health applications (apps) can help individuals with knee and/or hip osteoarthritis (OA) learn about, monitor, and manage their condition. These apps have not been formally evaluated.

OBJECTIVE

The aim of this study was to evaluate the publicly available mobile health apps for individuals with knee and/or hip OA using a systematic review.

METHODS

We searched the Apple App Store, Android Google Play, and Amazon Appstore using the terms "arthritis," "osteoarthritis," "hip OA," "knee OA," "hip," "knee," "rehabilitation," "rehab," and "physical therapy" in December of 2021. Applications that met the inclusion/exclusion criteria were reviewed using the Mobile Application Rating Scale (MARS; 29 items across 6 sections, each rated at 1-5).

RESULTS

Among 1104 identified apps, 94 met the inclusion/exclusion criteria for MARS appraisal. Fourteen apps met the predetermined score thresholds for final summary. Of the 14 apps appraised, the total overall mean app score on the MARS ranged from 3.12 to 4.20 (mean, 3.51 ± 0.37). Although app features varied, common features were symptom tracking, exercise recommendations, education, goal setting, and improving well-being. Many apps allowed for sharing with health care providers and included some measures to protect privacy. Jointfully Osteoarthritis was the top-rated app in both the Apple App Store and Android Google Play.

CONCLUSIONS

The majority of the apps we identified for knee and/or hip OA did not meet predetermined score thresholds for final summary. Many failed to provide comprehensive education and deliver management plans and lacked scientific testing. Future research should focus on apps that fit the needs of health care providers and patients including quality information, structured exercise programs tailored to individual needs, secure communication methods, and health information protection.

Effect of a mHealth exercise intervention compared with supervised exercise therapy in osteoarthritis management: protocol of the DigiOA trial

INTRODUCTION

Soaring prevalence of hip and knee osteoarthritis (OA) inflicts high costs on the healthcare system. A further rise in the OA incidence is expected, generating increased demand of care potentially challenging accessibility and threatening to overwhelm the healthcare system. Innovative solutions that may improve accessibility to recommended OA care for patients in primary care and maintain healthcare sustainability are warranted. Digitalising home exercise therapy may be one such solution. The primary aim of this study is to evaluate the effectiveness of a mobile health app providing digitalised home exercises, compared with supervised exercise therapy in patients with OA. Second, we will evaluate the cost-efficiency of the intervention and explore potential differences in outcome and adherence to exercises in the experimental treatment group.

METHODS AND ANALYSIS

A two-armed non-inferiority randomised controlled trial will be conducted. In total, 156 patients with hip and/or knee OA will be recruited from physiotherapy clinics in primary care in Norway. Following patient education, patients will be randomised to either 6 weeks of standard treatment (2 weekly sessions of supervised exercise therapy) or experimental treatment (home exercises via the Virtual Training (VT) app). Primary outcome is the proportion of Outcome Measures in Rheumatology-Osteoarthritis Research Society International (OMERACT-OARSI) responders at 6 weeks. Secondary outcomes include physical performance, patient-reported outcomes related to pain, fatigue, disease activity, physical function, mental health, health related quality of life, self-efficacy, utilisation of healthcare services and medication, digital competence and use of apps.

ETHICS AND DISSEMINATION

Patients will sign an informed consent form before participating in the trial. Approval has been granted by the Regional Ethics Committee (201105) and Data Protection Officer at Diakonhjemmet Hospital (00221). Patient research partners will contribute in all parts of the study.

TRIAL REGISTRATION NUMBER

NCT04767854.

Development of a low resource exercise rehabilitation application for musculoskeletal disorders to help underserved patients in a primary care setting

OBJECTIVE

We set out to create a Family Medicine EHR (electronic health record) embedded exercise application. This was done to evaluate the utility of the exercise app for providers and to understand the usefulness of the exercise app from the perspective of patients.

METHODS

This exercise application was developed through an iterative process with repeated pre-testing and feedback from an interprofessional team and embedded into the EHR at an academic family medicine clinic. Anecdotal feedback from patients was used to inform pre-testing adaptations.

RESULTS

The application required six iterations prior to clinical utility. It had several features that clinicians and patients felt were beneficial. These features involved a customizable exercise directory with pre-made templated plans which could be further modified. To overcome accessibility barriers, the application was developed to include digital and printable copies with an integrated direct email option for ease of remote sharing with patients.

CONCLUSION

A customizable, open-source exercise application was developed to facilitate provider exercise prescription and support patient self-management. This project may be useful for other providers interested in developing similar programs to address musculoskeletal conditions in their patients. Next steps are to undertake pilot testing of the app with broader provider and patient feedback.

The design, development and usability testing of a smartphone-based mobile system for management of children's oral health

The aim of the study was to design and develop a mobile system for better management of children's oral health by using the internet technology. This study was followed in a three-step approach. (1) Design stage: participatory design (including patients, dentists and computer scientists) was taken in order to adapt the system to the clinical practice of dentistry; (2) Development stage: dentists and computer scientists were involved in this stage to develop the system by using internet technology; (3) Usability testing stage: the quality (MARS), usability (SUS) and satisfaction of the system were assessed by children's caregivers. The system contains patient-side app, doctor-side app and Web side program for manager. Children and their caregivers could acquire many useful services through the app, such as oral healthcare education, brushing management, dietary record, online consultation, online appointment, feedback of adverse events. The overall value of SUS was 67.75. The final quality mean score was 3.44 ± 0.95, with the highest mean score of functionality. The majority of caregivers were satisfied with the system. They expressed the system could improve the current medical services and their oral health literacy.

Evaluation of two electronic-rehabilitation programmes for persistent knee pain: protocol for a randomised feasibility trial

INTRODUCTION

Persistent, knee pain is a common cause of disability. Education and exercise treatment are advocated in all clinical guidelines; however, the increasing prevalence of persistent knee pain presents challenges for health services regarding appropriate and scalable delivery of these treatments. Digital technologies may help address this, and this trial will evaluate the feasibility and acceptability of two electronic-rehabilitation interventions: 'My Knee UK' and 'Group E-Rehab'.

METHODS AND ANALYSIS

This protocol describes a non-blinded, randomised feasibility trial with three parallel groups. The trial aims to recruit 90 participants (45 years or older) with a history of persistent knee pain consistent with a clinical diagnosis of knee osteoarthritis. Participants will be randomly assigned in a 1:1:1 allocation ratio. The 'My Knee UK' intervention arm will receive a self-directed unsupervised internet-based home exercise programme plus short message service support (targeting exercise behaviour change) for 12 weeks; the 'Group E-Rehab' intervention arm will receive group-based physiotherapist-prescribed home exercises delivered via videoconferencing accompanied by internet-interactive educational sessions for 12 weeks; the control arm will receive usual physiotherapy care or continue with their usual self-management (depending on their recruitment path). Feasibility variables, patient-reported outcomes and clinical findings measured at baseline, 3 and 9 months will be assessed and integrated with qualitative interview data from a subset of Group E-Rehab and My Knee UK participants. If considered feasible and acceptable, a definitive randomised controlled trial can be conducted to investigate the clinical effectiveness and cost-effectiveness of one or both interventions with a view to implementation in routine care.

ETHICS AND DISSEMINATION

The trial was approved by the West of Scotland Research Ethics Committee 5 (Reference: 20/WS/0006). The results of the study will be disseminated to study participants, the study grant funder and will be submitted for publication in peer-reviewed journals.

TRIAL REGISTRATION NUMBER

ISRCTN15564385.

The Quality of Health Apps and Their Potential to Promote Behavior Change in Patients With a Chronic Condition or Multimorbidity: Systematic Search in App Store and Google Play

Background

Mobile apps offer an opportunity to improve the lifestyle of patients with chronic conditions or multimorbidity. However, for apps to be recommended in clinical practice, their quality and potential for promoting behavior change must be considered.

Objective

We aimed to investigate the quality of health apps for patients with a chronic condition or multimorbidity (defined as 2 or more chronic conditions) and their potential for promoting behavior change.

Methods

We followed the Cochrane Handbook guidelines to conduct and report this study. A systematic search of apps available in English or Danish on App Store (Apple Inc) and Google Play (Google LLC) for patients with 1 or more of the following common and disabling conditions was conducted: osteoarthritis, heart conditions (heart failure and ischemic heart disease), hypertension, type 2 diabetes mellitus, depression, and chronic obstructive pulmonary disease. For the search strategy, keywords related to these conditions were combined. One author screened the titles and content of the identified apps. Subsequently, 3 authors independently downloaded the apps onto a smartphone and assessed the quality of the apps and their potential for promoting behavior change by using the Mobile App Rating Scale (MARS; number of items: 23; score: range 0-5 [higher is better]) and the App Behavior Change Scale (ABACUS; number of items: 21; score: range 0-21 [higher is better]), respectively. We included the five highest-rated apps and the five most downloaded apps but only assessed free content for their quality and potential for promoting behavior change.

Results

We screened 453 apps and ultimately included 60. Of the 60 apps, 35 (58%) were available in both App Store and Google Play. The overall average quality score of the apps was 3.48 (SD 0.28) on the MARS, and their overall average score for their potential to promote behavior change was 8.07 (SD 2.30) on the ABACUS. Apps for depression and apps for patients with multimorbidity tended to have higher overall MARS and ABACUS scores, respectively. The most common app features for supporting behavior change were the self-monitoring of physiological parameters (eg, blood pressure monitoring; apps: 38/60, 63%), weight and diet (apps: 25/60, 42%), or physical activity (apps: 22/60, 37%) and stress management (apps: 22/60, 37%). Only 8 out of the 60 apps (13%) were completely free.

Conclusions

Apps for patients with a chronic condition or multimorbidity appear to be of acceptable quality but have low to moderate potential for promoting behavior change. Our results provide a useful overview for patients and clinicians who would like to use apps for managing chronic conditions and indicate the need to improve health apps in terms of their quality and potential for promoting behavior change.

Adherence, Efficacy, and Safety of Wearable Technology-Assisted Combined Home-Based Exercise in Chinese Patients With Ankylosing Spondylitis: Randomized Pilot Controlled Clinical Trial

Background

Clinical practice guidelines recommend that exercise is essential in the self-management of ankylosing spondylitis (AS). Attending supervised interventions requiring periodic medical center visits can be difficult and patients may decline participation, whereas effective home-based exercise interventions that do not require regular medical center visits are likely to be more accessible for AS patients.

Objective

The goal of the research was to investigate the adherence, efficacy, and safety of a wearable technology–assisted combined home-based exercise program in AS.

Methods

This was a 16-week investigator-initiated, assessor-blinded, randomized, pilot controlled trial conducted at Chinese People’s Liberation Army General Hospital. We enrolled patients with AS who had no regular exercise habits and had been stable in drug treatment for the preceding month. Patients were randomly assigned (1:1) using a computer algorithm. An exercise program consisting of moderate-intensity aerobic exercise and functional exercise was given to the patients in the intervention group. The exercise intensity was controlled by a Mio FUSE Heart Rate Monitor wristband, which uses photoplethysmography to measure heart rate. Patients in the control group received usual care. The primary outcome was the difference in the Ankylosing Spondylitis Disease Activity Score (ASDAS). The secondary outcomes were patient global assessment (PGA), physician global assessment (PhGA), total pain, nocturnal pain, Bath Ankylosing Spondylitis Disease Activity Index (BASDAI), BAS Functional Index (BASFI), BAS Metrology Index (BASMI), Spondyloarthritis International Society Health Index (ASAS HI), 36-item Short Form Survey (SF-36), maximal oxygen uptake (VO₂) max, body composition, range of motion of joints, and muscle endurance tests. Retention rate, adherence rate, barriers to being active, and adverse events were also assessed.

Results

A total of 77 patients were screened, of whom 55 (71%) patients were enrolled; 2% (1/55) withdrew without treatment after randomization. Patients were assigned to the intervention (n=26) or control group (n=28). The median adherence rate of the prescribed exercise protocol was 84.2% (IQR 48.7%-97.9%). For the primary outcome, between-group difference of ASDAS was significant, favoring the intervention (–0.2, 95% CI –0.4 to 0.02, P=.03). For the secondary outcomes, significant between-group differences at 16 weeks were detected in PGA, PhGA, total pain, BASDAI, BASDAI-fatigue, BASDAI–spinal pain, BASDAI–morning stiffness intensity, BASFI, and BASMI. Moreover, the frequency of difficulty in ASAS HI-motivation at 16 weeks was less in the intervention group (P=.03). Between-group difference for change from baseline were also detected in VO₂ max, SF-36, back extensor endurance test, and the range of motion of cervical lateral flexion at 16 weeks. Lack of time, energy, and willpower were the most distinct barriers to being active. Incidences of adverse events were similar between groups (P=.11).

Conclusions

Our pilot study suggests that this technology-assisted combined home-based exercise program can improve the clinical outcomes of patients with AS who have no exercise habit, with good adherence and safety profile.

Trial Registration

Chinese Clinical Trial Registry ChiCTR1900024244; http://www.chictr.org.cn/showproj.aspx?proj=40176

Patients' Use of Mobile Health for Self-management of Knee Osteoarthritis: Results of a 6-Week Pilot Study

Background

In a previous study, a prototype mobile health (mHealth) app was co-designed with patients, family physicians, and researchers to enhance self-management and optimize conservative management for patients with mild to moderate knee osteoarthritis (OA).

Objective

This study aims to evaluate the overall usability, quality, and effectiveness of the mHealth app prototype for aiding knee OA self-management from the perspectives of patients with OA and health care providers (HCPs).

Methods

Using methods triangulation of qualitative and quantitative data, we conducted a pilot evaluation of an mHealth app prototype that was codeveloped with patients and HCPs. We recruited adult patients aged ≥20 years with early knee OA (n=18) who experienced knee pain on most days of the month at any time in the past and HCPs (n=7) to participate. In the qualitative assessment, patient and HCP perspectives were elicited on the likeability and usefulness of app features and functionalities and the perceived impact of the app on patient-HCP communication. The quantitative assessment involved evaluating the app using usability, quality, and effectiveness metrics. Patient baseline assessments included a semistructured interview and survey to gather demographics and assess the quality of life (European Quality-of-Life 5-Dimension 5-Level Questionnaire [EQ-5D-5L]) and patient activation (patient activation measure [PAM]). Following the 6-week usability trial period, a follow-up survey assessed patients’ perceptions of app usability and quality and longitudinal changes in quality of life and patient activation. Semistructured interviews and surveys were also conducted with HCPs (n=7) at baseline to evaluate the usability and quality of the app prototype.

Results

Interviews with patients and HCPs revealed overall positive impressions of the app prototype features and functionalities related to likeability and usefulness. Between the baseline and follow-up patient assessments, the mean EQ-5D-5L scores improved from 0.77 to 0.67 (P=.04), and PAM scores increased from 80.4 to 87.9 (P=.01). Following the 6-week evaluation, patients reported a mean System Usability Scale (SUS) score of 57.8, indicating marginal acceptability according to SUS cutoffs. The mean number of goals set during the usability period was 2.47 (SD 3.08), and the mean number of activities completed for knee OA self-management during the study period was 22.2 (SD 17.8). Spearman rank correlation (r_s) calculations revealed that the follow-up PAM scores were weakly correlated (r_s=−0.32) with the number of goals achieved and the number (r_s=0.19) of activities performed during the 6-week usability period. HCPs reported a mean SUS score of 39.1, indicating unacceptable usability.

Conclusions

This evidence-based and patient-centered app prototype represents a potential use of mHealth for improving outcomes and enhancing conservative care by promoting patient activation and patient-HCP communication regarding OA management. However, future iterations of the app prototype are required to address the limitations related to usability and quality.

A feature-oriented analysis of developers' descriptions and user reviews of top mHealth applications for diabetes and hypertension

BACKGROUND AND OBJECTIVE

Diabetes and hypertension are two prevalent and related chronic conditions. To inform the design and development of mobile health applications (mHealth apps) for people living with multiple chronic conditions, this paper examines features mentioned in developers' descriptions and user reviews of mHealth apps, along with users' attitudes toward associated features.

MATERIALS AND METHODS

Eleven top apps for diabetes and hypertension were identified from Google Play as of January 2020. Based on a stratified sampling strategy, 1,100 user reviews were selected to form the final dataset. Developers' descriptions were also collected for analysis. Using the grounded theory approach, we developed a feature-oriented coding scheme, which was used to identify three levels of features mentioned in app descriptions and user reviews: feature group (the highest level), feature type (the second level), and individual feature (the lowest level). Users' attitudes toward app features mentioned in user reviews were also analyzed.

RESULTS

Most top-rated apps for diabetes and hypertension under study were multifeatured, incorporating self-management, information sharing, and decision support features. At the feature-group level, most informative user reviews commented on features related to self-management, followed by decision support and information sharing. The four most frequently mentioned feature types were data entry, data export/import, data visualization, and assessment. Users expressed overwhelming positive attitudes toward app features across all feature categories. Based on users' assessments of existing features and requests for additional features, design implications for app development are provided.

CONCLUSIONS

Despite the diversity of app features provided by mHealth apps and users' primarily positive attitudes toward existing app features, more comprehensive and personalized features are expected by app users to satisfy their health needs. Beyond identifying app features in user reviews, future research may seek more in-depth feedback from real-life patients for app development and design using methods like interviews and focus groups, to further enhance the overall quality of relevant mHealth apps to better support users.

The Telemedicine-Based Pediatric Examination of the Back and Lower Limbs: A Narrative Review

The COVID-19 pandemic has accelerated the transition to virtual healthcare while also prompting an abundance of new literature highlighting telemedicine's capabilities and limitations for various medical applications, notably musculoskeletal examinations. Telemedicine provides an opportunity to deliver timely patient- and family-centred care while maintaining physical distancing and improving access to remote communities. This review aims to narrate the current state of the literature on telemedicine applied in the context of a musculoskeletal examination for children aged 3 to 18 years. The PubMed and ScienceDirect databases were searched for relevant articles from January 2015 to August 2021 using a combination of keywords and nested searches. The general examination components relevant to the back and lumbosacral spine, hip, knee, ankle/foot, and gait are described. These components include inspection, palpation, range of motion, motor, and sensory examination as well as special testing. There is general feasibility, validity, and substantial reliability in performing most examination components, and primary diagnoses established virtually were found to be either the same or similar in the vast majority of cases. Despite the current literature focusing mainly on adult populations, we describe how each aspect of the exam can be reliably incorporated into a virtual appointment specific to the pediatric population. Currently available smartphone-based applications that measure joint range of motion were generally found to have high reliability and validity. Caregivers are needed for most of the consultation, especially in younger children, but select physical exam maneuvers can be self-performed by older children and adolescents alone. By providing an overview of the available smartphone tools as well as the reliability and validity of remote assessments, this review not only establishes a foundation for a structured pediatric musculoskeletal examination, but also aims to increase providers' confidence in incorporating telemedicine into their practice.

Applications of Digital Health Technologies in Knee Osteoarthritis: A Narrative Review (Preprint)

Background

With the increasing adoption of high-speed internet and mobile technologies by older adults, digital health is a promising modality to enhance clinical care for people with knee osteoarthritis (KOA), including those with knee replacement (KR).

Objective

This study aimed to summarize the current use, cost-effectiveness, and patient and clinician perspectives of digital health for intervention delivery in KOA and KR.

Methods

In this narrative review, search terms such as mobile health, smartphone, mobile application, mobile technology, ehealth, text message, internet, knee osteoarthritis, total knee arthroplasty, and knee replacement were used in the PubMed and Embase databases between October 2018 and February 2021. The search was limited to original articles published in the English language within the past 10 years. In total, 91 studies were included.

Results

Digital health technologies such as websites, mobile apps, telephone calls, SMS text messaging, social media, videoconferencing, and custom multi-technology systems have been used to deliver interventions in KOA and KR populations. Overall, there was significant heterogeneity in the types and applications of digital health used in these populations. Digital patient education improved disease-related knowledge, especially when used as an adjunct to traditional methods of patient education for both KOA and KR. Digital health that incorporated person-specific motivational messages, biofeedback, or patient monitoring was more successful at improving physical activity than self-directed digital interventions for both KOA and KR. Many digital exercise interventions were found to be as effective as in-person physical therapy for people with KOA. Many digital exercise interventions for KR incorporated both in-person and web-based treatments (blended format), communication with clinicians, and multi-technology systems and were successful in improving knee range of motion and self-reported symptoms and reducing the length of hospital stays. All digital interventions that incorporated cognitive behavioral therapy or similar psychological interventions showed significant improvements in knee pain, function, and psychological health when compared with no treatment or traditional treatments for both KOA and KR. Although limited in number, studies have indicated that digital health may be cost-effective for these populations, especially when travel costs are considered. Finally, although patients with KOA and KR and clinicians had positive views on digital health, concerns related to privacy and security and concerns related to logistics and training were raised by patients and clinicians, respectively.

Conclusions

For people with KOA and KR, many studies found digital health to be as effective as traditional treatments for patient education, physical activity, and exercise interventions. All digital interventions that incorporated cognitive behavioral therapy or similar psychological treatments were reported to result in significant improvements in patients with KOA and KR when compared with no treatment or traditional treatments. Overall, technologies that were blended and incorporated communication with clinicians, as well as biofeedback or patient monitoring, showed favorable outcomes.

Electronic patient-reported outcome measures using mobile health technology in rheumatology: A scoping review

OBJECTIVE

This scoping review aims to characterize the current literature on electronic patient-reported outcome measures (ePROMs) in rheumatology and assess the feasibility and utility of ePROMs and mobile health technology in the management of rheumatic disease.

INTRODUCTION

Patient-reported outcome measures (PROMs) are commonly used in rheumatology as they are important markers of disease activity and overall function, encourage shared decision-making, and are associated with high rates of patient satisfaction. With the widespread use of mobile devices, there is increasing interest in the use of mobile health technology to collect electronic PROMs (ePROM).

INCLUSION CRITERIA

All primary studies that involve the collection of ePROMs using mobile devices by individuals with a rheumatic disease were included. Articles were excluded if ePROMs were measured during clinic appointments.

METHODS

A scoping review was performed using Medline, Embase, PsycINFO, and CINAHL with index terms and key words related to "patient-reported outcome measures", "rheumatic diseases", and "mobile health technology".

RESULTS

A total of 462 records were identified after duplicates were removed. Of the 70 studies selected for review, 43% were conference proceedings and 57% were journal articles, with the majority published in 2016 or later. Inflammatory arthritis was the most common rheumatic disease studied. Generic ePROMs were used over three times more often than disease-specific ePROMs. A total of 39 (56%) studies directly evaluated the feasibility of ePROMs in clinical practice, 19 (27%) were clinical trials that used ePROMs as study endpoints, 9 (13%) were focus groups or surveys on smartphone application development, and 3 (4%) did not fit into one defined category.

CONCLUSION

The use of ePROMs in rheumatology is a growing area of research and shows significant utility in clinical practice, particularly in inflammatory arthritis. Further research is needed to better characterize the feasibility of ePROMs in rheumatology and their impact on patient outcomes.

A systematic review of mobile health technologies to support self-management of concurrent diabetes and hypertension

OBJECTIVE

This article reports results from a systematic literature review of the current state of mobile health (mHealth) technologies that have the potential to support self-management for people with diabetes and hypertension. The review aims to (a) characterize mHealth technologies used or described in the mHealth literature and (b) summarize their effects on self-management for people with diabetes and hypertension from the clinical and technical standpoints.

MATERIALS AND METHODS

A systematic literature review was conducted following PRISMA guidelines. Online databases were searched in September 2018 to identify eligible studies for review that had been published since 2007, the start of the smartphone era. Data were extracted from included studies based on the PICOS framework.

RESULTS

Of the 11 studies included for in-depth review, 5 were clinical research examining patient health outcomes and 6 were technology-focused studies examining users' experiences with mHealth technologies under development. The most frequently used mHealth technology features involved self-management support (n = 11) followed by decision support (n = 6) and shared decision-making (n = 6). Most clinical studies reported benefits associated with mHealth interventions. These included reported improvements in objectively measured patient health outcomes (n = 3) and perceptual or behavioral outcomes (n = 4).

DISCUSSION

Although most studies reported promising results in terms of the effects of mHealth interventions on patient health outcomes and experience, the strength of evidence was limited by the study designs.

CONCLUSION

More randomized clinical trials are needed to examine the promise and limitations of mHealth technologies as assistive tools to facilitate the self-management of highly prevalent comorbidity of chronic conditions, such as diabetes and hypertension.

Effects of technology-supported exercise programs on the knee pain, physical function, and quality of life of individuals with knee osteoarthritis and/or chronic knee pain: A systematic review and meta-analysis of randomized controlled trials

OBJECTIVE

The study sought to examine the effects of technology-supported exercise programs on the knee pain, physical function, and quality of life of individuals with knee osteoarthritis and/or chronic knee pain by a systematic review and meta-analysis of randomized controlled trials.

MATERIALS AND METHODS

We searched MEDLINE, EMBASE, CINAHL Plus, and the Cochrane Library from database inception to August 2020. A meta-analysis and subgroup analyses, stratified by technology type and program feature, were conducted.

RESULTS

Twelve randomized controlled trials were reviewed, all of which implemented the programs for 4 weeks to 6 months. Telephone, Web, mobile app, computer, and virtual reality were used to deliver the programs. The meta-analysis showed that these programs were associated with significant improvements in knee pain (standardized mean difference [SMD] = -0.29; 95% confidence interval [CI], -0.48 to -0.10; P = .003) and quality of life (SMD = 0.25; 95% CI, 0.04 to 0.46; P = .02) but not with significant improvement in physical function (SMD = 0.22; 95% CI, 0 to 0.43; P = .053). Subgroup analyses showed that some technology types and program features were suggestive of potential benefits.

CONCLUSIONS

Using technology to deliver the exercise programs appears to offer benefits. The technology types and program features that were associated with health values have been identified, based on which suggestions are discussed for the further research and development of such programs.

Mobile health technologies for the management of rheumatic diseases: a systematic review of online stores in Brazil

Rheumatic diseases are serious conditions with a low uptake of conservative treatments. Mobile health (mHealth) applications (apps) offer potential to assist the self-management of rheumatic diseases. Our goal was to perform a systematic review of available mHealth apps for rheumatic diseases in Brazil. We focused on the most prevalent rheumatic diseases: osteoarthritis, rheumatoid arthritis, fibromyalgia, systemic lupus erythematosus, osteoporosis, and axial spondylarthritis. Google Play Store and AppStore in Brazil were queried by two independent reviewers on September 2020, and the quality of eligible mHealth apps was assessed using the Mobile App Rating Scale (MARS). Of the 3173 mHealth apps found, five were eligible for inclusion. Two for fibromyalgia and two for axial spondylarthritis offered exercise, educational content, and tools to track patient-reported symptoms; and one for osteoporosis offered educational content and tracking tools only. The included apps scored moderately on the MARS quality scale, with a mean score (SD) of 3.1 (0.7) on a 0-5 scale. Most apps scored poorly based on credibility, user interface and experience, and engagement. There is growing interest in the development of mHealth technologies to support rheumatic diseases patients. Although the majority of the included apps came from non-profit organizations, they are still of poor quality and limited functionality. This study is a call for to the development of new user-centered mHealth apps that can empower rheumatic diseases patients in Brazil, especially in the area of osteoarthritis, rheumatoid arthritis, and lupus, since no apps were found.

Parental-oriented educational mobile messages to aid in the control of early childhood caries in low socioeconomic children: A randomized controlled trial

•

Educational mobile text messages were effective to control the severity of ECC.

•

They influenced changes in parental reports about children’s sugar consumption.

•

Also, they seemed beneficial to improve parental electronic health literacy levels.

Objectives

To evaluate the effectiveness of educational messages as an aid in the control of early childhood caries (ECC) in low socioeconomic children.

Methods

A single-blinded, randomized, and parallel-group study was conducted with 104 dyads of parents and children aged between 36–60 months, recruited in preschools from Bauru, Brazil. The participants were randomly allocated into control and intervention groups (1:1), stratified by parental eHealth literacy scores (eHEALS) and children's caries experience. Every 2 weeks, text messages were sent to parents of intervention group via WhatsApp. Visible plaque index (VPI) and the International Caries Detection and Assessment System (ICDAS) were assessed at baseline, 3- and 6-month follow-ups, while eHEALS and dietary habits were determined at baseline and 6-month follow-up. Statistical analysis was performed to intra and intergroup comparisons through Fischer’s exact and McNemar tests, and Mann-Whitney U and Friedman tests, respectively (P < 0.05).

Results

Despite similarities between groups, intervention increased parental eHEALS scores, influencing the reports about the children’s consumption of sugar-free sweets and controlling the severity of ECC.

Conclusion

Therefore, mobile text messages were effective to control the severity of ECC in low socioeconomic preschoolers, improving parental eHealth literacy and changing children’s dietary patterns.

Clinical significance

These findings demonstrate that parental-oriented WhatsApp messages can contribute to oral health education of socioeconomic vulnerable parents towards risk behavior changes to control ECC.

Co-Design in the Development of a Mobile Health App for the Management of Knee Osteoarthritis by Patients and Physicians: Qualitative Study

BACKGROUND

Despite a doubling of osteoarthritis-targeted mobile health (mHealth) apps and high user interest and demand for health apps, their impact on patients, patient outcomes, and providers has not met expectations. Most health and medical apps fail to retain users longer than 90 days, and their potential for facilitating disease management, data sharing, and patient-provider communication is untapped. An important, recurrent criticism of app technology development is low user integration design. User integration ensures user needs, desires, functional requirements, and app aesthetics are responsive and reflect target user preferences.

OBJECTIVE

This study aims to describe the co-design process for developing a knee osteoarthritis minimum viable product (MVP) mHealth app with patients, family physicians, and researchers that facilitates guided, evidence-based self-management and patient-physician communication.

METHODS

Our qualitative co-design approach involved focus groups, prioritization activities, and a pre-post quality and satisfaction Kano survey. Study participants included family physicians, patient researchers and patients with knee osteoarthritis (including previous participants of related collaborative research), researchers, key stakeholders, and industry partners. The study setting was an academic health center in Southern Alberta.

RESULTS

Distinct differences exist between what patients, physicians, and researchers perceive are the most important, convenient, desirable, and actionable app functional requirements. Despite differences, study participants agreed that the MVP should be electronic, should track patient symptoms and activities, and include features customized for patient- and physician-identified factors and international guideline-based self-management strategies. Through the research process, participants negotiated consensus on their respective priority functional requirements. The highest priorities were a visual symptom graph, setting goals, exercise planning and daily tracking, and self-management strategies. The structured co-design with patients, physicians, and researchers established multiple collaborative processes, grounded in shared concepts, language, power, rationale, mutual learning, and respect for diversity and differing opinions. These shared team principles fostered an open and inclusive environment that allowed for effective conceptualization, negotiation, and group reflection, aided by the provision of tangible and ongoing support throughout the research process, which encouraged team members to question conventional thinking. Group-, subgroup-, and individual-level data helped the team reveal how and for whom perspectives about individual functional requirements changed or remained stable over the course of the study. This provided valuable insight into how and why consensus emerged, despite the presence of multiple and differing underlying rationales for functional requirement prioritization.

CONCLUSIONS

It is feasible to preserve the diversity of perspectives while negotiating a consensus on the core functional requirements of an mHealth prototype app for knee osteoarthritis management. Our study sample was purposely constructed to facilitate high co-design interactivity. This study revealed important differences between the patient, physician, and researcher preferences for functional requirements of an mHealth app that did not preclude the development of consensus.

Rehabilitation protocol with or without mobile health in overweight and obese knee osteoarthritis patients - a pilot study

Knee osteoarthritis (OA) is a degenerative and weight bearing joint disease that resulted from wear and tear of articular cartilage. It is more common in the overweight and obese knee OA patients. The objectives of pilot study were to assess the feasibility, acceptability and challenges of study design, study setting and tools of lower limb rehabilitation protocol among the knee OA patients who are overweight and obese. Twelve overweight and obese knee OA patients attending a Teaching Bay in the Pakistan were enrolled in the study and completed 6 training sessions over 2 weeks. The participants were divided randomly into Intervention Group with Mobile Health (IGW-mH), Intervention Group without Mobile Health (IGWO-mH) and the Control Group (CG). Both intervention groups were provided fifteen days of lower limb rehabilitation protocol but the CG did not. Two text messages per day for three days a week were sent to IGW-mH as a reminder to carry on their training session and instructions of daily care. All participants of intervention groups showed willingness to randomization and adherence to training sessions. The results indicated that eligibility criteria, recruitment rate and randomization procedures were feasible and there were no adverse events from training sessions. The participants demanded Urdu translation and pictures of lower limb rehabilitation protocol. Key words: mobile health technology, overweight, knee, osteoarthritis,

Qualitative study to elicit patients' and primary care physicians' perspectives on the use of a self-management mobile health application for knee osteoarthritis

OBJECTIVE

To elicit perspectives of family physicians and patients with knee osteoarthritis (KOA) on KOA, its treatment/management and the use of a mobile health application (app) to help patients self-manage their KOA.

DESIGN

A qualitative study using Cognitive Task Analysis for physician interviews and peer-to-peer semistructured interviews for patients according to the Patient and Community Engagement Research (PaCER) method.

SETTING

Primary care practices and patient researchers at an academic centre in Southern Alberta.

PARTICIPANTS

Intentional sampling of family physicians (n=4; 75% women) and patients with KOA who had taken part in previous PaCER studies and had experienced knee pain on most days of the month at any time in the past (n=5; 60% women).

RESULTS

Physician and patient views about KOA were starkly contrasting. Patient participants expressed that KOA seriously impacted their lives and lifestyles, and they wanted their knee pain to be considered as important as other health problems. In contrast, physicians uniformly conceptualised KOA as a relatively minor health problem, although they still recognised it as a painful condition that often limits patients' activities. Consequently, physicians did not regard KOA as a condition to be proactively and aggressively managed. The gap between physicians' and patients' conceptualisation of KOA and its treatment extended to the use of an app for self-management. While patients were supportive of the app, physicians were sceptical of its use and focused more on accountability and patient resources.

CONCLUSIONS

The clear discord between physicians' mental models and patients' lived experience and perceived needs around KOA emphasised a gap in understanding and communication about treatment and management of KOA. As such, this preliminary and formative research will inform a codesign approach to develop an app that will act as a communications tool between patients and physicians, enabling patient-physician discussions regarding modifiable self-management options based on a patient's perspectives and needs.

Help at hand: Women's experiences of using a mobile health application upon diagnosis of asymptomatic osteoporosis

Objectives

This study aims to test a mobile health application (mHealth app) developed to meet the needs of women newly diagnosed with asymptomatic osteoporosis. We investigate how the women experience using an mHealth app upon diagnosis of osteoporosis and whether the app can help them to be prepared for treatment decision-making and support them in osteoporosis self-management. We also tested the usability of the app, to find out whether any adjustments were necessary prior to implementation.

Methods

A test was conducted at a Danish university hospital with 18 women aged 50-65, newly diagnosed with asymptomatic osteoporosis. On presenting for a bone density scan at the hospital, they were provided with the app, which was named 'My Osteoporosis Journey'. Data were collected through semi-structured interviews. Giorgi's descriptive phenomenological method guided the data analysis in four steps.

Findings

In total, 17 women succeeded in downloading the app, thereby accessing information on asymptomatic osteoporosis, their bone density scan results and treatment recommendations prior to visiting their general practitioner. Three overall themes were identified. Women experienced that the app (1) gave a feeling of confidence and reassurance, (2) prepared the women on treatment decision-making in the general practitioner visit and (3) provided help at hand in self-management of osteoporosis.

Conclusion

Our findings show that the mHealth app helps women to feel confident and reassured upon diagnosis of asymptomatic osteoporosis. The women felt that the app promoted an equal dialogue in the osteoporosis consultation since they felt prepared for visiting their general practitioner and were able to articulate their individual needs regarding treatment. After diagnosis, the women felt that the app provided support in self-management, right at their fingertips.

Gaps in appropriate use of treatment strategies in osteoarthritis

Optimal management of osteoarthritis (OA) requires a combination of therapies, with behavioral (e.g., exercise and weight management) and rehabilitative components at the core, accompanied by pharmacological treatments and, in later stages, consideration of joint replacement surgery. Although multiple sets of OA treatment guidelines have been developed, there are gaps in the implementation of these recommendations. Key areas of concern include the underuse of exercise, weight management, and other behavioral and rehabilitation strategies as well as the overuse of opioid analgesics. In this review, we describe the major categories of treatment strategies for OA, including self-management, physical activity, weight management, physical therapy and other rehabilitative therapies, pharmacotherapies, and joint replacement surgery. For each category, we discuss the current evidence base to report on appropriate use, data regarding adherence to treatment recommendations, and potential approaches to optimize use.

Implementing Systematically Collected User Feedback to Increase User Retention in a Mobile App for Self-Management of Low Back Pain: Retrospective Cohort Study

BACKGROUND

Promising first results for Kaia, a mobile app digitalizing multidisciplinary rehabilitation for low back pain, were recently published. It remains unclear whether the implementation of user feedback in an updated version of this app leads to desired effects in terms of increased app usage and clinical outcomes.

OBJECTIVE

The aim is to elucidate the effect on user retention and clinical outcomes of an updated version of the Kaia app where user feedback was included during development.

METHODS

User feedback of the initial app versions (0.x) was collected in a quality management system and systematically analyzed to define requirements of a new version. For this study, the anonymized data of Kaia users was analyzed retrospectively and users were grouped depending on the available version at the time of the sign-up (0.x vs 1.x). The effect on the duration of activity of users in the app, the number of completed exercises of each type, and user-reported pain levels were compared.

RESULTS

Overall, data of 1251 users fulfilled the inclusion criteria, of which 196 users signed up using version 0.x and 1055 users signed up with version 1.x. There were significant differences in the demographic parameters for both groups. A log-rank test showed no significant differences for the duration of activity in the app between groups (P=.31). Users signing up during availability of the 1.x version completed significantly more exercises of each type in the app (physical exercises: 0.x mean 1.99, SD 1.61 units/week vs 1.x mean 3.15, SD1.72 units/week; P<.001; mindfulness exercises: 0.x mean 1.36, SD 1.43 units/week vs 1.x mean 2.42, SD 1.82 units/week; P<.001; educational content: 0.x mean 1.51, SD 1.42 units/week vs 1.x mean 2.71, SD 1.89 units/week; P<.001). This translated into a stronger decrease in user-reported pain levels in versions 1.x (F1,1233=7.084, P=.008).

CONCLUSIONS

Despite the limitations of retrospective cohort studies, this study indicates that the implementation of systematically collected user feedback during development of updated versions can contribute to improvements in terms of frequency of use and potentially even clinical endpoints such as pain level. The clinical efficiency of the Kaia app needs to be validated in prospective controlled trials to exclude bias.