User-Centered Development of a Mobile App for Biopsychosocial Pain Assessment in Adults: Usability, Reliability, and Validity Study

PaiNEd app. Assessing central sensitization in survivors of breast cancer: A reliability study

Introduction

Pain is a common adverse event in survivors of breast cancer (sBCs). As there is no gold standard to assess pain experience predominantly related to central sensitization (CS) symptoms, we designed the PaiNEd app, which includes an algorithm to report whether patients are under predominant CS pain mechanisms.

Objective

We aimed to assess the reliability of the PaiNEd app to estimate whether sBC pain experience is predominantly related to CS symptoms.

Methods

An observational, descriptive reliability design was employed to assess the inter- and intrarater reliability of the PaiNEd app. This app includes an algorithm that considers the number of painful body parts and some questionnaires related to pain, such as the Numeric Pain-Rating Scale, the Brief Pain Inventory, the Tampa Scale for Kinesiophobia, the Pain Catastrophizing Scale, and the Central Sensitization Inventory (CSI).

Results

A total of 21 sBCs with persistent pain were recruited. We observe a general trend of close agreement between the paper-based and app-based formats (ICCs ranged between 0.802 and 0.972; Cronbach's alpha ranged between 0.797 and 0.971). Test-retest reliabilities were moderate to excellent (ICCs ranged between 0.510 and 0.941; Cronbach's alpha ranged between 0.499 and 0.938). The agreement between the categorization of the CS algorithm and the CSI (cut-off point ≥ 40 for CS symptoms) was 95.24%.

Conclusion

The PaiNEd app emerges as a robust tool for evaluating pain experience predominantly related to CS and pain-related symptoms in sBCs. Its demonstrated reliability not only bolsters its utility but also signifies its potential as a valuable asset for healthcare professionals engaged in pain education programs.

Usability of a mobile application for the clinical follow-up of patients with chronic obstructive pulmonary disease and home oxygen therapy

BACKGROUND

Technological health tools (e-Health) may potentially facilitate the treatment of patients with chronic diseases through development of self-management and -care skills in patients and caregivers. However, these tools are usually marketed without prior analysis and without providing any context to final users, which frequently results in low adherence to their use.

PURPOSE

To determine the usability of and satisfaction toward a mobile app for the clinical monitoring of patients with chronic obstructive pulmonary disease (COPD) receiving oxygen therapy at home.

METHODS

This was a participative-qualitative study focused on final users-with direct intervention by patients and professionals-consisting of three phases as follows: (i) medium-fidelity mockups design, (ii) development of a usability test for each user profile, and (iii) assessment of the satisfaction level regarding the usability of the mobile app. A sample was established and selected through non-probability convenience sampling and was divided into two groups as follows: healthcare professionals (n = 13) and patients (n = 7). Each participant received a smartphone with mockup designs. The "think-aloud" method was applied in the usability test. Participants were audio recorded and the anonymous transcriptions were analyzed, highlighting fragments about mockups characteristics and the usability test. The difficulty level of the tasks was assessed with a scale from 1 (very easy) to 5 (too difficult), and task non-completion was considered a critical mistake. The satisfaction level related to test usability was assessed with a 4-score Likert scale ranging from 4 (totally agree) to 1 (totally disagree).

RESULTS

Regarding the difficulty level, >60% of professionals described most tasks as "very easy" and 70% of patients as "easy." No participant made critical mistakes and both groups reported a high satisfaction level regarding the usability variables. The patient and professionals group required 18 and 11 min to complete all tasks, respectively.

CONCLUSIONS

Participants described the app as intuitive and easy to use. The usability satisfaction results show a high level of satisfaction for both groups. This positive assessment and performance in user tests showed that the mobile application was able to be apprehended and used by participants in the circumstances of use in the usability tests. Usability evaluation through satisfaction surveys and qualitative data analysis allows for greater insight into the use of mobile applications in healthcare.

Toward a digital citizen lab for capturing data about alternative ways of self-managing chronic pain: An attitudinal user study

Background

Myriad psychosocial and cultural factors influence personal ways of coping with chronic pain (CP). Mobile health (mHealth) apps facilitate creation of citizen laboratories outside clinical frameworks. However, issues of safety, privacy and technostress must be addressed. This attitudinal user study aimed to assess whether persons with persistent pain (PwPP) would be open to sharing qualitative and quantitative data about their self-management of CP via mHealth platforms.

Methods

In March 2020, we invited PwPPs, their personal or medical caregivers, or those interested in the development of an app for researching alternative ways of self-managing CP to complete an anonymous survey. We formulated an attitudinal survey within the theoretical framework of stress to estimate whether the novelty, unpredictability, and risks of data-sharing via mHealth apps concerned users. Descriptive statistics (% Part/Group) were used to interpret the survey, and open comments were reflectively analyzed to identify emerging themes.

Results

Of 202 responses (June 2021), 127 identified as PwPPs (average age 43.86 ± 14.97; 100/127 female), and listed several primary and secondary CP diagnoses. In almost 90% of PwPPs, physical and emotional wellbeing were affected by CP. More than 90% of PwPPs used alternative therapies (acupuncture, homeopathy, massage therapy, etc.). Attitude toward mHealth apps were positive even though nearly half of PwPPs were unfamiliar with them. More than 72% of respondents were open to using a health-related app as a research tool for data collection in real life situations. Comprehensive data collection (especially about psychosocial factors) was the most important requirement. More respondents (especially medical professionals) were concerned about health hazards of misinformation communicated via health-related information and communication systems (maximum 80%) than about privacy (maximum 40%). Qualitative analyses revealed several promises and impediments to creation of data-sharing platforms for CP.

Conclusions

This study shows a general willingness among PwPPs to become partners in studying alternative pain management. Despite a generally positive attitude toward the concept of sharing complex personal data to advance research, heterogeneity of attitudes shaped by personal experiences must be considered. Our study underlines the need for any digital strategy for CP research to be person-centered and flexible.

Implementation of a Personalized Digital Application for Pediatric Pre-Anesthesia Evaluation and Education: An Ongoing Usability Analysis and Dynamic Improvement Scheme

BACKGROUND

Pre-anesthesia evaluation session is a basic practice preceding any surgical procedure, aimed at tailoring individualized anesthetic plan per patient, improving safety, and providing patients with educational knowledge and tools in preparation for the surgery day. In the last two decades, electronic health (eHealth) and mobile health (mHealth) settings gradually replaced part of the face-to-face encounters as the platform for pre-anesthesia communication between doctor and patient, yielding a range of benefits as demonstrated in recent publications. Yet, there is a lack of studies examining the effectiveness of surgical mHealth applications focusing on the pediatric preanesthetic setting and addressing their usability among families.

OBJECTIVE

This study describes a dynamic approach for the development process of GistMD's pre-anesthesia mHealth system, a mobile-based educational and management system designed for the pediatric setting.

METHODS

The study was conducted in four departments in a 1500-beds quaternary, academic medical center in Tel Aviv, Israel. During the study period, pre-anesthesia system was sent via text message to families whose children were about to undergo surgery. The system included pre-anesthesia questionnaires, educational videos, downloadable instructions, and consent forms. Ongoing collection and examination of usability data were conducted during the implementation term including responsiveness, effectiveness, and satisfaction indicators. The information collected in each stage was used to draw conclusions regarding potential usability gaps of the system and to plan product adjustments for the following period.

RESULTS

In a period of 141 days of implementation, GistMD pre-anesthesia management system was sent to 769 families. Three product fit actions were applied during this term: (1) Change of text message scheduling, aimed at addressing learnability and accessibility, resulted in a significant increase of 27% (χ2 [1] = 12.65, P<.001) in view rates and 27.4% (χ2 [1] = 30.01, P<.001) in satisfaction rates; (2) Reduce the number of screens, aimed at increasing efficiency and operability, resulted in a significant decrease of 8.6% of cases in which users did not perform any activity on the system after logging in (χ2 [1] = 6.18, P=.02); (3) Patient-focused campaign in two departments aimed at addressing memorability, resulted in significant increases in eight of twelve usability indicators.

CONCLUSIONS

Our results indicate that mHealth product-fit decisions derived from theory-based approach and ongoing usability data analysis allow tailoring of most appropriate responses for usability gaps, as reflected in increasing use rates and satisfaction. In the case of the pre-anesthesia management system in the pediatric setting, increased usability conveyed important benefits for patients and families. This work suggests a framework and study methods that may also be applicable in other mHealth settings and domains.

CLINICALTRIAL