Development of a lumbar puncture virtual simulator for medical students training: A preliminary evaluation

BACKGROUND

Lumbar puncture is an essential medical procedure whose objective is to obtain cerebrospinal fluid. Lumbar puncture is considered a complex procedure, mainly for novice residents who suffer from stress and low confidence, which may result in harm to the patient.

METHODS

The LPVirSim, has been developed in four stages: i) requirements analysis through user-centred design; ii) prototyping of the virtual environment and the haptic component; iii) preliminary tests with Ph.D. students and physicians using two haptic devices (Omega.7 and Sigma.7); iv) a user study where physicians evaluated the usability and user experience.

RESULTS

The LPVirSim integrates non-technical skills and the possibility of representing different patients for training. Usability increased from 61.76 to 68.75 in the preliminary tests to 71.43 in the user study.

CONCLUSIONS

All the results showed good usability and demonstrated that the simulator arouses interest and realistically represents a Lumbar puncture, through the force and visual feedback.

Designing a Tangible User Interface (TUI) for the Elderly Based on Their Motivations and Game Elements

The elderly population has grown significantly in recent years, requiring strategies focused on promoting active aging to improve health and well-being. It may be achieved in many ways, including using technology for this population. We propose an interactive system for older adults based on a tangible user interface. A group of 10 experts conducted a heuristic evaluation of a system of this type utilizing a questionnaire and obtaining satisfactory results. This study evaluated the older adult population's fun and pervasive game experience. The results will provide a basis for continuing to build this interactive system to promote active aging in older adults, either at the cognitive or physical level, depending on the applied approach.

How do adolescents experience a newly developed Online Single Session Sleep Intervention? A Think-Aloud Study

BACKGROUND

Sleep problems are common in adolescents and have detrimental impacts on physical and mental health and daily functioning. Evidence-based treatment like cognitive behaviour therapy for insomnia (CBT-I) is often hard to access, and adolescents may not engage in and adhere to longer, clinician-delivered interventions. Brief, self-guided, and accessible sleep interventions are needed.

OBJECTIVE

To explore the user experience of a prototype online self-help single session sleep intervention developed for adolescents.

METHODS

Eleven participants aged 17-19 years (8 females, 3 males) took part in online retrospective think-aloud interviews. Participants first completed the prototype intervention independently and were then shown the intervention page by page and asked to verbalise their thoughts and experiences. Transcripts were analyzed thematically.

RESULTS

Participants found the intervention helpful. Four themes were generated - 'Educative: Learning, but more fun', 'Effortless: Quicker and Easier', 'Personalization: Power of Choice', and 'Positivity: Just Good Vibes'. The theme 'Educative: Learning, but more fun' encompassed two sub-themes 'Opportunity to Learn' and 'Aesthetics and Learning'. These themes reflected participants' views that the intervention was educative, personalised, solution-oriented and easy to use, but could incorporate more graphics and visuals to aid in learning and could be made more effortless and positive through modifications to its design.

CONCLUSIONS

Findings convey the importance of ensuring educative well-designed content, personalization, a positive tone, and ease of use while designing interventions targeting adolescents's sleep and mental health. They also indicate areas for further developing the intervention.

Think Aloud Testing of a Smartphone App for Lifestyle Change Among Persons at Risk of Type 2 Diabetes: Usability Study

BACKGROUND

Type 2 diabetes mellitus (DM2) is a leading cause of morbidity and mortality worldwide and is considered a global epidemic. Despite the growing evidence on the effectiveness of mobile health interventions in the management of DM2, the evidence on the effect of mobile health interventions in prevention of DM2 is sparse. Therefore, we have developed an app aiming to promote initiation of behavioral change and adherence to healthy behavior. Before commencing a small-scale randomized controlled trial to assess the feasibility of using an app for initiation and adherence of healthy behavior in people at risk of DM2, testing the usability of the app in the target population is warranted.

OBJECTIVE

The aim of this study was to assess the usability of an app among people at risk of DM2.

METHODS

A qualitative study with the use of a think aloud (TA) procedure was conducted from April to November 2022. The TA procedure consisted of 10 problem-solving tasks and a semistructured interview which was carried out after the tasks. These interviews served to gain more in-depth knowledge of the users experience of the problem-solving tasks. The TA-sessions and the postactivity interviews were recorded and transcribed verbatim, and the data were coded and analyzed following the principles of thematic analysis.

RESULTS

In total, 7 people at risk of DM2 with a median age of 66 (range 41-75) years participated in this study. The analysis resulted in the following themes: (1) user interface design; and (2) suggestions for improvements of the functionality of the app.

CONCLUSIONS

Overall, the participants were satisfied with the usability of the app. Through the TA-sessions, real time perspective on the appeal, relevance, and utility of the app were gained. Only minor changes to the functionality of the prototype app were reported as necessary to improve the usability of the app. Points of guidance from the participants in this study have been adopted and incorporated into the final design of the app now being assessed for feasibility in a small-scale randomized controlled trial.

Analyzing User Reviews of the First Digital Contraceptive: Mixed Methods Study

BACKGROUND

People in Western countries are increasingly rejecting hormone-based birth control and expressing a preference for hormone-free methods. Digital contraceptives have emerged as nonhormonal medical devices that make use of self-tracked data and algorithms to find a user's fertile window. However, there is little knowledge about how people experience this seemingly new form of contraception, whose failure may result in unwanted pregnancies, high health risks, and life-changing consequences. As digital contraception becomes more widely adopted, examining its user experience is crucial to inform the design of technologies that not only are medically effective but also meet users' preferences and needs.

OBJECTIVE

We examined the user experience offered by Natural Cycles-the first digital contraceptive-through an analysis of app reviews written by its users worldwide.

METHODS

We conducted a mixed methods analysis of 3265 publicly available reviews written in English by users of Natural Cycles on the Google Play Store. We combined computational and human techniques, namely, topic modeling and reflexive thematic analysis.

RESULTS

For some users of digital contraception, the hormone-free aspect of the experience can be more salient than its digital aspect. Cultivating self-knowledge through the use of the technology can, in turn, feel empowering. Users also pointed to an algorithmic component that allows for increased accuracy over time as long as user diligence is applied. The interactivity of the digital contraceptive supports mutual learning and is experienced as agential and rewarding. Finally, a digital contraceptive can facilitate sharing the burden of contraceptive practices or highlight single-sided responsibilities while creating points of friction in the required daily routines.

CONCLUSIONS

Digital contraception is experienced by users as a tamed natural approach-a natural method contained and regulated by science and technology. This means that users can experience a method based on a digital product as "natural," which positions digital contraceptives as a suitable option for people looking for evidence-based nonhormonal contraceptive methods. We point to interactivity as core to the user experience and highlight that a digital contraceptive might allow for collaboration between partners around contraceptive practices and responsibilities. We note that the user diligence required for the digital contraceptive to provide accurate and frequent data is sometimes not enough. Future research could look at designing (and redesigning) digital contraceptives with primary users and intimate partners, enhancing the experience of tamed naturalness; exploring how trust fluctuates among involved actors and in interactions with the technology; and, ultimately, designing more inclusive approaches to digital contraception.

Supporting the Management of Gestational Diabetes Mellitus With Comprehensive Self-Tracking: Mixed Methods Study of Wearable Sensors

BACKGROUND

Gestational diabetes mellitus (GDM) is an increasing health risk for pregnant women as well as their children. Telehealth interventions targeted at the management of GDM have been shown to be effective, but they still require health care professionals for providing guidance and feedback. Feedback from wearable sensors has been suggested to support the self-management of GDM, but it is unknown how self-tracking should be designed in clinical care.

OBJECTIVE

This study aimed to investigate how to support the self-management of GDM with self-tracking of continuous blood glucose and lifestyle factors without help from health care personnel. We examined comprehensive self-tracking from self-discovery (ie, learning associations between glucose levels and lifestyle) and user experience perspectives.

METHODS

We conducted a mixed methods study where women with GDM (N=10) used a continuous glucose monitor (CGM; Medtronic Guardian) and 3 physical activity sensors: activity bracelet (Garmin Vivosmart 3), hip-worn sensor (UKK Exsed), and electrocardiography sensor (Firstbeat 2) for a week. We collected data from the sensors, and after use, participants took part in semistructured interviews about the wearable sensors. Acceptability of the wearable sensors was evaluated with the Unified Theory of Acceptance and Use of Technology (UTAUT) questionnaire. Moreover, maternal nutrition data were collected with a 3-day food diary, and self-reported physical activity data were collected with a logbook.

RESULTS

We found that the CGM was the most useful sensor for the self-discovery process, especially when learning associations between glucose and nutrition intake. We identified new challenges for using data from the CGM and physical activity sensors in supporting self-discovery in GDM. These challenges included (1) dispersion of glucose and physical activity data in separate applications, (2) absence of important trackable features like amount of light physical activity and physical activities other than walking, (3) discrepancy in the data between different wearable physical activity sensors and between CGMs and capillary glucose meters, and (4) discrepancy in perceived and measured quantification of physical activity. We found the body placement of sensors to be a key factor in measurement quality and preference, and ultimately a challenge for collecting data. For example, a wrist-worn sensor was used for longer compared with a hip-worn sensor. In general, there was a high acceptance for wearable sensors.

CONCLUSIONS

A mobile app that combines glucose, nutrition, and physical activity data in a single view is needed to support self-discovery. The design should support tracking features that are important for women with GDM (such as light physical activity), and data for each feature should originate from a single sensor to avoid discrepancy and redundancy. Future work with a larger sample should involve evaluation of the effects of such a mobile app on clinical outcomes.

TRIAL REGISTRATION

Clinicaltrials.gov NCT03941652; https://clinicaltrials.gov/study/NCT03941652.

Reducing Dental Anxiety in Children Using a Mobile Health App: Usability and User Experience Study

BACKGROUND

Dentistry interventions cause common anxiety and fear problems in children (6-11 years), and according to scientific evidence, this causes a decrease in their quality of life. Therapies mediated by IT-based tools have been shown to positively influence children's mood based on distraction as well as relaxing activities, but there is no evidence of their use to reduce dental anxiety in children.

OBJECTIVE

The aim of this study was to answer the following research question: Does our new children-centered codesign methodology contribute to achieving a usable mobile-based product with a highly scored user experience?

METHODS

A mobile health app was developed to reduce dental anxiety in children using rapid application development following the usage-centered design methodology. Structured interviews were conducted to test the usability and user experience of the app prototype among 40 children (n=20, 50%, boys and n=20, 50%, girls; age 6-11 years) using a children-adapted questionnaire and the 7-point Single Ease Question rating scale. The Smiley Faces Program-Revised questionnaire was used to assess the level of dental anxiety in participants.

RESULTS

There were no significant differences between girls and boys. The task completion rate was 95% (n=19) for children aged 6-8 years (group 1) and 100% (n=20) for children aged 9-11 years (group 2). Group 1 found watching the relaxing video (task C) to be the easiest, followed by playing a video minigame (task B) and watching the narrative (task A). Group 2 found task C to be the easiest, followed by task A and then task B. The average time spent on the different types of tasks was similar in both age groups. Most of the children in both age groups were happy with the app and found it funny. All children thought that having the app in the waiting room during a dental visit would be useful.

CONCLUSIONS

The findings confirmed that the app is usable and provides an excellent user experience. Our children-adapted methodology contributes to achieving usable mobile-based products for children with a highly scored user experience.

Feasibility of common, enjoyable game play for assessing daily cognitive functioning in older adults

Background

Frequent digital monitoring of cognition is a promising approach for assessing endpoints in prevention and treatment trials of Alzheimer's disease and related dementias (ADRD). This study evaluated the feasibility of the MIND GamePack© for recurrent semi-passive assessment of cognition across a longitudinal interval.

Methods

The MIND GamePack consists of four iPad-based games selected to be both familiar and enjoyable: Word Scramble, Block Drop, FreeCell, and Memory Match. Participants were asked to play 20 min/day for 5 days (100 min) for 4 months. Feasibility of use by older adults was assessed by measuring gameplay time and game performance. We also evaluated compliance through semi-structured surveys. A linear generalized estimating equation (GEE) model was used to analyze changes in gameplay time, and a regression tree model was employed to estimate the days it took for game performance to plateau. Subjective and environmental factors associated with gameplay time and performance were examined, including daily self-reported questions of memory and thinking ability, mood, sleep, energy, current location, and distractions prior to gameplay.

Results

Twenty-six cognitively-unimpaired older adults participated (mean age ± SD = 71.9 ± 8.6; 73% female). Gameplay time remained stable throughout the 4-months, with an average compliance rate of 91% ± 11% (1946 days of data across all participants) and weekly average playtime of 210 ± 132 min per participant. We observed an initial learning curve of improving game performance which on average, plateaued after 22-39 days, depending on the game. Higher levels of self-reported memory and thinking ability were associated with more gameplay time and sessions.

Conclusion

MIND GamePack is a feasible and well-designed semi-passive cognitive assessment platform which may provide complementary data to traditional neuropsychological testing in research on aging and dementia.

How do search systems impact systematic searching? A qualitative study

Objective

Systematic reviews and other evidence synthesis projects require systematic search methods. Search systems require several essential attributes to support systematic searching; however, many systems used in evidence synthesis fail to meet one or more of these requirements. I undertook a qualitative study to examine the effects of these limitations on systematic searching and how searchers select information sources for evidence synthesis projects.

Methods

Qualitative data were collected from interviews with twelve systematic searchers. Data were analyzed using reflexive thematic analysis.

Results

I used thematic analysis to identify two key themes relating to search systems: systems shape search processes, and systematic searching occurs within the information market. Many systems required for systematic reviews, in particular sources of unpublished studies, are not designed for systematic searching. Participants described various workarounds for the limitations they encounter in these systems. Economic factors influence searchers' selection of sources to search, as well as the degree to which vendors prioritize these users.

Conclusion

Interviews with systematic searchers suggest priorities for improving search systems, and barriers to improvement that must be overcome. Vendors must understand the unique requirements of systematic searching and recognize systematic searchers as a distinct group of users. Better interfaces and improved functionality will result in more efficient evidence synthesis.

"Everything's so Role-Specific": VA Employee Perspectives' on Electronic Health Record (EHR) Transition Implications for Roles and Responsibilities

BACKGROUND

Electronic health record (EHR) transitions are increasingly widespread and often highly disruptive. It is imperative we learn from past experiences to anticipate and mitigate such disruptions. Veterans Affairs (VA) is undergoing a large-scale transition from its homegrown EHR (CPRS/Vista) to a commercial EHR (Cerner), creating a unique opportunity of shedding light on large-scale EHR-to-EHR transition challenges.

OBJECTIVE

To explore one facet of the organizational impact of VA's EHR transition: its implications for employees' roles and responsibilities at the first VA site to implement Cerner Millennium EHR.

DESIGN

As part of a formative evaluation of frontline staff experiences with VA's EHR transition, we conducted brief (~ 15 min) and full-length interviews (~ 60 min) with clinicians and staff at Mann-Grandstaff VA Medical Center in Spokane, WA, before, during, and after transition (July 2020-November 2021).

PARTICIPANTS

We conducted 111 interviews with 26 Spokane clinicians and staff, recruited via snowball sampling.

APPROACH

We conducted audio interviews using a semi-structured guide with grounded prompts. We coded interview transcripts using a priori and emergent codes, followed by qualitative content analysis.

KEY RESULTS

Unlike VA's previous EHR, Cerner imposes additional restrictions on access to its EHR functionality based upon "roles" assigned to users. Participants described a mismatch between established institutional duties and their EHR permissions, unanticipated changes in scope of duties brought upon by the transition, as well as impediments to communication and collaboration due to different role-based views.

CONCLUSIONS

Health systems should anticipate substantive impacts on professional workflows when EHR role settings do not reflect prior workflows. Such changes may increase user error, dissatisfaction, and patient care disruptions. To mitigate employee dissatisfaction and safety risks, health systems should proactively plan for and communicate about expected modifications and monitor for unintended role-related consequences of EHR transitions, while vendors should ensure accurate role configuration and assignment.

Impacts of an Electronic Health Record Transition on Veterans Health Administration Health Professions Trainee Experience

BACKGROUND

Adoption of electronic health care records (EHRs) has proliferated since 2000. While EHR transitions are widely understood to be disruptive, little attention has been paid to their effect on health professions trainees' (HPTs) ability to learn and conduct work. Veterans Health Administration's (VA) massive transition from its homegrown EHR (CPRS/Vista) to the commercial Oracle Cerner presents an unparalleled-in-scope opportunity to gain insight on trainee work functions and their ability to obtain requisite experience during transitions.

OBJECTIVE

To identify how an organizational EHR transition affected HPT work and learning at the third VA go-live site.

DESIGN

A formative mixed-method evaluation of HPT experiences with VHA's EHR transition including interviews with HPTs and supervisors at Chalmers P. Wylie VA Outpatient Clinic in Columbus, OH, before (~60 min), during (15-30 min), and after (~60 min) go-live (December 2021-July 2022). We also conducted pre- (March 2022-April 2022) and post-go live (May 2022-June 2022) HPT and employee surveys.

PARTICIPANTS

We conducted 24 interviews with HPTs (n=4), site leaders (n=2), and academic affiliates (n=2) using snowball sampling. We recruited HPTs in pre- (n=13) and post-go-live (n=10) surveys and employees in pre- (n=408) and post-go-live (n=458) surveys.

APPROACH

We conducted interviews using a semi-structured guide and grounded prompts. We coded interviews and survey free text data using a priori and emergent codes, subsequently conducting thematic analysis. We conducted descriptive statistical analysis of survey responses and merged interview and survey data streams.

KEY RESULTS

Our preliminary findings indicate that the EHR transition comprehensively affected HPT experiences, disrupting processes from onboarding and training to clinical care contributions and training-to-career retention.

CONCLUSIONS

Understanding HPTs' challenges during EHR transitions is critical to effective training. Mitigating the identified barriers to HPT training and providing patient care may lessen their dissatisfaction and ensure quality patient care during EHR transitions.

Identifying the Information Needs and Format Preferences for Web-Based Content Among Adults With or Parents of Children With Attention-Deficit/Hyperactivity Disorder: Three-Stage Qualitative Analysis

BACKGROUND

Attention-deficit/hyperactivity disorder (ADHD) is a highly prevalent childhood and adult behavioral disorder. Internet searches for ADHD information are rising, particularly for diagnosis and treatment. Despite effective ADHD treatments, research suggests that there are delays in seeking help for ADHD. Identifying ways to shorten delays is important for minimizing morbidity associated with ADHD. One way to shorten these delays is to improve internet health information resources. Research shows that parents of children with ADHD feel that much of the information available is technical and not tailored for their child's needs and verbal instructions given by health care providers were too pharmacologically focused with limited information about how to manage and support ADHD symptoms in daily living. A majority of parents search the internet for general and pharmacological information for ADHD and prefer web-based resources for learning about ADHD, but web-based resources may be inaccurate and of low quality. Ensuring accurate information through the internet is an important step in assisting parents and adults in making informed decisions about the diagnosis and treatment of ADHD.

OBJECTIVE

Although a great deal of information regarding ADHD is available on the internet, some information is not based on scientific evidence or is difficult for stakeholders to understand. Determining gaps in access to accurate ADHD information and stakeholder interest in the type of information desired is important in improving patient engagement with the health care system, but minimal research addresses these needs. This study aims to determine the information needs and formatting needs of web-based content for adults with ADHD and parents of children with ADHD in order to improve user experience and engagement.

METHODS

This was a 3-phase study consisting of in-depth phone interviews about experiences with ADHD and barriers searching for ADHD-related information, focus groups where participants were instructed to consider the pathways by which they made decisions using web-based resources, and observing participants interacting with a newly developed website tailored for adults with potential ADHD and caregivers of children who had or might have ADHD. Phase 1 individual interviews and phase 2 focus groups identified the needs of the ADHD stakeholders related to website content and format. Interview and focus group findings were used to develop a website. Phase 3 used think-aloud interviews to evaluate website usability to inform the tailoring of the website based on user feedback.

RESULTS

Interviews and focus group findings revealed preferences for ADHD website information and content, website layout, and information sources. Themes included a preference for destigmatizing information about ADHD, information specific to patient demographics, and evidence-based information tailored to lay audiences.

CONCLUSIONS

ADHD stakeholders are specifically seeking positive information about ADHD presented in a user-friendly format.

Patient and Clinician Perceptions of the Pulse Oximeter in a Remote Monitoring Setting for COVID-19: Qualitative Study

BACKGROUND

As a response to the COVID-19 pandemic, the Sydney Local Health District in New South Wales, Australia, launched the rpavirtual program, the first full-scale virtual hospital in Australia, to remotely monitor and follow up stable patients with COVID-19. As part of the intervention, a pulse oximeter wearable device was delivered to patients to monitor their oxygen saturation levels, a critical indicator of COVID-19 patient deterioration. Understanding users' perceptions toward the device is fundamental to assessing its usability and acceptability and contributing to the effectiveness of the intervention, but no research to date has explored the user experience of the pulse oximeter for remote monitoring in this setting.

OBJECTIVE

This study aimed to explore the use, performance, and acceptability of the pulse oximeter by clinicians and patients in rpavirtual during COVID-19.

METHODS

Semistructured interviews and usability testing were conducted. Stable adult patients with COVID-19 (aged ≥18 years) who used the pulse oximeter and were monitored by rpavirtual, and rpavirtual clinicians monitoring these patients were interviewed. Clinicians could be nurses, doctors, or staff who were part of the team that assisted patients with the use of the pulse oximeter. Usability testing was conducted with patients who had the pulse oximeter when they were contacted. Interviews were coded using the Theoretical Framework of Acceptability. Usability testing was conducted using a think-aloud protocol. Data were collected until saturation was reached.

RESULTS

Twenty-one patients (average age 51, SD 13 years) and 15 clinicians (average age 41, SD 11 years) completed the interview. Eight patients (average age 51, SD 13 years) completed the usability testing. All participants liked the device and thought it was easy to use. They also had a good understanding of how to use the device and the device's purpose. Patients' age and device use-related characteristics (eg, the warmth of hands and hand steadiness) were identified by users as factors negatively impacting the accurate use of the pulse oximeter.

CONCLUSIONS

Patients and clinicians had very positive perceptions of the pulse oximeter for COVID-19 remote monitoring, indicating high acceptability and usability of the device. However, factors that may impact the accuracy of the device should be considered when delivering interventions using the pulse oximeter for remote monitoring. Targeted instructions about the use of the device may be necessary for specific populations (eg, older people and patients unfamiliar with technology). Further research should focus on the integration of the pulse oximeter data into electronic medical records for real-time and secure patient monitoring.

Diagnostic Performance, Triage Safety, and Usability of a Clinical Decision Support System Within a University Hospital Emergency Department: Algorithm Performance and Usability Study

Background

Computerized clinical decision support systems (CDSSs) are increasingly adopted in health care to optimize resources and streamline patient flow. However, they often lack scientific validation against standard medical care.

Objective

The purpose of this study was to assess the performance, safety, and usability of a CDSS in a university hospital emergency department setting in Kuopio, Finland.

Methods

Patients entering the emergency department were asked to voluntarily participate in this study. Patients aged 17 years or younger, patients with cognitive impairments, and patients who entered the unit in an ambulance or with the need for immediate care were excluded. Patients completed the CDSS web-based form and usability questionnaire when waiting for the triage nurse's evaluation. The CDSS data were anonymized and did not affect the patients' usual evaluation or treatment. Retrospectively, 2 medical doctors evaluated the urgency of each patient's condition by using the triage nurse's information, and urgent and nonurgent groups were created. The International Statistical Classification of Diseases, Tenth Revision diagnoses were collected from the electronic health records. Usability was assessed by using a positive version of the System Usability Scale questionnaire.

Results

In total, our analyses included 248 patients. Regarding urgency, the mean sensitivities were 85% and 19%, respectively, for urgent and nonurgent cases when assessing the performance of CDSS evaluations in comparison to that of physicians. The mean sensitivities were 85% and 35%, respectively, when comparing the evaluations between the two physicians. Our CDSS did not miss any cases that were evaluated to be emergencies by physicians; thus, all emergency cases evaluated by physicians were evaluated as either urgent cases or emergency cases by the CDSS. In differential diagnosis, the CDSS had an exact match accuracy of 45.5% (97/213). The usability was good, with a mean System Usability Scale score of 78.2 (SD 16.8).

Conclusions

In a university hospital emergency department setting with a large real-world population, our CDSS was found to be equally as sensitive in urgent patient cases as physicians and was found to have an acceptable differential diagnosis accuracy, with good usability. These results suggest that this CDSS can be safely assessed further in a real-world setting. A CDSS could accelerate triage by providing patient-provided data in advance of patients' initial consultations and categorize patient cases as urgent and nonurgent cases upon patients' arrival to the emergency department.

Design and Evaluation of Using Head-Mounted Virtual Reality for Learning Clinical Procedures: Mixed Methods Study

BACKGROUND

The capacity of health care professionals to perform clinical procedures safely and competently is crucial as it will directly impact patients' outcomes. Given the ability of head-mounted virtual reality to simulate the authentic clinical environment, this platform should be suitable for nurses to refine their clinical skills for knowledge and skills acquisition. However, research on head-mounted virtual reality in learning clinical procedures is limited.

OBJECTIVE

The objectives of this study were (1) to describe the design of a head-mounted virtual reality system and evaluate it for education on clinical procedures for nursing students and (2) to explore the experience of nursing students using head-mounted virtual reality for learning clinical procedures and the usability of the system.

METHODS

This usability study used a mixed method approach. The stages included developing 3D models of the necessary instruments and materials used in intravenous therapy and subcutaneous injection procedures performed by nurses, followed by developing the procedures using the Unreal Engine (Epic Games). Questionnaires on the perception of continuance intention and the System Usability Scale were used along with open-ended questions.

RESULTS

Twenty-nine nursing students took part in this questionnaire study after experiencing the immersive virtual reality (IVR) intervention. Participants reported largely favorable game perception and learning experience. Mean perception scores ranged from 3.21 to 4.38 of a maximum score of 5, while the mean system usability score was 53.53 of 100. The majority found that the IVR experience was engaging, and they were immersed in the game. The challenges encountered included unfamiliarity with the new learning format; technological constraints, such as using hand controllers; and physical discomfort.

CONCLUSIONS

The conception of IVR for learning clinical procedures through deliberate practice to enhance nurses' knowledge and skills is promising. However, refinement of the prototypes is required to improve user experience and learning. Future research can explore other ways to use IVR for better education and health care purposes.

A Bespoke Electronic Health Journal for Monitoring Response to Botulinum Toxin in Treatment of Cervical Dystonia: Open-Label Observational Study of User Experience

BACKGROUND

The mainstay of treatment for cervical dystonia (CD) is regular botulinum toxin injections every 3-4 months. Clinical evaluation of response is dependent on the patient's recall of how well symptoms responded to the previous injection. A mobile health app could assist both patients and health care professionals to monitor treatment benefits and side effects to assist with the selection of muscle and toxin dose to be injected at the next visit. The DystoniaDiary is a bespoke electronic health journal for monitoring symptoms of CD and response to treatment.

OBJECTIVE

The objective of this study was to assess the acceptability and utility of the DystoniaDiary in patients with CD treated with botulinum toxins as part of their usual care.

METHODS

In this open-label, single-center, single-arm observational study, patients attending a botulinum toxin injection clinic were invited to download the DystoniaDiary app. Patients selected up to 3 of their most troublesome CD symptoms (from a predefined list) and were prompted every 3 days to rate the control of these symptoms on a scale from 0 (very badly) to 100 (very well). Dates of onset and wearing off of response to injected botulinum toxin and responses to the Cervical Dystonia Impact Profile (CDIP-58) questionnaire at baseline and week 6 were also recorded in the app.

RESULTS

A total of 34 patients installed DystoniaDiary. Twenty-five patients (25/34, 74%) recorded data for ≥12 weeks and 21 patients (21/34, 62%) for ≥16 weeks. Median time between the first and last data input was 140 days with a median of 13 recordings per patient. User experience questionnaires at weeks 4 and 12 (20 respondents) indicated that the majority of respondents found the DystoniaDiary app easy to install and use, liked using it, would recommend it to others (19/20), and wished to continue using it (16/20). A smaller proportion indicated that the DystoniaDiary gave a greater sense of control in managing their CD (13/20). There was interindividual variation in patients' perceptions of control of their symptoms after botulinum toxin injection. Response to treatment was apparent in the symptom control scores for some patients, whereas the severity of other patients' symptoms did not appear to change after treatment.

CONCLUSIONS

This observational study demonstrated that the DystoniaDiary app was perceived as useful and acceptable for a large proportion of this sample of patients with CD attending a botulinum toxin clinic. Patients with CD appear to be willing to regularly record symptom severity for at least the duration of a botulinum injection treatment cycle (12-16 weeks). This app may be useful in monitoring and optimizing individual patient responses to botulinum toxin injection.

Multi-list interfaces for recommender systems: survey and future directions

For a long time, recommender systems presented their results in the form of simple item lists. In recent years, however, multi-list interfaces have become the de-facto standard in industry, presenting users with numerous collections of recommendations, one below the other, each containing items with common characteristics. Netflix's interface, for instance, shows movies from certain genres, new releases, and lists of curated content. Spotify recommends new songs and albums, podcasts on specific topics, and what similar users are listening to. Despite their popularity, research on these so-called "carousels" is still limited. Few authors have investigated how to simulate the user behavior and how to optimize the recommendation process accordingly. The number of studies involving users is even smaller, with sometimes conflicting results. Consequently, little is known about how to design carousel-based interfaces for achieving the best user experience. This mini review aims to organize the existing knowledge and outlines directions that may improve the multi-list presentation of recommendations in the future.

Operability of Smart Spaces in Urban Environments: A Systematic Review on Enhancing Functionality and User Experience

This literature review highlights the emergence of the Internet of Things (IoT) and the proliferation of connected devices as the driving force behind the adoption of smart spaces. This review also discusses the various applications of smart spaces, including smart homes, smart cities, and smart healthcare: (1) Background: the aim of this research is to provide a comprehensive overview of the concept of smart spaces, including their key features, technologies, and applications in built environments and urban areas; (2) Methods: The study adopts a qualitative approach, drawing on secondary sources, such as academic journals, reports, and online sources; (3) Results: The findings suggest that smart spaces have the potential to transform the way people interact with their environment and each other. They could improve efficiency, safety, and quality of life. However, there are also concerns about privacy and security in relation to the collection and use of personal data; (4) Conclusions: The study concludes that smart spaces have significant theoretical and practical implications for various fields, including architecture, urban planning, and healthcare. The theoretical implications include the need for new models and frameworks to understand the complex relationships between technology, space, and society. The practical implications involve the development of new standards and regulations to ensure the responsible and ethical use of smart spaces.

Experiences and Perceptions of Telehealth Visits in Diabetes Care During and After the COVID-19 Pandemic Among Adults With Type 2 Diabetes and Their Providers: Qualitative Study

BACKGROUND

Since the COVID-19 pandemic, telehealth has been widely adopted in outpatient settings in the United States. Although telehealth visits are publicly accepted in different settings, little is known about the situation after the wide adoption of telehealth from the perspectives of adults with type 2 diabetes mellitus (T2D) and their providers.

OBJECTIVE

This study aims to identify barriers and facilitators of maintaining continuity of care using telehealth for patients with T2D in a diabetes specialty clinic.

METHODS

As the second phase of a multimethod study to understand missed appointments among adults with T2D, we conducted semistructured, individual, in-depth phone or Zoom interviews with 23 adults with T2D (14/23, 61% women; mean age 55.1, SD 14.4, range 35-77 years) and 10 providers from diabetes clinics in a tertiary academic medical center in Maryland. Interviews were audio-recorded, transcribed, and analyzed using thematic content analysis by the research team.

RESULTS

Adults with T2D and their providers generally reported positive experiences with telehealth visits for diabetes care with some technical challenges resulting in the need for in-person visits. We identified the following 3 themes: (1) "perceived benefits of telehealth visits," such as convenience, time and financial efficiencies, and independence from caregivers, benefits shared by both patients and providers; (2) "perceived technological challenges of telehealth visits," such as disparities in digital health literacy, frustration caused by unstable internet connection, and difficulty sharing glucose data, challenges shared by both patients and providers; and (3) "impact of telehealth visits on the quality of diabetes care," including lack of diabetes quality measures and needs and preferences for in-person visits, shared mainly from providers' perspectives with some patient input.

CONCLUSIONS

Telehealth is generally received positively in diabetes care with some persistent challenges that might compromise the quality of diabetes care. Telehealth technology and glucose data platforms must incorporate user experience and user-centered design to optimize telehealth use in diabetes care. Clinical practices need to consider new workflows for telehealth visits to facilitate easier follow-up scheduling and lab completion. Future research to investigate the ideal balance between in-person and telehealth visits in diabetes care is warranted to enhance the quality of diabetes care and to optimize diabetes outcomes. Policy flexibilities should also be considered to broaden access to diabetes care for all patients with T2D.

User Experiences on the Implementation of Exoskeletons in Care Work

This article describes the results of a field test of an exoskeleton in care work. Qualitative data about the implementation and use of exoskeletons, with the help of interviews and user diaries, were collected both from nurses who used the exoskeleton and managers at different levels of the care organization. On the basis of these data, there are relatively few obstacles in and many opportunities for the implementation of exoskeletons in care work, taken that the introduction, orientation and continuous support for technology use are given enough weight.

Culturally Adapting a Digital Intervention to Reduce Suicidal Ideation for Syrian Asylum Seekers and Refugees in the United Kingdom: Protocol for a Qualitative Study

BACKGROUND

The conflict in Syria has produced the largest forced displacement crisis since the Second World War. As a result, Syrians have experienced various stressors across the migratory process, putting them at an increased risk of developing mental health issues, including, crucially, suicidal ideation (SI). Despite their high rates of SI across Europe, there remain various barriers to accessing treatment. One way to increase access is the use of culturally adapted digital interventions, which have already shown potential for other minority populations. To culturally adapt the intervention, further research is needed to better understand Syrian asylum seekers' and refugees' cultural conceptualizations, coping strategies, and help-seeking behavior for SI. To do so, this study will use a unique cultural adaptation framework to intervene at points of lived experience with the migratory process where Syrian culture and signs of psychopathology converge. Likewise, co-design events will be used to adapt points of experience with the intervention where Syrian culture and the intervention conflict. As the first cultural adaption of a digital SI intervention for Syrian asylum seekers and refugees, this study will hopefully encourage further development of culturally sensitive interventions for the largest refugee population in the United Kingdom and the world.

OBJECTIVE

The objective of the study is to increase access to mental health treatment for Syrian asylum seekers and refugees in the United Kingdom by culturally adapting a digital intervention to reduce SI.

METHODS

The study will use experience-based co-design, an action research method, to culturally adapt a digital intervention to reduce SI for Syrian asylum seekers and refugees in the United Kingdom. This will involve conducting 20-30 interviews to understand their lived experiences with the migratory process, cultural conceptualizations of mental health and SI, coping strategies, mental health help-seeking behavior, and perceptions of digital mental health interventions. In addition, 3 co-design events with 6 participants in each will be held to collaboratively adapt the intervention. Touchpoints and themes extracted from each phase will be prioritized by a community panel before adapting the intervention.

RESULTS

The study began in November 2022 and will continue until the last co-design event in August 2023. The results of the study will then be published by December 2023.

CONCLUSIONS

Access to treatment for some of the most severe mental health issues is still limited for Syrian asylum seekers and refugees in the United Kingdom. Cultural adaptations of digital interventions developed for general populations have the potential to increase access to treatment for this population. Specifically, adapting the intervention for Syrian asylum seekers' and refugees' experiences with SI in relation to their lived experience with the migratory process may enable greater recruitment and adherence for users of various cultural and ethnic subgroups and levels of SI.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/47627.

Physicians' Perspectives on EHR Usability: Results from Four Large Cross-Sectional Surveys from 2010 to 2021

Usability and user experience are central quality attributes of electronic health record (EHR) systems. Usability evaluation studies typically focus on short-term use and situational usability, although feedback collected during operational use provides input for future information systems development. An abundance of studies report on physicians' dissatisfaction with the usability of their EHR systems and many show an association between poor usability and physician burnout. However, there is a scarcity of large long-term monitoring studies assessing end users' experiences with EHRs. We report on the results from four large (n=3,929-4,628) national cross-sectional usability surveys conducted among Finnish physicians in 2010, 2014, 2017, and 2021. The main finding was that the perceptions of physicians working in public health centres had changed for the better but those working in public hospitals reported similar or even more negative experiences in 2021 than in 2010-17; they rated only system responsiveness to inputs as having improved. Based on this finding, systematic research-based monitoring of EHR development from the end users' perspectives should be continued.

Utility and Usability of Two Forms of Supplemental Vibrotactile Kinesthetic Feedback for Enhancing Movement Accuracy and Efficiency in Goal-Directed Reaching

Recent advances in wearable sensors and computing have made possible the development of novel sensory augmentation technologies that promise to enhance human motor performance and quality of life in a wide range of applications. We compared the objective utility and subjective user experience for two biologically inspired ways to encode movement-related information into supplemental feedback for the real-time control of goal-directed reaching in healthy, neurologically intact adults. One encoding scheme mimicked visual feedback encoding by converting real-time hand position in a Cartesian frame of reference into supplemental kinesthetic feedback provided by a vibrotactile display attached to the non-moving arm and hand. The other approach mimicked proprioceptive encoding by providing real-time arm joint angle information via the vibrotactile display. We found that both encoding schemes had objective utility in that after a brief training period, both forms of supplemental feedback promoted improved reach accuracy in the absence of concurrent visual feedback over performance levels achieved using proprioception alone. Cartesian encoding promoted greater reductions in target capture errors in the absence of visual feedback (Cartesian: 59% improvement; Joint Angle: 21% improvement). Accuracy gains promoted by both encoding schemes came at a cost in terms of temporal efficiency; target capture times were considerably longer (1.5 s longer) when reaching with supplemental kinesthetic feedback than without. Furthermore, neither encoding scheme yielded movements that were particularly smooth, although movements made with joint angle encoding were smoother than movements with Cartesian encoding. Participant responses on user experience surveys indicate that both encoding schemes were motivating and that both yielded passable user satisfaction scores. However, only Cartesian endpoint encoding was found to have passable usability; participants felt more competent using Cartesian encoding than joint angle encoding. These results are expected to inform future efforts to develop wearable technology to enhance the accuracy and efficiency of goal-directed actions using continuous supplemental kinesthetic feedback.

User Experience Design for Social Robots: A Case Study in Integrating Embodiment

Social robotics is an emerging field with a high level of innovation. For many years, it was a concept framed in the literature and theoretical approaches. Scientific and technological advances have made it possible for robots to progressively make their way into different areas of our society, and now, they are ready to make the leap out of the industry and extend their presence into our daily lives. In this sense, user experience plays a fundamental role in achieving a smooth and natural interaction between robots and humans. This research focused on the user experience approach in terms of the embodiment of a robot, centring on its movements, gestures, and dialogues. The aim was to investigate how the interaction between robotic platforms and humans takes place and what differential aspects should be considered when designing the robot tasks. To achieve this objective, a qualitative and quantitative study was conducted based on a real interview between several human users and the robotic platform. The data were gathered by recording the session and having each user complete a form. The results showed that participants generally enjoyed interacting with the robot and found it engaging, which led to greater trust and satisfaction. However, delays and errors in the robot's responses caused frustration and disconnection. The study found that incorporating embodiment into the design of the robot improved the user experience, and the robot's personality and behaviour were significant factors. It was concluded that robotic platforms and their appearance, movements, and way of communicating have a decisive influence on the user's opinion and the way they interact.

Feasibility study of a clinical decision support system for polymedicated patients in primary care

Age-related changes in pharmacokinetics and pharmacodynamics, multimorbidity, frailty, and cognitive impairment represent challenges for drug treatments. Moreover, older adults are commonly exposed to polypharmacy, leading to increased risk of drug interactions and related adverse events, and higher costs for the healthcare systems. Thus, the complex task of prescribing medications to older polymedicated patients encourages the use of Clinical Decision Support Systems (CDSS). This paper evaluates the CDSS miniQ for identifying potentially inappropriate prescribing in poly-medicated older adults and assesses the usability and acceptability of the system in health care professionals, patients, and caregivers. The results of the study demonstrate that the miniQ system was useful for Primary Care physicians in significantly improving prescription, thereby reducing potentially inappropriate medication prescriptions for elderly patients. Additionally, the system was found to be beneficial for patients and their caregivers in understanding their medications, as well as usable and acceptable among healthcare professionals, patients, and caregivers, highlighting the potential to improve the prescription process and reduce errors, and enhancing the quality of care for elderly patients with polypharmacy, reducing adverse drug events, and improving medication management.

Increasing Participation in a TelePrEP Program for Sexual and Gender Minority Adolescents and Young Adults in Louisiana: Protocol for an SMS Text Messaging-Based Chatbot

BACKGROUND

Sexual and gender minority (SGM) adolescents and young adults (AYAs) are at increased risk of HIV infection, particularly in the Southern United States. Despite the availability of effective biomedical prevention strategies, such as pre-exposure prophylaxis (PrEP), access and uptake remain low among SGM AYAs. In response, the Louisiana Department of Health initiated the LA TelePrEP Program, which leverages the power of telemedicine to connect Louisiana residents to PrEP. A virtual TelePrEP Navigator guides users through the enrollment process, answers questions, schedules appointments, and facilitates lab testing and medication delivery. To increase the participation of SGM AYAs in the program, the TelePrEP program partnered with researchers to develop a chatbot that would facilitate access to the program and support navigator functions. Chatbots are capable of carrying out many functions that reduce employee workload, and despite their successful use in health care and public health, they are relatively new to HIV prevention.

OBJECTIVE

In this paper, we describe the iterative and community-engaged process that we used to develop an SMS text messaging-based chatbot tailored to SGM AYAs that would support navigator functions and disseminate PrEP-related information.

METHODS

Our process was comprised of 2 phases: conceptualization and development. In the conceptualization phase, aspects of navigator responsibilities, program logistics, and user interactions to prioritize in chatbot programming (eg, scheduling appointments and answering questions) were identified. We also selected a commercially available chatbot platform that could execute these functions and could be programmed with minimal coding experience. In the development phase, we engaged Department of Health staff and SGM AYAs within our professional and personal networks. Five different rounds of testing were conducted with various groups to evaluate each iteration of the chatbot. After each iteration of the testing process, the research team met to discuss feedback, guide the programmer on incorporating modifications, and re-evaluate the chatbot's functionality.

RESULTS

Through our highly collaborative and community-engaged process, a rule-based chatbot with artificial intelligence components was successfully created. We gained important knowledge that could advance future chatbot development efforts for HIV prevention. Key to the PrEPBot's success was resolving issues that hampered the user experience, like asking unnecessary questions, responding too quickly, and misunderstanding user input.

CONCLUSIONS

HIV prevention researchers can feasibly and efficiently program a rule-based chatbot with the assistance of commercially available tools. Our iterative process of engaging researchers, program personnel, and different subgroups of SGM AYAs to obtain input was key to successful chatbot development. If the results of this pilot trial show that the chatbot is feasible and acceptable to SGM AYAs, future HIV researchers and practitioners could consider incorporating chatbots as part of their programs.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/42983.

A Virtual Reality App Intervention to Improve Concussion Recognition and Reporting in Athletes Aged 9 to 12 Years: Development and Pilot Testing

BACKGROUND

Existing concussion education programs for preteen athletes typically do not result in sustained improvements in concussion symptom recognition or reporting behaviors. Virtual reality (VR) technology offers an innovative tool that may improve concussion symptom recognition and reporting behaviors among preteen athletes.

OBJECTIVE

We aimed to describe the design and development of a VR concussion education app, Make Play Safe (MPS), and present findings on the usability and preliminary efficacy of MPS in improving concussion recognition and reporting intentions among soccer athletes aged 9-12 years.

METHODS

A collaborative user-centered design process was implemented to develop and evaluate MPS, a semi-immersive VR concussion education app designed to address two behavioral outcomes in preteen athletes aged 9-12 years: (1) recognizing concussion and (2) reporting concussion. The development of MPS occurred in three phases: (1) design and development, (2) usability testing, and (3) preliminary efficacy testing. During phase 1, consultations were completed with 6 experts. Additionally, 5 interviews with children who had a history of concussion were conducted to collect feedback about the proof of concept of MPS. During phase 2, a participatory workshop with 11 preteen athletes and a small group discussion with 6 parents and 2 coaches were conducted to explore the usefulness and acceptability of MPS from the perspective of end users. Finally, phase 3 included preliminary efficacy testing with 33 soccer athletes aged 9-12 years to examine changes in concussion-related knowledge, attitudes, and reporting intentions from pre- to postintervention. The data generated from each phase of this study informed the development of the final version of the proof of concept of the VR concussion education app, MPS.

RESULTS

Experts positively rated the features of MPS and noted that the design and content were innovative and age-appropriate. Preteens with a history of concussion indicated the scenarios and symptoms portrayed in the app represented well what they experienced while concussed. Further, they stated that the app would be an engaging way for children to learn about concussions. The 11 healthy children in the workshop perceived the app positively, noting that the scenarios were informative and engaging. Results from preliminary efficacy testing revealed increases in many athletes' knowledge and reporting intentions from pre- to postintervention. Others demonstrated no significant changes or a decrease in knowledge, attitudes, or reporting intentions from pre- to postintervention. Group-level changes in concussion knowledge and intention to report concussions were statistically significant (P<.05), while changes in attitudes toward reporting concussions were not (P=.08).

CONCLUSIONS

Results suggest VR technology may be an effective and efficient tool to equip preteen athletes with the requisite knowledge and skills to recognize and report future concussions. Further research is recommended to examine the use of VR as an effective strategy to improve concussion-reporting behaviors in preteen athletes.

Detecting user experience issues from mHealth apps that support stroke caregiver needs: an analysis of user reviews

Background

Existing research has demonstrated the potential of mHealth apps in improving the caregiving outcomes of stroke. Since most of the apps were published in commercially available app stores without explaining their design and evaluation processes, it is necessary to identify the user experience issues to promote long-term adherence and usage.

Objective

The purpose of this study was to utilize published user reviews of commercially available apps to determine the user experience issues to guide future app development in stroke caregiving.

Methods

User reviews were extracted from the previously identified 46 apps that support stroke caregiving needs using a python-scraper. The reviews were pre-processed and filtered using python scripts to consider English reviews that described issues faced by the user. The final corpus was categorized based on TF-IDF vectorization and k-means clustering technique, and the issues extracted from the various topics were classified based on the seven dimensions of user experience to highlight factors that may affect the usage of the app.

Results

A total of 117,364 were extracted from the two app stores. After filtration, 13,368 reviews were included and classified based on the user experience dimensions. Findings highlight critical issues that affect the usability, usefulness, desirability, findability, accessibility, credibility, and value of the app that contribute to decreased satisfaction and increased frustration.

Conclusion

The study identified several user experience issues due to the inability of the app developers to understand the needs of the user. Further, the study describes the inclusion of a participatory design approach to promote an improved understanding of user needs; therefore, limiting any issues and ensuring continued use.

Analysis of Japanese consumers' attitudes toward the digital transformation of OTC medicine purchase behavior and eHealth literacy: an online survey for digital experience design

Introduction

Since the enactment of the revised Pharmaceutical Affairs Act in Japan in 2009, self-medication practices have increased in the country. However, studies report that consumers pay little attention to the medication facts and risks indicated on the packages of over-the-counter (OTC) medicines, which could be a potential risk. Since the COVID-19 pandemic, the digital transformation of purchasing OTC medicines has progressed. As an appropriate design for the digital transformation is likely to improve consumers' literacy and them obtaining medical information, this study systematically examines Japanese consumers' attitudes toward the digital transformation of OTC medicine purchase behavior and its correlation to eHealth literacy, exploring an appropriate digital experience design in purchasing OTC medicine.

Methods

Participants from the Greater Tokyo Area of Japan participated in an online survey. Consumers' current behavior and preferences in accessing OTC medicine, receiving medication guidance, and obtaining medical information were examined. eHealth literacy was assessed using the J-eHEALS. Descriptive statistics, text mining, and thematic analysis were conducted to answer research questions.

Results

Over 89% of the respondents who had experience in purchasing OTC medicines preferred local pharmacies or stores rather than online purchasing, p < 0.001. Obtaining medicine guidance in pharmacies or stores was the main preference over other approaches, p < 0.001. Furthermore, most of the participants accepted selecting medicine on shelves and digital screens in-store. However, they were accustomed to using smartphones to obtain additional information at the pharmacy or drug store, p < 0.001; this behavior was positively correlated with eHealth literacy, p < 0.001.

Conclusions

Japanese consumers are seeking a combination of conventional and digital behaviors for purchasing OTC medicine rather than opting for a particular method. Most consumers prefer purchasing and receiving instructions in-store while searching for additional decision-making information online. eHealth literacy is positively associated with digital behaviors of OTC medicine information acquisition but less associated with medicine purchases and selections. The hybrid digital experience design may enhance the OTC medicine purchase experience and reduce potential risks by providing appropriate information.

An Overview of Chatbot-Based Mobile Mental Health Apps: Insights From App Description and User Reviews

BACKGROUND

Chatbots are an emerging technology that show potential for mental health care apps to enable effective and practical evidence-based therapies. As this technology is still relatively new, little is known about recently developed apps and their characteristics and effectiveness.

OBJECTIVE

In this study, we aimed to provide an overview of the commercially available popular mental health chatbots and how they are perceived by users.

METHODS

We conducted an exploratory observation of 10 apps that offer support and treatment for a variety of mental health concerns with a built-in chatbot feature and qualitatively analyzed 3621 consumer reviews from the Google Play Store and 2624 consumer reviews from the Apple App Store.

RESULTS

We found that although chatbots' personalized, humanlike interactions were positively received by users, improper responses and assumptions about the personalities of users led to a loss of interest. As chatbots are always accessible and convenient, users can become overly attached to them and prefer them over interacting with friends and family. Furthermore, a chatbot may offer crisis care whenever the user needs it because of its 24/7 availability, but even recently developed chatbots lack the understanding of properly identifying a crisis. Chatbots considered in this study fostered a judgment-free environment and helped users feel more comfortable sharing sensitive information.

CONCLUSIONS

Our findings suggest that chatbots have great potential to offer social and psychological support in situations where real-world human interaction, such as connecting to friends or family members or seeking professional support, is not preferred or possible to achieve. However, there are several restrictions and limitations that these chatbots must establish according to the level of service they offer. Too much reliance on technology can pose risks, such as isolation and insufficient assistance during times of crisis. Recommendations for customization and balanced persuasion to inform the design of effective chatbots for mental health support have been outlined based on the insights of our findings.

A Hybrid Multimodal Emotion Recognition Framework for UX Evaluation Using Generalized Mixture Functions

Multimodal emotion recognition has gained much traction in the field of affective computing, human-computer interaction (HCI), artificial intelligence (AI), and user experience (UX). There is growing demand to automate analysis of user emotion towards HCI, AI, and UX evaluation applications for providing affective services. Emotions are increasingly being used, obtained through the videos, audio, text or physiological signals. This has led to process emotions from multiple modalities, usually combined through ensemble-based systems with static weights. Due to numerous limitations like missing modality data, inter-class variations, and intra-class similarities, an effective weighting scheme is thus required to improve the aforementioned discrimination between modalities. This article takes into account the importance of difference between multiple modalities and assigns dynamic weights to them by adapting a more efficient combination process with the application of generalized mixture (GM) functions. Therefore, we present a hybrid multimodal emotion recognition (H-MMER) framework using multi-view learning approach for unimodal emotion recognition and introducing multimodal feature fusion level, and decision level fusion using GM functions. In an experimental study, we evaluated the ability of our proposed framework to model a set of four different emotional states (Happiness, Neutral, Sadness, and Anger) and found that most of them can be modeled well with significantly high accuracy using GM functions. The experiment shows that the proposed framework can model emotional states with an average accuracy of 98.19% and indicates significant gain in terms of performance in contrast to traditional approaches. The overall evaluation results indicate that we can identify emotional states with high accuracy and increase the robustness of an emotion classification system required for UX measurement.

Virtual Reality Training of Social Skills in Adults with Autism Spectrum Disorder: An Examination of Acceptability, Usability, User Experience, Social Skills, and Executive Functions

Poor social skills in autism spectrum disorder (ASD) are associated with reduced independence in daily life. Current interventions for improving the social skills of individuals with ASD fail to represent the complexity of real-life social settings and situations. Virtual reality (VR) may facilitate social skills training in social environments and situations similar to those in real life; however, more research is needed to elucidate aspects such as the acceptability, usability, and user experience of VR systems in ASD. Twenty-five participants with ASD attended a neuropsychological evaluation and three sessions of VR social skills training, which incorporated five social scenarios with three difficulty levels. Participants reported high acceptability, system usability, and user experience. Significant correlations were observed between performance in social scenarios, self-reports, and executive functions. Working memory and planning ability were significant predictors of the functionality level in ASD and the VR system's perceived usability, respectively. Yet, performance in social scenarios was the best predictor of usability, acceptability, and functionality level. Planning ability substantially predicted performance in social scenarios, suggesting an implication in social skills. Immersive VR social skills training in individuals with ASD appears to be an appropriate service, but an errorless approach that is adaptive to the individual's needs should be preferred.

Methods and Lessons Learned from a Current State Workflow Assessment following Transition to a New Electronic Health Record System

The transition to a new electronic health record (EHR) system requires an understanding of how the new system addresses the needs, business processes, and current activities of a healthcare system. To address such requirements, a multidisciplinary team conducted a current state workflow assessment (CSWFA) of clinical and administrative functions to elicit and document business processes (via process diagrams), requirements, workarounds, and process issues (i.e., user interface issues, training gaps) at one healthcare facility. We provided a novel method of evaluating the implementation process to ensure that a CSWFA was documented with key stakeholders. In this analysis, we describe the CSWFA approach and expected outcomes with a specific emphasis on how a qualitative approach can be integrated to explore underlying patterns and relationships in the data. Overall, this methodology enables practitioners to deliver data-driven support initiatives that optimize EHR implementation while considering user experience, productivity, and patient safety.

Needs and wishes for the future lower limb exoskeleton: an interview study among people with spinal cord injury with community-based exoskeleton experience

PURPOSE

Exoskeleton use by people with complete spinal cord injury (SCI) in daily life is challenging. To optimize daily exoskeleton use, a better understanding of the purpose of use and the accompanying improvements are needed. The perspective of experienced exoskeleton users could guide design improvements.

METHODS

Face-to-face semi-structured interviews were held with 13 people with SCI with exoskeleton experience. Interviews were audio-taped, transcribed, and analysed thematically.

RESULTS

Participants expressed three future purposes of exoskeleton use: for daily activities (e.g., stair climbing), exercise (e.g., staying healthy), and social interaction (e.g., standing at parties). Exoskeleton use during daily activities was the ultimate goal. Therefore, the future exoskeleton should be: easy to use, small and lightweight, tailor made, safe, comfortable, less distinctive, durable, and affordable. Improving the ease of use was relevant for all purposes, for all participants. The other suggestions for improvement varied depending on the purpose of use and the participant.

CONCLUSION

Increasingly more advanced improvements are needed to transition from an exercise purpose to social interaction, and ultimately use during daily activities. In the current study, detailed suggestions for improvements have been made. Only when multiple of these suggestions are adjusted, can the exoskeleton be used to its full potential.IMPLICATIONS FOR REHABILITATIONThe use of an exoskeleton by people with a complete spinal cord injury in daily life is still in its infancy.To optimize daily exoskeleton use, a better understanding of the purpose of use and exoskeleton improvements is needed.More advanced improvements to future exoskeletons are needed to make a transition from use as an exercise device to use during social interaction and daily activities.Improving the ease of use of future exoskeletons is considered a priority by experienced users, followed by making the exoskeleton small, lightweight, and tailor made.

A Pilot of Digital Whiteboards for Improving Patient Satisfaction in the Emergency Department: Nonrandomized Controlled Trial

BACKGROUND

Electronic paper (E-paper) screens use electrophoretic ink to provide paper-like low-power displays with advanced networking capabilities that may potentially serve as an alternative to traditional whiteboards and television display screens in hospital settings. E-paper may be leveraged in the emergency department (ED) to facilitate communication. Providing ED patient status updates on E-paper screens could improve patient satisfaction and overall experience and provide more equitable access to their health information.

OBJECTIVE

We aimed to pilot a patient-facing digital whiteboard using E-paper to display relevant orienting and clinical information in real time to ED patients. We also sought to assess patients' satisfaction after our intervention and understand our patients' overall perception of the impact of the digital whiteboards on their stay.

METHODS

We deployed a 41-inch E-paper digital whiteboard in 4 rooms in an urban, tertiary care, and academic ED and enrolled 110 patients to understand and evaluate their experience. Participants completed a modified Hospital Consumer Assessment of Health Care Provider and Systems satisfaction questionnaire about their ED stay. We compared responses to a matched control group of patients triaged to ED rooms without digital whiteboards. We designed the digital whiteboard based on iterative feedback from various departmental stakeholders. After establishing IT infrastructure to support the project, we enrolled patients on a convenience basis into a control and an intervention (digital whiteboard) group. Enrollees were given a baseline survey to evaluate their comfort with technology and an exit survey to evaluate their opinions of the digital whiteboard and overall ED satisfaction. Statistical analysis was performed to compare baseline characteristics as well as satisfaction.

RESULTS

After the successful prototyping and implementation of 4 digital whiteboards, we screened 471 patients for inclusion. We enrolled 110 patients, and 50 patients in each group (control and intervention) completed the study protocol. Age, gender, and racial and ethnic composition were similar between groups. We saw significant increases in satisfaction on postvisit surveys when patients were asked about communication regarding delays (P=.03) and what to do after discharge (P=.02). We found that patients in the intervention group were more likely to recommend the facility to family and friends (P=.04). Additionally, 96% (48/50) stated that they preferred a room with a digital whiteboard, and 70% (35/50) found the intervention "quite a bit" or "extremely" helpful in understanding their ED stay.

CONCLUSIONS

Digital whiteboards are a feasible and acceptable method of displaying patient-facing data in the ED. Our pilot suggested that E-paper screens coupled with relevant, real-time clinical data and packaged together as a digital whiteboard may positively impact patient satisfaction and the perception of the facility during ED visits. Further study is needed to fully understand the impact on patient satisfaction and experience.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04497922; https://clinicaltrials.gov/ct2/show/NCT04497922.

General Practitioners' Experiences With Potentials and Pitfalls of Video Consultations in Norway During the COVID-19 Lockdown: Qualitative Analysis of Free-Text Survey Answers

BACKGROUND

The use of video consultations (VCs) in Norwegian general practice rapidly increased during the COVID-19 pandemic. During societal lockdowns, VCs were used for nearly all types of clinical problems, as in-person consultations were kept to a minimum.

OBJECTIVE

This study aimed to explore general practitioners' (GPs') experiences of potentials and pitfalls associated with the use of VCs during the first pandemic lockdown.

METHODS

Between April 14 and May 3, 2020, all regular Norwegian GPs (N=4858) were invited to answer a web-based survey, which included open-ended questions about their experiences with the advantages and pitfalls of VCs. A total of 2558 free-text answers were provided by 657 of the 1237 GPs who participated in the survey. The material was subjected to reflexive thematic analysis.

RESULTS

Four main themes were identified. First, VCs are described as being particularly convenient, informative, and effective for consultations with previously known patients. Second, strategically planned VCs may facilitate effective tailoring of clinical trajectories that optimize clinical workflow. VCs allow for an initial overview of the problem (triage), follow-up evaluation after an in-person consultation, provision of advice and information concerning test results and discharge notes, extension of sick leaves, and delivery of other medical certificates. VCs may, in certain situations, enhance the GPs' insight in their patients' relational and socioeconomical resources and vulnerabilities, and even facilitate relationship-building with patients in need of care who might otherwise be reluctant to seek help. Third, VCs are characterized by a demarcated communication style and the "one problem approach," which may entail effectiveness in the short run. However, the web-based communication climate implies degradation of valuable nonverbal signals that are more evidently present in in-person consultations. Finally, overreliance on VCs may, in a longer perspective, undermine the establishment and maintenance of relational trust, with a negative impact on the quality of care and patient safety. Compensatory mechanisms include clarifying with the patient what the next step is, answering any questions and giving further advice on treatment if conditions do not improve or there is a need for follow-up. Participation of family members can also be helpful to improve reciprocal understanding and safety.

CONCLUSIONS

The findings have relevance for future implementation of VCs and deserve further exploration under less stressful circumstances.

Patient and Provider Recommendations for Improved Telemedicine User Experience in Primary Care: A Multi-Center Qualitative Study

OBJECTIVE

The purpose of this study was to explore telemedicine use and obtain actionable recommendations to improve telemedicine user experience from a diverse group of patients and providers.

METHODS

We interviewed adult patients and primary care providers (PCPs) across three National Patient-Centered Clinical Research Network (PCORnet) sites in New York City, North Carolina, and Florida. Both patients and providers could participate via phone or videoconferencing; patients could complete the interview in English or Spanish. Spanish interviews were conducted by a member of the research team who spoke Spanish fluently. Interviews were audio-recorded, transcribed verbatim, and when necessary, professionally translated.

RESULTS

We interviewed 21 PCPs and 65 patients between March and October 2021. We found that patients' and providers' perspectives on ways to improve the telemedicine experience focused on three recommendation themes: (1) expectations of care provided via telemedicine, (2) innovations to support usability, and (3) alleviation of physician burden. Key recommendations were related to expectations regarding (1) care provided, for example, adding educational content for the patients, and clarity about long-term payment models; (2) support innovation to improve telemedicine usability, for example, providing patients with remote monitoring devices, integrating in-home testing and nursing evaluation; (3) and reduce physician burden, for example, virtual rooming, reimbursement of time spent outside of the telemedicine encounter.

DISCUSSION

Primary care patients and providers see merit in telemedicine. However, both groups recommended novel ways to improve the quality of care and user experience. Findings from this article suggest that policymakers would be best served by addressing current gaps in patient digital literacy by creating technical support strategies, and gaps in telemedicine reimbursement to present an equitable form of payment.

Building a Low-Cost Wireless Biofeedback Solution: Applying Design Science Research Methodology

In recent years, affective computing has emerged as a promising approach to studying user experience, replacing subjective methods that rely on participants' self-evaluation. Affective computing uses biometrics to recognize people's emotional states as they interact with a product. However, the cost of medical-grade biofeedback systems is prohibitive for researchers with limited budgets. An alternative solution is to use consumer-grade devices, which are more affordable. However, these devices require proprietary software to collect data, complicating data processing, synchronization, and integration. Additionally, researchers need multiple computers to control the biofeedback system, increasing equipment costs and complexity. To address these challenges, we developed a low-cost biofeedback platform using inexpensive hardware and open-source libraries. Our software can serve as a system development kit for future studies. We conducted a simple experiment with one participant to validate the platform's effectiveness, using one baseline and two tasks that elicited distinct responses. Our low-cost biofeedback platform provides a reference architecture for researchers with limited budgets who wish to incorporate biometrics into their studies. This platform can be used to develop affective computing models in various domains, including ergonomics, human factors engineering, user experience, human behavioral studies, and human-robot interaction.

Acceptability of a Health Care App With 3 User Interfaces for Older Adults and Their Caregivers: Design and Evaluation Study

BACKGROUND

The older population needs solutions for independent living and reducing the burden on caregivers while maintaining the quality and dignity of life.

OBJECTIVE

The aim of this study was to design, develop, and evaluate an older adult health care app that supports trained caregivers (ie, formal caregivers) and relatives (ie, informal caregivers). We aimed to identify the factors that affect user acceptance of interfaces depending on the user's role.

METHODS

We designed and developed an app with 3 user interfaces that enable remote sensing of an older adult's daily activities and behaviors. We conducted user evaluations (N=25) with older adults and their formal and informal caregivers to obtain an overall impression of the health care monitoring app in terms of user experience and usability. In our design study, the participants had firsthand experience with our app, followed by a questionnaire and individual interview to express their opinions on the app. Through the interview, we also identified their views on each user interface and interaction modality to identify the relationship between the user's role and their acceptance of a particular interface. The questionnaire answers were statistically analyzed, and we coded the interview answers based on keywords related to a participant's experience, for example, ease of use and usefulness.

RESULTS

We obtained overall positive results in the user evaluation of our app regarding key aspects such as efficiency, perspicuity, dependability, stimulation, and novelty, with an average between 1.74 (SD 1.02) and 2.18 (SD 0.93) on a scale of -3.0 to 3.0. The overall impression of our app was favorable, and we identified that "simple" and "intuitive" were the main factors affecting older adults' and caregivers' preference for the user interface and interaction modality. We also identified a positive user acceptance of the use of augmented reality by 91% (10/11) of the older adults to share information with their formal and informal caregivers.

CONCLUSIONS

To address the need for a study to evaluate the user experience and user acceptance by older adults as well as both formal and informal caregivers regarding the user interfaces with multimodal interaction in the context of health monitoring, we designed, developed, and conducted user evaluations with the target user groups. Our results through this design study show important implications for designing future health monitoring apps with multiple interaction modalities and intuitive user interfaces in the older adult health care domain.

Electronic Health Record Use and Perceptions among Urologic Surgeons

OBJECTIVE

Electronic health records (EHRs) have become widely adopted with increasing emphasis on improving care delivery. Improvements in surgery may be limited by specialty-specific issues that impact EHR usability and engagement. Accordingly, we examined EHR use and perceptions in urology, a diverse surgical specialty.

METHODS

We conducted a national, sequential explanatory mixed methods study. Through the 2019 American Urological Association Census, we surveyed urologic surgeons on EHR use and perceptions and then identified associated characteristics through bivariable and multivariable analyses. Using purposeful sampling, we interviewed 25 urologists and applied coding-based thematic analysis, which was then integrated with survey findings.

RESULTS

Among 2,159 practicing urologic surgeons, 2,081 (96.4%) reported using an EHR. In the weighted sample (n = 12,366), over 90% used the EHR for charting, viewing results, and order entry with most using information exchange functions (59.0-79.6%). In contrast, only 35.8% felt the EHR increases clinical efficiency, whereas 43.1% agreed it improves patient care, which related thematically to information management, administrative burden, patient safety, and patient-surgeon interaction. Quantitatively and qualitatively, use and perceptions differed by years in practice and practice type with more use and better perceptions among more recent entrants into the urologic workforce and those in academic/multispecialty practices, who may have earlier EHR exposure, better infrastructure, and more support.

CONCLUSION

Despite wide and substantive usage, EHRs engender mixed feelings, especially among longer-practicing surgeons and those in lower-resourced settings (e.g., smaller and private practices). Beyond reducing administrative burden and simplifying information management, efforts to improve care delivery through the EHR should focus on surgeon engagement, particularly in the community, to boost implementation and user experience.

Exploring Patient Journey Mapping and the Learning Health System: Scoping Review

BACKGROUND

Journey maps are visualization tools that can facilitate the diagrammatical representation of stakeholder groups by interest or function for comparative visual analysis. Therefore, journey maps can illustrate intersections and relationships between organizations and consumers using products or services. We propose that some synergies may exist between journey maps and the concept of a learning health system (LHS). The overarching goal of an LHS is to use health care data to inform clinical practice and improve service delivery processes and patient outcomes.

OBJECTIVE

The purpose of this review was to assess the literature and establish a relationship between journey mapping techniques and LHSs. Specifically, in this study, we explored the current state of the literature to answer the following research questions: (1) Is there a relationship between journey mapping techniques and an LHS in the literature? (2) Is there a way to integrate the data from journey mapping activities into an LHS? (3) How can the data gleaned from journey map activities be used to inform an LHS?

METHODS

A scoping review was conducted by querying the following electronic databases: Cochrane Database of Systematic Reviews (Ovid), IEEE Xplore, PubMed, Web of Science, Academic Search Complete (EBSCOhost), APA PsycInfo (EBSCOhost), CINAHL (EBSCOhost), and MEDLINE (EBSCOhost). Two researchers applied the inclusion criteria and assessed all articles by title and abstract in the first screen, using Covidence. Following this, a full-text review of included articles was done, with relevant data extracted, tabulated, and assessed thematically.

RESULTS

The initial search yielded 694 studies. Of those, 179 duplicates were removed. Following this, 515 articles were assessed during the first screening phase, and 412 were excluded, as they did not meet the inclusion criteria. Next, 103 articles were read in full, and 95 were excluded, resulting in a final sample of 8 articles that satisfied the inclusion criteria. The article sample can be subsumed into 2 overarching themes: (1) the need to evolve service delivery models in health care, and (2) the potential value of using patient journey data in an LHS.

CONCLUSIONS

This scoping review demonstrated the gap in knowledge regarding integrating the data from journey mapping activities into an LHS. Our findings highlighted the importance of using the data from patient experiences to enrich an LHS and provide holistic care. To satisfy this gap, the authors intend to continue this investigation to establish the relationship between journey mapping and the concept of LHSs. This scoping review will serve as phase 1 of an investigative series. Phase 2 will entail the creation of a holistic framework to guide and streamline data integration from journey mapping activities into an LHS. Lastly, phase 3 will provide a proof of concept to demonstrate how patient journey mapping activities could be integrated into an LHS.

Changes in Mobile Health Apps Usage Before and After the COVID-19 Outbreak in China: Semilongitudinal Survey

BACKGROUND

Mobile health (mHealth) apps are rapidly emerging technologies in China due to strictly controlled medical needs during the COVID-19 pandemic while continuing essential services for chronic diseases. However, there have been no large-scale, systematic efforts to evaluate relevant apps.

OBJECTIVE

We aim to provide a landscape of mHealth apps in China by describing and comparing digital health concerns before and after the COVID-19 outbreak, including mHealth app data flow and user experience, and analyze the impact of COVID-19 on mHealth apps.

METHODS

We conducted a semilongitudinal survey of 1593 mHealth apps to study the app data flow and clarify usage changes and influencing factors. We selected mHealth apps in app markets, web pages from the Baidu search engine, the 2018 top 100 hospitals with internet hospitals, and online shopping sites with apps that connect to smart devices. For user experience, we recruited residents from a community in southeastern China from October 2019 to November 2019 (before the outbreak) and from June 2020 to August 2020 (after the outbreak) comparing the attention of the population to apps. We also examined associations between app characteristics, functions, and outcomes at specific quantiles of distribution in download changes using quantile regression models.

RESULTS

Rehabilitation medical support was the top-ranked functionality, with a median 1.44 million downloads per app prepandemic and a median 2.74 million downloads per app postpandemic. Among the top 10 functions postpandemic, 4 were related to maternal and child health: pregnancy preparation (ranked second; fold change 4.13), women's health (ranked fifth; fold change 5.16), pregnancy (ranked sixth; fold change 5.78), and parenting (ranked tenth; fold change 4.03). Quantile regression models showed that rehabilitation (P₇₅, P₉₀), pregnancy preparation (P₉₀), bodybuilding (P₅₀, P₉₀), and vaccination (P₇₅) were positively associated with an increase in downloads after the outbreak. In the user experience survey, the attention given to health information (prepandemic: 249/375, 66.4%; postpandemic: 146/178, 82.0%; P=.006) steadily increased after the outbreak.

CONCLUSIONS

mHealth apps are an effective health care approach gaining in popularity among the Chinese population following the COVID-19 outbreak. This research provides direction for subsequent mHealth app development and promotion in the postepidemic era, supporting medical model reformation in China as a reference, which may provide new avenues for designing and evaluating indirect public health interventions such as health education and health promotion.

A Smartwatch System for Continuous Monitoring of Atrial Fibrillation in Older Adults After Stroke or Transient Ischemic Attack: Application Design Study

BACKGROUND

The prevalence of atrial fibrillation (AF) increases with age and can lead to stroke. Therefore, older adults may benefit the most from AF screening. However, older adult populations tend to lag more than younger groups in the adoption of, and comfort with, the use of mobile health (mHealth) apps. Furthermore, although mobile apps that can detect AF are available to the public, most are designed for intermittent AF detection and for younger users. No app designed for long-term AF monitoring has released detailed system design specifications that can handle large data collections, especially in this age group.

OBJECTIVE

This study aimed to design an innovative smartwatch-based AF monitoring mHealth solution in collaboration with older adult participants and clinicians.

METHODS

The Pulsewatch system is designed to link smartwatches and smartphone apps, a website for data verification, and user data organization on a cloud server. The smartwatch in the Pulsewatch system is designed to continuously monitor the pulse rate with embedded AF detection algorithms, and the smartphone in the Pulsewatch system is designed to serve as the data-transferring hub to the cloud storage server.

RESULTS

We implemented the Pulsewatch system based on the functionality that patients and caregivers recommended. The user interfaces of the smartwatch and smartphone apps were specifically designed for older adults at risk for AF. We improved our Pulsewatch system based on feedback from focus groups consisting of patients with stroke and clinicians. The Pulsewatch system was used by the intervention group for up to 6 weeks in the 2 phases of our randomized clinical trial. At the conclusion of phase 1, 90 trial participants who had used the Pulsewatch app and smartwatch for 14 days completed a System Usability Scale to assess the usability of the Pulsewatch system; of 88 participants, 56 (64%) endorsed that the smartwatch app is "easy to use." For phases 1 and 2 of the study, we collected 9224.4 hours of smartwatch recordings from the participants. The longest recording streak in phase 2 was 21 days of consecutive recordings out of the 30 days of data collection.

CONCLUSIONS

This is one of the first studies to provide a detailed design for a smartphone-smartwatch dyad for ambulatory AF monitoring. In this paper, we report on the system's usability and opportunities to increase the acceptability of mHealth solutions among older patients with cognitive impairment.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03761394; https://www.clinicaltrials.gov/ct2/show/NCT03761394.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1016/j.cvdhj.2021.07.002.

Pactolo Bar: An Approach to Mitigate the Midas Touch Problem in Non-Conventional Interaction

New ways of interacting with computers is driving research, which is motivated mainly by the different types of user profiles. Referred to as non-conventional interactions, these are found with the use of hands, voice, head, mouth, and feet, etc. and these interactions occur in scenarios where the use of mouse and keyboard would be difficult. A constant challenge in the adoption of new forms of interaction, based on the movement of pointers and the selection of interface components, is the Midas Touch (MT) problem, defined as the involuntary action of selection by the user when interacting with the computer system, causing unwanted actions and harming the user experience during the usage process. Thus, this article aims to mitigate the TM problem in interaction with web pages using a solution centered on the Head Tracking (HT) technique. For this purpose, a component in the form of a Bar was developed and inserted on the left side of the web page, called the Pactolo Bar (PB), in order to enable or disable the clicking event during the interaction process. As a way of analyzing the effectiveness of PB in relation to TM, two stages of tests were carried out based on the collaboration of voluntary participants. The first step aims to find the data that would lead to the best configuration of the BP, while the second step aims to carry out a comparative analysis between the PB solution and the eViacam software, whose use is also focused on the HT technique. The results obtained from the use of PB were considered promising, since the analysis of quantitative data points to a significant prevention of involuntary clicks in the iteration interface and the analysis of qualitative data showed the development of a better user experience due to the ease of use, which can be noticed in elements such as the PB size, the triggering mechanism, and its positioning in the graphical interface. This study benefits in the context of the user experience, because, when using non-conventional interactions, basic items such as aspects of the graphic elements, and interaction events raise new studies that seek to mitigate the problem of the Midas Touch.

Coaching Robots for Older Seniors: Do They Get What They Expect? Insights from an Austrian Study

To support the increasing number of older people, new (assistive) technologies are constantly being developed. For these technologies to be used successfully, future users need to be trained. Due to demographic change, this will become difficult in the future, as the resources for training will no longer be available. In this respect, coaching robots could have great potential to support younger seniors in particular. However, there is little evidence in the literature about the perceptions and potential impact of this technology on the well-being of older people. This paper provides insights into the use of a robot coach (robo-coach) to train younger seniors in the use of a new technology. The study was carried out in Austria in autumn 2020, involving 34 participants equally distributed among employees in their last three years of service and retirees in their first three years of retirement (23 female; 11 male). The aim was to assess participants' expectations and perceptions by examining the perceived ease of use and user experience of the robot in providing assistance during a learning session. The findings reveal a positive impression of the participants and promising results for using the robot as a coaching assistant in daily tasks.

Liminal design: A conceptual framework and three-step approach for developing technology that delivers transcendence and deeper experiences

As ubiquitous technology is increasingly mediating our relationships with the world and others, we argue that the sublime is struggling to find room in product design primarily aimed at commercial and transactional goals such as speed and efficiency. We suggest a new category of products to promote deeper and more meaningful experiences, specifically those offering liminality, transcendence, and personal transformation. This paper introduces a conceptual framework and three-step design approach looking at narrative participation in design through abstractions to promote, hold and deepen more complex emotions. We explore implications from a theoretical point of view and suggest product examples for how the model might be applied in practice.

Affective Out-World Experience via Virtual Reality for Older Adults Living with Mild Cognitive Impairments or Mild Dementia

Older adults with cognitive impairments may face barriers to accessing experiences beyond their physical premises. Previous research has suggested that missing out on emotional experiences may affect mental health and impact cognitive abilities. In recent years, there has been growing research interest in designing non-pharmacological interventions to improve the health-related quality of life of older adults. With virtual reality offering endless opportunities for health support, we must consider how virtual reality can be sensitively designed to provide comfortable, enriching out-world experiences to older adults to enhance their emotional regulation. Thirty older adults living with mild cognitive impairment or mild dementia participated in the study. Affect and emotional behavior were measured. The usability and the sense of presence were also assessed. Finally, we assessed the virtual reality experiences based on physiological responses and eye-tracking data. The results indicated that virtual reality can positively enhance the mental health of this population by eliciting a positive affective state and enhancing their emotional regulation. Overall, this paper raises awareness of the role of virtual reality in emotion elicitation, regulation, and expression and enhances our understanding of the use of virtual reality by older adults living with mild cognitive impairments or mild dementia.

Determinants of intention with remote health management service among urban older adults: A Unified Theory of Acceptance and Use of Technology perspective

Background

Although older adults health management systems have been shown to have a significant impact on health levels, there remains the problem of low use rate, frequency of use, and acceptance by the older adults. This study aims to explore the significant factors which serve as determinants of behavioral intention to use the technology, which in turn promotes actual use.

Methods

This study took a total of 402 urban older adults over 60 years to explore the impact of the use behavior toward remote health management (RHM) through an online questionnaire. Based on the Unified Theory of Acceptance and Use of Technology (UTAUT), the author adds four dimensions: perceived risk, perceived value, perceived interactivity and individual innovation, constructed an extended structural equation model of acceptance and use of technology, and analyzed the variable path relationship.

Results

In this study, the factor loading is between 0.61 and 0.98; the overall Cronbach's Alpha coefficients are >0.7; The composite reliability ranges from 0.59 to 0.91; the average variance extraction ranges from 0.51 to 0.85, which shows the good reliability, validity, and discriminant validity of the constructed model. The influencing factors of the behavioral intention of the older adults to accept the health management system are: effort expectation, social influences, perceived value, performance expectation, perceived interactivity and perceived risk. Effort expectation has a significant positive impact on performance expectation. Individual innovation positively impacts performance expectation and perceived interactivity. Perceived interactivity and behavioral intention have a significant positive effect on the use behavior of the older adults, while the facilitating conditions have little effect on the use behavior.

Conclusions

This paper constructs and verifies the extended model based on UTAUT, fully explores the potential factors affecting the use intention of the older adult users. According to the research findings, some suggestions are proposed from the aspects of effort expectation, performance expectation, perceived interaction and perceived value to improve the use intention and user experience of Internet-based health management services in older adults.

COVID-19 Vaccine Equity and Access: Case Study for Health Care Chatbots

BACKGROUND

Disparities in COVID-19 information and vaccine access have emerged during the pandemic. Individuals from historically excluded communities (eg, Black and Latin American) experience disproportionately negative health outcomes related to COVID-19. Community gaps in COVID-19 education, social, and health care services (including vaccines) should be prioritized as a critical effort to end the pandemic. Misinformation created by the politicization of COVID-19 and related public health measures has magnified the pandemic's challenges, including access to health care, vaccination and testing efforts, as well as personal protective equipment. Information and Communication Technology (ICT) has been demonstrated to reduce the gaps of marginalization in education and access among communities. Chatbots are an increasingly present example of ICTs, particularly in health care and in relation to the COVID-19 pandemic.

OBJECTIVE

This project aimed to (1) follow an inclusive and theoretically driven design process to develop and test a COVID-19 information ICT bilingual (English and Spanish) chatbot tool named "Ana" and (2) characterize and evaluate user experiences of these innovative technologies.

METHODS

Ana was developed following a multitheoretical framework, and the project team was comprised of public health experts, behavioral scientists, community members, and medical team. A total of 7 iterations of ß chatbots were tested, and a total of 22 ß testers participated in this process. Content was curated primarily to provide users with factual answers to common questions about COVID-19. To ensure relevance of the content, topics were driven by community concerns and questions, as ascertained through research. Ana's repository of educational content was based on national and international organizations as well as interdisciplinary experts. In the context of this development and pilot project, we identified an evaluation framework to explore reach, engagement, and satisfaction.

RESULTS

A total of 626 community members used Ana from August 2021 to March 2022. Among those participants, 346 used the English version, with an average of 43 users per month; and 280 participants used the Spanish version, with an average of 40 users monthly. Across all users, 63.87% (n=221) of English users and 22.14% (n=62) of Spanish users returned to use Ana at least once; 18.49% (n=64) among the English version users and 18.57% (n=52) among the Spanish version users reported their ranking. Positive ranking comprised the "smiley" and "loved" emojis, and negative ranking comprised the "neutral," "sad," and "mad" emojis. When comparing negative and positive experiences, the latter was higher across Ana's platforms (English: n=41, 64.06%; Spanish: n=41, 77.35%) versus the former (English: n=23, 35.93%; Spanish: n=12, 22.64%).

CONCLUSIONS

This pilot project demonstrated the feasibility and capacity of an innovative ICT to share COVID-19 information within diverse communities. Creating a chatbot like Ana with bilingual content contributed to an equitable approach to address the lack of accessible COVID-19-related information.

Game based assessments of cognitive ability in recruitment: Validity, fairness and test-taking experience

Gamification and machine learning are emergent technologies in recruitment, promising to improve the user experience and fairness of assessments. We test this by validating a game based assessment of cognitive ability with a machine learning based scoring algorithm optimised for validity and fairness. We use applied data from 11,574 assessment completions. The assessment has convergent validity (r = 0.5) and test-retest reliability (r = 0.68). It maintains fairness in a separate sample of 3,107 job applicants, showing that fairness-optimised machine learning can improve outcome parity issues with cognitive ability tests in recruitment settings. We show that there are no significant gender differences in test taking anxiety resulting from the games, and that anxiety does not directly predict game performance, supporting the notion that game based assessments help with test taking anxiety. Interactions between anxiety, gender and performance are explored. Feedback from 4,778 job applicants reveals a Net Promoter score of 58, indicating more applicants support than dislike the assessment, and that games deliver a positive applicant experience in practise. Satisfaction with the format is high, but applicants raise face validity concerns over the abstract games. We encourage the use of gamification and machine learning to improve the fairness and user experience of psychometric tests.