Usability Testing of a Patient-Centered Mobile Health App for Supporting and Guiding the Pediatric Emergency Department Patient Journey: Mixed Methods Study

Exploring patient-centered design solutions of a telehealth app for HIV - A qualitative study

BACKGROUND

The Communication and Tracing App HIV (COMTRAC-HIV) project is developing a mobile health (mHealth) app for integrated care of HIV patients in Germany. The complexity of HIV treatment and continuous care necessitates the need for tailored mHealth solutions. This qualitative study explores design solutions and a prototype to enhance the app's functionality and effectiveness.

METHODS

A total of eight HIV patients and pre-exposure prophylaxis (PrEP) users, recruited at the HIV Center Frankfurt, participated in focus groups and thinking-aloud tests (TA test). In the focus groups, design solutions were discussed for user-interface clarity, leading to the development of an interactive prototype, the usability of which was evaluated with a TA test. Data collection involved video/audio recordings. Qualitative analysis was conducted using a deductive category system, and focused on app design and usage in focus groups, and layout, navigation, interaction, terminology, comprehension, feedback, and level of satisfaction in TA tests.

RESULTS

The app was commended for its simple, clear design, especially its medication reminders and health tracking features. Opinions on the symptom diary varied however, respondents noting it more suitable for HIV users than PrEP users. Privacy concerns suggest avoiding display of HIV-specific information. Suggested improvements include e.g. image uploads, drug interaction checks and prescription tracking. A total of 25 usability issues were identified in the TA test, with most found in the layout (n = 6), navigation (n = 5), interaction (n = 5), and terminology (n = 5) categories. Two examples are non-intuitive controls and illogical button placement. Despite these disadvantages, participants noted positive impressions (n = 5) in the satisfaction category.

CONCLUSION

The study emphasizes the need for patient-centered design in mobile HIV care solutions, highlighting to the app's user-friendliness and potential to enhance care. Further research is necessary to refine the app's functionality and to align it with clinical and patients' privacy needs.

Methods, Indicators, and End-User Involvement in the Evaluation of Digital Health Interventions for the Public: Scoping Review

BACKGROUND

Digital health interventions (DHIs) have the potential to enable public end users, such as citizens and patients, to manage and improve their health. Although the number of available DHIs is increasing, examples of successfully established DHIs in public health systems are limited. To counteract the nonuse of DHIs, they should be comprehensively evaluated while integrating end users. Unfortunately, there is a wide variability and heterogeneity according to the approaches of evaluation, which creates a methodological challenge.

OBJECTIVE

This scoping review aims to provide an overview of the current established processes for evaluating DHIs, including methods, indicators, and end-user involvement. The review is not limited to a specific medical field or type of DHI but offers a holistic overview.

METHODS

This scoping review was conducted following the JBI methodology for scoping reviews based on the framework by Arksey & O'Malley and complies with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. Three scientific databases (PubMed, Scopus, and Science Direct) were searched in April 2023. English and German studies between 2008 and 2023 were considered when evaluating DHIs that explicitly address public end users. The process of study selection was carried out by several researchers to avoid reviewer bias.

RESULTS

The search strategy identified 9618 publications, of which 160 were included. Among these included articles, 200 evaluations were derived and analyzed. The results showed that there is neither a consensus on the methods to evaluate DHIs nor a commonly agreed definition or usage of the evaluated indicators, which results in a broad variety of evaluation practices. This aligns with observations of the existing literature. It was found that there is a lack of references to existing frameworks for the evaluation of DHIs. The majority of the included studies referred to user-centered approaches and involved end users in the evaluation process. As assistance for people developing and evaluating DHIs and as a basis for thinking about appropriate ways to evaluate DHIs, a results matrix was created where the findings were combined per DHI cluster. Additionally, general recommendations for the evaluators of DHIs were formulated.

CONCLUSIONS

The findings of this scoping review offer a holistic overview of the variety and heterogeneity according to the approaches of evaluation of DHIs for public end users. Evaluators of these DHIs should be encouraged to reference established frameworks or measurements for justification. This would ease the transferability of the results among similar evaluation studies within the digital health sector, thereby enhancing the coherence and comparability of research in this area.

Usability and Evaluation of a Health Information System in the Emergency Department: Mixed Methods Study

BACKGROUND

A lack of information during an emergency visit leads to the experience of powerlessness for patients and their family members, who may also feel unprepared to cope with acute symptoms. The ever-changing nature and fast-paced workflow in the emergency department (ED) often affect how health care professionals can tailor information and communication to the needs of the patient.

OBJECTIVE

This study aimed to evaluate the usability and experience of a newly developed information system. The system was developed together with patients and their family members to help provide the information needed in the ED.

METHODS

We conducted a mixed methods study consisting of quantitative data obtained from the System Usability Scale questionnaire and qualitative interview data obtained from purposively selected participants included in the quantitative part of the study.

RESULTS

A total of 106 patients and 14 family members (N=120) answered the questionnaire. A total of 10 patients and 3 family members participated in the interviews. Based on the System Usability Scale score, the information system was rated close to excellent, with a mean score of 83.6 (SD 12.8). Most of the participants found the information system easy to use and would like to use it again. The participants reported that the system helped them feel in control, and the information was useful. Simplifications were needed to improve the user experience for the older individuals.

CONCLUSIONS

This study demonstrates that the usability of the information system is rated close to excellent. It was perceived to be useful as it enabled understanding and predictability of the patient's trajectory in the ED. Areas for improvement include making the system more usable by older individuals. The study provides an example of how a technological solution can be used to diminish the information gap in an ED context.

Characteristics and Admission Preferences of Pediatric Emergency Patients and Their Waiting Time Prediction Using Electronic Medical Record Data: Retrospective Comparative Analysis

BACKGROUND

The growing number of patients visiting pediatric emergency departments could have a detrimental impact on the care provided to children who are triaged as needing urgent attention. Therefore, it has become essential to continuously monitor and analyze the admissions and waiting times of pediatric emergency patients. Despite the significant challenge posed by the shortage of pediatric medical resources in China's health care system, there have been few large-scale studies conducted to analyze visits to the pediatric emergency room.

OBJECTIVE

This study seeks to examine the characteristics and admission patterns of patients in the pediatric emergency department using electronic medical record (EMR) data. Additionally, it aims to develop and assess machine learning models for predicting waiting times for pediatric emergency department visits.

METHODS

This retrospective analysis involved patients who were admitted to the emergency department of Children's Hospital Capital Institute of Pediatrics from January 1, 2021, to December 31, 2021. Clinical data from these admissions were extracted from the electronic medical records, encompassing various variables of interest such as patient demographics, clinical diagnoses, and time stamps of clinical visits. These indicators were collected and compared. Furthermore, we developed and evaluated several computational models for predicting waiting times.

RESULTS

In total, 183,024 eligible admissions from 127,368 pediatric patients were included. During the 12-month study period, pediatric emergency department visits were most frequent among children aged less than 5 years, accounting for 71.26% (130,423/183,024) of the total visits. Additionally, there was a higher proportion of male patients (104,147/183,024, 56.90%) compared with female patients (78,877/183,024, 43.10%). Fever (50,715/183,024, 27.71%), respiratory infection (43,269/183,024, 23.64%), celialgia (9560/183,024, 5.22%), and emesis (6898/183,024, 3.77%) were the leading causes of pediatric emergency room visits. The average daily number of admissions was 501.44, and 18.76% (34,339/183,204) of pediatric emergency department visits resulted in discharge without a prescription or further tests. The median waiting time from registration to seeing a doctor was 27.53 minutes. Prolonged waiting times were observed from April to July, coinciding with an increased number of arrivals, primarily for respiratory diseases. In terms of waiting time prediction, machine learning models, specifically random forest, LightGBM, and XGBoost, outperformed regression methods. On average, these models reduced the root-mean-square error by approximately 17.73% (8.951/50.481) and increased the R2 by approximately 29.33% (0.154/0.525). The SHAP method analysis highlighted that the features "wait.green" and "department" had the most significant influence on waiting times.

CONCLUSIONS

This study offers a contemporary exploration of pediatric emergency room visits, revealing significant variations in admission rates across different periods and uncovering certain admission patterns. The machine learning models, particularly ensemble methods, delivered more dependable waiting time predictions. Patient volume awaiting consultation or treatment and the triage status emerged as crucial factors contributing to prolonged waiting times. Therefore, strategies such as patient diversion to alleviate congestion in emergency departments and optimizing triage systems to reduce average waiting times remain effective approaches to enhance the quality of pediatric health care services in China.

Digital Marketing: A Unique Multidisciplinary Approach towards the Elimination of Viral Hepatitis

New technologies are supported by the global implementation of the internet. These improvements have deeply affected various disciplines of sciences and consequently changed services such as daily business, particularly health sectors. Innovative digital marketing strategies utilize the channels of social media and retrieved user data to analyze and improve relevant services. These multidisciplinary innovations can assist specialists, physicians and researchers in diagnostic, prophylaxis and treatment issues in the health sector. Accordingly, compared to recent decades, health decision makers are more accurate and trustful in defining new strategies. Interestingly, using social media and mobile health apps in current pandemics of SARS-CoV-2 could be an important instance of the key role of these platforms at the local and global level of health policies. These digital technologies provide platforms to connect public health sectors and health politicians for communicating and spreading relevant information. Adding influencers and campaigns to this toolbox strengthens the implementation of public health programs. In 2016, the WHO adopted a global program to eliminate viral hepatitis by 2030. Recent constructive measures that have been used in the battle against COVID-19 could be adopted for the elimination of viral hepatitis program. The presented evidence in our narrative review demonstrates that the application of digital marketing tools to create campaigns on social media, armed with professional influencers, can efficiently consolidate this program. The application of different strategies in using these popular tools will raise the public awareness about viral hepatitis. Subsequently, the availability of an effective vaccine for HBV and antiviral medication for HCV can motivate the audience to take steps towards prophylaxis and screening methods against these infectious illnesses. The encouragement of health policy makers to apply digital communication technologies and comprehensive roadmaps to implement this global program will certainly decrease the burden of viral hepatitis worldwide.