Health workers' perspectives of a mobile health tool to improve diagnosis and management of paediatric acute respiratory illnesses in Uganda: a qualitative study

Acceptability of artificial intelligence for cervical cancer screening in Dschang, Cameroon: a qualitative study on patient perspectives

BACKGROUND

Cervical cancer is the fourth most frequent cancer among women, with 90% of cervical cancer-related deaths occurring in low- and middle-income countries like Cameroon. Visual inspection with acetic acid is often used in low-resource settings to screen for cervical cancer; however, its accuracy can be limited. To address this issue, the Swiss Federal Institute of Technology Lausanne and the University Hospitals of Geneva are collaborating to develop an automated smartphone-based image classifier that serves as a computer aided diagnosis tool for cancerous lesions. The primary objective of this study is to explore the acceptability and perspectives of women in Dschang regarding the usage of a screening tool for cervical cancer relying on artificial intelligence. A secondary objective is to understand the preferred form and type of information women would like to receive regarding this artificial intelligence-based screening tool.

METHODS

A qualitative methodology was employed to gain better insight into the women's perspectives. Participants, aged between 30 and 49 were invited from both rural and urban regions and semi-structured interviews using a pre-tested interview guide were conducted. The focus groups were divided on the basis of level of education, as well as HPV status. The interviews were audio-recorded, transcribed, and coded using the ATLAS.ti software.

RESULTS

A total of 32 participants took part in the six focus groups, and 38% of participants had a primary level of education. The perspectives identified were classified using an adapted version of the Technology Acceptance Model. Key factors influencing the acceptability of artificial intelligence include privacy concerns, perceived usefulness, and trust in the competence of providers, accuracy of the tool as well as the potential negative impact of smartphones.

CONCLUSION

The results suggest that an artificial intelligence-based screening tool for cervical cancer is mostly acceptable to the women in Dschang. By ensuring patient confidentiality and by providing clear explanations, acceptance can be fostered in the community and uptake of cervical cancer screening can be improved.

TRIAL REGISTRATION

Ethical Cantonal Board of Geneva, Switzerland (CCER, N°2017-0110 and CER-amendment n°4) and Cameroonian National Ethics Committee for Human Health Research (N°2022/12/1518/CE/CNERSH/SP). NCT: 03757299.

Neonatal jaundice detection in low-resource Mexican settings: possibilities and barriers for innovation with mobile health

BACKGROUND

Neonatal jaundice is a common condition that can lead to brain damage and disabilities when severe cases go undetected. Low- and middle-income countries often lack accurate methods for detecting neonatal jaundice and rely on visual assessment, resulting in a higher incidence of adverse consequences. Picterus Jaundice Pro (Picterus JP), an easy-to-use and affordable smartphone-based screening device for the condition, has demonstrated higher accuracy than visual assessment in Norwegian, Philippine and Mexican newborns. This study aimed to identify the barriers and facilitators to implementing Picterus JP in public health services in low-income settings in Mexico by exploring the current process of neonatal jaundice detection and stakeholders' perspectives in that context.

METHODS

Qualitative data collection techniques, including one focus group, 15 semi-structured interviews and four observations, were employed in urban and rural health facilities in Oaxaca, Mexico. The participants included medical doctors, nurses and health administrators. The data were analysed by thematic analysis guided by the Consolidated Framework for Implementation Research.

RESULTS

The analysis yielded four main themes: (I) the current state of neonatal care and NNJ detection, (II) the needs and desires for enhancing NNJ detection, (III) the barriers and facilitators to implementing Picterus JP in the health system and (IV) HCWs' expectations of Picterus JP. The findings identify deficiencies in the current neonatal jaundice detection process and the participants' desire for a more accurate method. Picterus JP was perceived as easy to use, useful and compatible with the work routine, but barriers to adoption were identified, including internet deficiencies and costs.

CONCLUSIONS

The introduction of Picterus JP as a supporting tool to screen for neonatal jaundice is promising but contextual barriers in the setting must be addressed for successful implementation. There is also an opportunity to optimise visual assessment to improve detection of neonatal jaundice.

Methods used to evaluate usability of mobile clinical decision support systems for healthcare emergencies: a systematic review and qualitative synthesis

Objective

The aim of this study was to determine the methods and metrics used to evaluate the usability of mobile application Clinical Decision Support Systems (CDSSs) used in healthcare emergencies. Secondary aims were to describe the characteristics and usability of evaluated CDSSs.

Materials and Methods

A systematic literature review was conducted using Pubmed/Medline, Embase, Scopus, and IEEE Xplore databases. Quantitative data were descriptively analyzed, and qualitative data were described and synthesized using inductive thematic analysis.

Results

Twenty-three studies were included in the analysis. The usability metrics most frequently evaluated were efficiency and usefulness, followed by user errors, satisfaction, learnability, effectiveness, and memorability. Methods used to assess usability included questionnaires in 20 (87%) studies, user trials in 17 (74%), interviews in 6 (26%), and heuristic evaluations in 3 (13%). Most CDSS inputs consisted of manual input (18, 78%) rather than automatic input (2, 9%). Most CDSS outputs comprised a recommendation (18, 78%), with a minority advising a specific treatment (6, 26%), or a score, risk level or likelihood of diagnosis (6, 26%). Interviews and heuristic evaluations identified more usability-related barriers and facilitators to adoption than did questionnaires and user testing studies.

Discussion

A wide range of metrics and methods are used to evaluate the usability of mobile CDSS in medical emergencies. Input of information into CDSS was predominantly manual, impeding usability. Studies employing both qualitative and quantitative methods to evaluate usability yielded more thorough results.

Conclusion

When planning CDSS projects, developers should consider multiple methods to comprehensively evaluate usability.

Evaluating the Usefulness and Ease of Use of a Next-Generation-Connected Drug Delivery Device for Growth Hormone Therapy: Qualitative Study of Health Care Professionals' Perceptions

BACKGROUND

Digital solutions targeting children's health have become an increasingly important element in the provision of integrated health care. For the treatment of growth hormone deficiency (GHD), a unique connected device is available to facilitate the delivery of recombinant human growth hormone (r-hGH) by automating the daily injection process and collecting injection data such that accurate adherence information is available to health care professionals (HCPs), caregivers, and patients. The adoption of such digital solutions requires a good understanding of the perspectives of HCPs as key stakeholders because they leverage data collection and prescribe these solutions to their patients.

OBJECTIVE

This study aimed to evaluate the third generation of the easypod device (EP3) for the delivery of r-hGH treatment from the HCP perspective, with a focus on perceived usefulness and ease of use.

METHODS

A qualitative study was conducted, based on a participatory workshop conducted in Zaragoza, Spain, with 10 HCPs experienced in the management of pediatric GHD from 7 reference hospitals in Spain. Several activities were designed to promote discussion among participants about predefined topics based on the Technology Acceptance Model and the Unified Theory of Acceptance and Use of Technology to provide their perceptions about the new device.

RESULTS

Participants reported 2 key advantages of EP3 over previous easypod generations: the touch screen interface and the real-time data transmission functionality. All participants (10/10, 100%) agreed that the new device should be part of a digital health ecosystem that provides complementary functionalities including data analysis.

CONCLUSIONS

This study explored the perceived value of the EP3 autoinjector device for the treatment of GHD by HCPs. HCPs rated the new capabilities of the device as having substantial improvements and concluded that it was highly recommendable for clinical practice. EP3 will enhance decision-making and allow for more personalized care of patients receiving r-hGH.

Scoping review of health information technology usability methods leveraged in Africa

OBJECTIVE

The aim of this study was to explore the state of health information technology (HIT) usability evaluation in Africa.

MATERIALS AND METHODS

We searched three electronic databases: PubMed, Embase, and Association for Computing Machinery. We categorized the stage of evaluations, the type of interactions assessed, and methods applied using Stead's System Development Life Cycle (SDLC) and Bennett and Shackel's usability models.

RESULTS

Analysis of 73 of 1002 articles that met inclusion criteria reveals that HIT usability evaluations in Africa have increased in recent years and mainly focused on later SDLC stage (stages 4 and 5) evaluations in sub-Saharan Africa. Forty percent of the articles examined system-user-task-environment (type 4) interactions. Most articles used mixed methods to measure usability. Interviews and surveys were often used at each development stage, while other methods, such as quality-adjusted life year analysis, were only found at stage 5. Sixty percent of articles did not include a theoretical model or framework.

DISCUSSION

The use of multistage evaluation and mixed methods approaches to obtain a comprehensive understanding HIT usability is critical to ensure that HIT meets user needs.

CONCLUSIONS

Developing and enhancing usable HIT is critical to promoting equitable health service delivery and high-quality care in Africa. Early-stage evaluations (stages 1 and 2) and interactions (types 0 and 1) should receive special attention to ensure HIT usability prior to implementing HIT in the field.

Performance and usability of a new mobile application for measuring respiratory rate in young children with acute lower respiratory infections

OBJECTIVES

Respiratory rate (RR) measurement is critical to diagnosing pneumonia in resource-constrained settings, but accurate RR measurement is challenging. The acute lower respiratory illness treatment and evaluation (ALRITE) mobile phone application (app), designed to help healthcare workers (HCWs) manage pediatric respiratory illnesses, includes a semiautomated RR counter. This study aimed to evaluate the accuracy and usability of the ALRITE RR counter and a commercially available RR counter app, RRate, with a reference standard.

METHODS

This was a cross-sectional observational study of HCWs. Participants used both apps to measure the RR of pediatric patients from standardized videos. The reference standard was determined by consensus of a manual 1-min count by two providers. We assessed agreement using Spearman's rank correlation coefficient and constructed Bland-Altman plots to determine bias and limits of agreement. Participants completed a usability survey.

RESULTS

Thirty-nine HCWs participated. The agreement between the apps and reference standard (Spearman's coefficient) was 0.83 (95% confidence interval [CI]: 0.78-0.87) for ALRITE and 0.62 (95% CI: 0.52-0.70) for RRate. ALRITE had a bias of -2 breaths/min (lower limit of agreement [LoA] -16 to +12) and RRate had a bias of -0.4 breaths/min (LoA -24 to +23) compared to the reference standard. Both apps had a poorer agreement at higher RRs. Based on usability survey responses, 95% found ALRITE easy to use.

CONCLUSIONS

The ALRITE RR counter has acceptable accuracy for counting RR in infants with respiratory distress, appears to be more accurate than a commercially available option, and was user-friendly. The ALRITE RR counter is a promising tool for meriting evaluation in real-world settings.

Digital Solutions for Community and Primary Health Workers: Lessons From Implementations in Africa

The agenda for Universal Health Coverage has driven the exploration of various innovative approaches to expanding health services to the general population. As more African countries have adopted digital health tools as part of the strategic approach to expanding health services, there is a need for defining a standard framework for implementation across board. Therefore, there is a need to review and employ an evidence-based approach to inform managing challenges, adopting best approaches, and implement informed recommendations. We reviewed a variety of digital health tools applied to different health conditions in primary care settings and highlighted the challenges faced, approaches that worked and relevant recommendations. These include limited coverage and network connectivity, lack of technological competence, lack of power supply, limited mobile phone usage and application design challenges. Despite these challenges, this review suggests that mHealth solutions could attain effective usage when healthcare workers receive adequate onsite training, deploying applications designed in an intuitive and easy to understand approach in a manner that fits into the users existing workflows, and involvement of the stakeholders at all levels in the design, planning, and implementation stages of the interventions.

Digital auscultation as a novel childhood pneumonia diagnostic tool for community clinics in Sylhet, Bangladesh: protocol for a cross-sectional study

INTRODUCTION

The WHO's Integrated Management of Childhood Illnesses (IMCI) algorithm for diagnosis of child pneumonia relies on counting respiratory rate and observing respiratory distress to diagnose childhood pneumonia. IMCI case defination for pneumonia performs with high sensitivity but low specificity, leading to overdiagnosis of child pneumonia and unnecessary antibiotic use. Including lung auscultation in IMCI could improve specificity of pneumonia diagnosis. Our objectives are: (1) assess lung sound recording quality by primary healthcare workers (HCWs) from under-5 children with the Feelix Smart Stethoscope and (2) determine the reliability and performance of recorded lung sound interpretations by an automated algorithm compared with reference paediatrician interpretations.

METHODS AND ANALYSIS

In a cross-sectional design, community HCWs will record lung sounds of ~1000 under-5-year-old children with suspected pneumonia at first-level facilities in Zakiganj subdistrict, Sylhet, Bangladesh. Enrolled children will be evaluated for pneumonia, including oxygen saturation, and have their lung sounds recorded by the Feelix Smart stethoscope at four sequential chest locations: two back and two front positions. A novel sound-filtering algorithm will be applied to recordings to address ambient noise and optimise recording quality. Recorded sounds will be assessed against a predefined quality threshold. A trained paediatric listening panel will classify recordings into one of the following categories: normal, crackles, wheeze, crackles and wheeze or uninterpretable. All sound files will be classified into the same categories by the automated algorithm and compared with panel classifications. Sensitivity, specificity and predictive values, of the automated algorithm will be assessed considering the panel's final interpretation as gold standard.

ETHICS AND DISSEMINATION

The study protocol was approved by the National Research Ethics Committee of Bangladesh Medical Research Council, Bangladesh (registration number: 09630012018) and Academic and Clinical Central Office for Research and Development Medical Research Ethics Committee, Edinburgh, UK (REC Reference: 18-HV-051). Dissemination will be through conference presentations, peer-reviewed journals and stakeholder engagement meetings in Bangladesh.

TRIAL REGISTRATION NUMBER

NCT03959956.