Applying human-centered design to maximize acceptability, feasibility, and usability of mobile technology supervision in Kenya: a mixed methods pilot study protocol

Integrating a mental health intervention into PrEP services for South African young women: a human-centred implementation research approach to intervention development

INTRODUCTION

Adolescent girls and young women (AGYW) who may benefit from HIV pre-exposure prophylaxis (PrEP) face high levels of common mental disorders (e.g. depression, anxiety). Common mental disorders can reduce PrEP adherence and increase HIV risk, yet mental health interventions have not been well-integrated into PrEP delivery.

METHODS

We conducted a four-phase human-centred design process, from December 2020 to April 2022, to understand mental health challenges among AGYW in Johannesburg, South Africa and barriers to integrated mental health and PrEP services. In the "Discover" phase, we conducted in-depth interviews with AGYW and key informants (KIs) in Johannesburg. We conducted a rapid qualitative analysis, informed by the Consolidated Framework for Implementation Research (CFIR), to identify facilitators and barriers of integrated mental health and PrEP services and mapped barriers to potential implementation strategies. In the "Design" and "Build" phases, we conducted stakeholder workshops to iteratively adapt an evidence-based mental health intervention, the Friendship Bench, and refine implementation strategies for South African PrEP delivery settings. In the "Test" phase, we piloted our adapted Friendship Bench package.

RESULTS

Interviews with 70 Discover phase participants (48 AGYW, 22 KIs) revealed the importance of integrated mental health and PrEP services for South African AGYW. Interviewees described barriers and implementation strategies for mental health and PrEP services around the CFIR domains: intervention characteristics (e.g. challenges with AGYW "opening up"); outer Johannesburg setting (e.g. community stigma); inner clinic setting (e.g. judgemental healthcare providers); characteristics of counsellors (e.g. training gaps); and the implementation process (e.g. need for demand creation). The Design and Build workshops included 13 AGYW and 15 KIs. Implementation barriers related to the quality and accessibility of public-sector clinic services, lay counsellor training, and community education and demand creation activities were prioritized. This led to 12 key Friendship Bench adaptations and the specification of 10 implementation strategies that were acceptable and feasible in initial pilot testing with three AGYW.

CONCLUSIONS

Using a human-centred approach, we identified determinants and potential solutions for integrating mental health interventions within PrEP services for South African AGYW. This design process centred stakeholders' perspectives, enabling rapid development of an adapted Friendship Bench intervention implementation package.

"A problem shared is a problem solved:" integrating human-centered design and implementation science to optimize lay counselor supervision in Western Kenya

Implementation science and human-centered design (HCD) offer useful frameworks and methods for considering and designing for individuals' needs and preferences when implementing new interventions or technologies in global health. When used in tandem, the two approaches may blend creative and partnered research methods with a focus on the factors necessary to design, implement, and sustain interventions. However, research is needed that describes the process of blending these two approaches and explores the experiences of community partners. This study builds from a stepped-wedge cluster-randomized trial in Western Kenya, wherein teachers and community health volunteers have been trained to provide trauma-focused cognitive behavioral therapy (TF-CBT). Mobile phones emerged as a tool to supervise lay counselors from afar; however, their use was characterized by unique challenges. Informed by human-centered design and implementation science, we first engaged lay counselors (n = 24) and supervisors (n = 3) in individual semi-structured interviews then hosted an in-person participatory workshop to "co-design" solutions to optimize the use of mobile phone supervision. Lay counselors participated in focus group discussions regarding their experiences in the workshop. Focus group transcripts were analyzed using thematic analysis. We describe our approach as well as focus group discussion results. Counselors felt the workshop was a valuable experience to learn new strategies from their colleagues, and they enjoyed the "collaborative spirit" that emerged as they worked together. Counselors felt that varying small and large group discussions fostered participation by creating opportunities for more people to engage and share their thoughts. Counselors suggested the approach be improved by providing more tangible materials (e.g., hand-outs) and more closely following a schedule of activities. It is important to also center stakeholders' experiences as partners in the research process. Though counselors largely expressed positive sentiments, they also shared valuable suggestions for how to improve participatory research practices in the future.

Designing a Smartphone-Based Pulse Oximeter for Children in South Africa (Phefumla Project): Qualitative Analysis of Human-Centered Design Workshops With Health Care Workers

Background

Pulse oximeters noninvasively measure blood oxygen levels, but these devices have rarely been designed for low-resource settings and are inconsistently available at outpatient clinics.

Objective

The Phefumla project aims to develop and validate a pediatric smartphone-based pulse oximeter designed specifically for this context. We present the process of human-centered oximeter design with health care workers in South Africa.

Methods

We purposively sampled 19 health care workers from 5 clinics in Khayelitsha, Cape Town. Using a human-centered design approach, we conducted participatory workshops with four activities with health care workers: (1) they received 3D-printed prototypes of potential oximeter designs to provide feedback; (2) we demonstrated on dolls how they would use the novel oximeter; (3) they used pile sorting to rank design features and suggest additional features they desired; and (4) they designed their preferred user interface using a whiteboard, marker, and magnetized features that could be repositioned. We audio recorded the workshops, photographed outputs, and took detailed field notes. Analysis involved iterative review of these data to describe preferences, identify key design updates, and provide modifications.

Results

Participants expressed a positive sentiment toward the idea of a smartphone pulse oximeter and suggested that a pediatric device would address an important gap in outpatient care. Specifically, participants expressed a preference for the prototype that they felt enabled more diversity in the way it could be used. There was a strong tendency to prioritize pragmatic design features, such as robustness, which was largely dictated by health care worker context. They also added features that would allow the oximeter device to serve other clinical functions in addition to oxygen saturation measurement, such as temperature and respiratory rate measurements.

Conclusions

Our end user-centered rapid participatory approach led to tangible design changes and prompted design discussions that the team had not previously considered. Overall, health care workers prioritized pragmatism for pediatric pulse oximeter device design.

Feasibility, usability, and acceptability of psychoeducational videoconferencing interventions for informal caregivers: A systematic review of randomized controlled trials

Psychoeducational videoconferencing interventions bypass traditional in-person barriers to attendance and are effective in improving caregiving skills, self-care, and wellness among informal caregivers. Information on their feasibility, usability, and acceptability from the caregivers' perspective is needed to inform future designs and developments. This systematic review follows PRISMA 2020 guidelines to integrate this information. Five databases were systematically searched for relevant randomized control trials published between January 2012 and December 2022. Reference lists were cross-checked for additional studies. Relevant studies were appraised and had their data extracted. This review contains 14 randomized controlled trials. Retention rates ranged from 55.56% to 100%, and major reasons for withdrawing include deteriorating patient health, lack of interest, and technical difficulties (feasibility). Caregivers found the videoconference technology usable, although participants in one intervention experienced poor connectivity and persistent technical issues (usability). Most caregivers were satisfied with videoconferencing interventions, found their content applicable to their situation, and appreciated their structure (acceptability). Those in videoconferencing group interventions were satisfied with small caregiver group sizes (acceptability). Adding respite care to interventions and incorporating short and regular videoconferencing sessions may improve feasibility. Ensuring small group sizes in videoconferencing group interventions and using participatory design may enhance acceptability. Advocacy is needed for employees identifying as informal caregivers to receive employer support and for quality connectivity within underserved areas. This may improve the feasibility and usability of interventions, allowing caregivers to receive the support they need. In future studies, power analyses and recruiting more caregivers may better assess feasibility.

A Case Study of the Development of a Valid and Pragmatic Implementation Science Measure: The Barriers and Facilitators in Implementation of Task-Sharing Mental Health Interventions (BeFITS-MH) Measure

Background

Few implementation science (IS) measures have been evaluated for validity, reliability and utility - the latter referring to whether a measure captures meaningful aspects of implementation contexts. In this case study, we describe the process of developing an IS measure that aims to assess Barriers and Facilitators in Implementation of Task-Sharing in Mental Health services (BeFITS-MH), and the procedures we implemented to enhance its utility.

Methods

We summarize conceptual and empirical work that informed the development of the BeFITS-MH measure, including a description of the Delphi process, detailed translation and local adaptation procedures, and concurrent pilot testing. As validity and reliability are key aspects of measure development, we also report on our process of assessing the measure's construct validity and utility for the implementation outcomes of acceptability, appropriateness, and feasibility.

Results

Continuous stakeholder involvement and concurrent pilot testing resulted in several adaptations of the BeFITS-MH measure's structure, scaling, and format to enhance contextual relevance and utility. Adaptations of broad terms such as "program," "provider type," and "type of service" were necessary due to the heterogeneous nature of interventions, type of task-sharing providers employed, and clients served across the three global sites. Item selection benefited from the iterative process, enabling identification of relevance of key aspects of identified barriers and facilitators, and what aspects were common across sites. Program implementers' conceptions of utility regarding the measure's acceptability, appropriateness, and feasibility were seen to cluster across several common categories.

Conclusions

This case study provides a rigorous, multi-step process for developing a pragmatic IS measure. The process and lessons learned will aid in the teaching, practice and research of IS measurement development. The importance of including experiences and knowledge from different types of stakeholders in different global settings was reinforced and resulted in a more globally useful measure while allowing for locally-relevant adaptation. To increase the relevance of the measure it is important to target actionable domains that predict markers of utility (e.g., successful uptake) per program implementers' preferences. With this case study, we provide a detailed roadmap for others seeking to develop and validate IS measures that maximize local utility and impact.

Stress Alleviation Methods for community-Based Health ActiVists (SAMBHAV): Development of a digital program for stress reduction for community health workers in rural India

Background

Community health workers (CHWs) face high levels of stress (both professional and personal) and risk of burnout, highlighting the need for efforts to promote their mental health and well-being. This study seeks to develop a digital stress reduction program for CHWs in rural India.

Methods

A stepwise design process was employed to adapt and digitize the evidence-based World Health Organization's Self-Help Plus (SH+) intervention for addressing psychological distress among CHWs in Madhya Pradesh, India. This involved participatory design workshops with CHWs to ensure that the digital stress reduction intervention would be relevant for their needs and the local culture and context. Small groups of CHWs reviewed the adapted program content, allowing the research team to make refinements such as simplifying language, tailoring content to the local setting, and ensuring that program materials are both interesting and relevant. Simultaneously, the research team digitized the content, leveraging a combination of video and graphical content, and uploaded it to the Sangath Learning Management System, a digital platform accessible on a smartphone app.

Results

In total, 18 CHWs contributed to the adaptation of the SH+ content and digital intervention development. Participants commented on finding some terms difficult to follow and recommended simplifying the language and providing detailed explanations. Participants offered positive feedback on the adapted content, expressing that they found the examples covered in the material both relatable and relevant to their own personal experiences at home and in the workplace. By combining participants' insights and comments with feedback from content experts, it was possible to finalize a digital Hindi version of the SH+ intervention for CHWs in rural India.

Conclusions

This study is timely given the continued detrimental impacts of the COVID-19 pandemic, and offers a promising and potentially scalable digital program to alleviate psychological distress among frontline health workers.

Co-developed implementation guidelines to maximize acceptability, feasibility, and usability of mobile phone supervision in Kenya

Opportunities exist to leverage mobile phones to replace or supplement in-person supervision of lay counselors. However, contextual variables, such as network connectivity and provider preferences, must be considered. Using an iterative and mixed methods approach, we co-developed implementation guidelines to support the implementation of mobile phone supervision with lay counselors and supervisors delivering a culturally adapted trauma-focused cognitive behavioral therapy in Western Kenya. Guidelines were shared and discussed with lay counselors in educational outreach visits led by supervisors. We evaluated the impact of guidelines and outreach on the acceptability, feasibility, and usability of mobile phone supervision. Guidelines were associated with significant improvements in acceptability and usability of mobile phone supervision. There was no evidence of a significant difference in feasibility. Qualitative interviews with lay counselors and supervisors contextualized how guidelines impacted acceptability and feasibility - by setting expectations for mobile phone supervision, emphasizing importance, increasing comfort, and sharing strategies to improve mobile phone supervision. Introducing and discussing co-developed implementation guidelines significantly improved the acceptability and usability of mobile phone supervision. This approach may provide a flexible and scalable model to address challenges with implementing evidence-based practices and implementation strategies in lower-resourced areas.

Effective training practices for non-specialist providers to promote high-quality mental health intervention delivery: A narrative review with four case studies from Kenya, Ethiopia, and the United States

Mental health needs and disparities are widespread and have been exacerbated by the COVID-19 pandemic, with the greatest burden being on marginalized individuals worldwide. The World Health Organization developed the Mental Health Gap Action Programme to address growing global mental health needs by promoting task sharing in the delivery of psychosocial and psychological interventions. However, little is known about the training needed for non-specialists to deliver these interventions with high levels of competence and fidelity. This article provides a brief conceptual overview of the evidence concerning the training of non-specialists carrying out task-sharing psychosocial and psychological interventions while utilizing illustrative case studies from Kenya, Ethiopia, and the United States to highlight findings from the literature. In this article, the authors discuss the importance of tailoring training to the skills and needs of the non-specialist providers and their roles in the delivery of an intervention. This narrative review with four case studies advocates for training that recognizes the expertise that non-specialist providers bring to intervention delivery, including how they promote culturally responsive care within their communities.

Understanding Lay Counselor Perspectives on Mobile Phone Supervision in Kenya: Qualitative Study

BACKGROUND

Task shifting is an effective model for increasing access to mental health treatment via lay counselors with less specialized training that deliver care under supervision. Mobile phones may present a low-technology opportunity to replace or decrease reliance on in-person supervision in task shifting, but important technical and contextual limitations must be examined and considered.

OBJECTIVE

Guided by human-centered design methods, we aimed to understand how mobile phones are currently used when supervising lay counselors, determine the acceptability and feasibility of mobile phone supervision, and generate solutions to improve mobile phone supervision.

METHODS

Participants were recruited from a large hybrid effectiveness implementation study in western Kenya wherein teachers and community health volunteers were trained to provide trauma-focused cognitive behavioral therapy. Lay counselors (n=24) and supervisors (n=3) participated in semistructured interviews in the language of the participants' choosing (ie, English or Kiswahili). Lay counselor participants were stratified by supervisor-rated frequency of mobile phone use such that interviews included high-frequency, average-frequency, and low-frequency phone users in equal parts. Supervisors rated lay counselors on frequency of phone contact (ie, calls and SMS text messages) relative to their peers. The interviews were transcribed, translated when needed, and analyzed using thematic analysis.

RESULTS

Participants described a range of mobile phone uses, including providing clinical updates, scheduling and coordinating supervision and clinical groups, and supporting research procedures. Participants liked how mobile phones decreased burden, facilitated access to clinical and personal support, and enabled greater independence of lay counselors. Participants disliked how mobile phones limited information transmission and relationship building between supervisors and lay counselors. Mobile phone supervision was facilitated by access to working smartphones, ease and convenience of mobile phone supervision, mobile phone literacy, and positive supervisor-counselor relationships. Limited resources, technical difficulties, communication challenges, and limitations on which activities can be effectively performed via mobile phone were barriers to mobile phone supervision. Lay counselors and supervisors generated 27 distinct solutions to increase the acceptability and feasibility of mobile phone supervision. Strategies ranged in terms of the resources required and included providing phones and airtime to support supervision, identifying quiet and private places to hold mobile phone supervision, and delineating processes for requesting in-person support.

CONCLUSIONS

Lay counselors and supervisors use mobile phones in a variety of ways; however, there are distinct challenges to their use that must be addressed to optimize acceptability, feasibility, and usability. Researchers should consider limitations to implementing digital health tools and design solutions alongside end users to optimize the use of these tools.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s43058-020-00102-9.

Human centered design workshops as a meta-solution to diagnostic disparities

OBJECTIVES

Diagnostic errors - inaccurate or untimely diagnoses or failures to communicate diagnoses - are harmful and costly for patients and health systems. Diagnostic disparities occur when diagnostic errors are experienced at disproportionate rates by certain patient subgroups based, for example, on patients' age, sex/gender, or race/ethnicity. We aimed to develop and test the feasibility of a human centered design workshop series that engages diverse stakeholders to develop solutions for mitigating diagnostic disparities.

METHODS

We employed a series of human centered design workshops supplemented by semi-structured interviews and literature evidence scans. Co-creation sessions and rapid prototyping by patient, clinician, and researcher stakeholders were used to generate design challenges, solution concepts, and prototypes.

RESULTS

A series of four workshops attended by 25 unique participants was convened in 2019-2021. Workshops generated eight design challenges, envisioned 29 solutions, and formulated principles for developing solutions in an equitable, patient-centered manner. Workshops further resulted in the conceptualization of 37 solutions for addressing diagnostic disparities and prototypes for two of the solutions. Participants agreed that the workshop processes were replicable and could be implemented in other settings to allow stakeholders to generate context-specific solutions.

CONCLUSIONS

The incorporation of human centered design through a series of workshops promises to be a productive way of engaging patient-researcher stakeholders to mitigate and prevent further exacerbation of diagnostic disparities. Healthcare stakeholders can apply human centered design principles to guide thinking about improving diagnostic performance and to center diverse patients' needs and experiences when implementing quality and safety improvements.

Usability-Focused Development and Usage of NeoTree-Beta, an App for Newborn Care in a Low-Resource Neonatal Unit, Malawi

Background

Neonatal mortality is high in low-resource settings. NeoTree is a digital intervention for neonatal healthcare professionals (HCPs) aiming to achieve data-driven quality improvement and improved neonatal survival in low-resource hospitals. Optimising usability with end-users could help digital health interventions succeed beyond pilot stages in low-resource settings. Usability is the quality of a user's experience when interacting with an intervention, encompassing their effectiveness, efficiency, and overall satisfaction.

Objective

To evaluate the usability and usage of NeoTree beta-app and conduct Agile usability-focused intervention development.

Method

A real-world pilot of NeoTree beta-app was conducted over 6 months at Kamuzu Central Hospital neonatal unit, Malawi. Prior to deployment, think-aloud interviews were conducted to guide nurses through the app whilst voicing their thoughts aloud (n = 6). System Usability Scale (SUS) scores were collected before the implementation of NeoTree into usual clinical care and 6 months after implementation (n = 8 and 8). During the pilot, real-world user-feedback and user-data were gathered. Feedback notes were subjected to thematic analysis within an Agile “product backlog.” For usage, number of users, user-cadre, proportion of admissions/outcomes recorded digitally, and median app-completion times were calculated.

Results

Twelve overarching usability themes generated 57 app adjustments, 39 (68%) from think aloud analysis and 18 (32%) from the real-world testing. A total of 21 usability themes/issues with corresponding app features were produced and added to the app. Six themes relating to data collection included exhaustiveness of data schema, prevention of errors, ease of progression, efficiency of data entry using shortcuts, navigation of user interface (UI), and relevancy of content. Six themes relating to the clinical care included cohesion with ward process, embedded education, locally coherent language, adaptability of user-interface to available resources, and printout design to facilitate handover. SUS scores were above average (88.1 and 89.4 at 1 and 6 months, respectively). Ninety-three different HCPs of 5 cadres, recorded 1,323 admissions and 1,197 outcomes over 6 months. NeoTree achieved 100% digital coverage of sick neonates admitted. Median completion times were 16 and 8 min for admissions and outcomes, respectively.

Conclusions

This study demonstrates optimisation of a digital health app in a low-resource setting and could inform other similar usability studies apps in similar settings.

Mobile technology and task shifting to improve access to alcohol treatment services in Mozambique

INTRODUCTION

Unhealthy alcohol use (UAU) is a major public health challenge, particularly in low- and middle-income countries. Mozambique is the fourth poorest country in the world where half of the population lives below the poverty line. UAU is frequent among drinkers in Mozambique; however, resources and infrastructure to treat UAU are very limited. This paper examines how task-shifting and a provider-facing mobile health application are being used to improve access to care. In this paper, the feasibility, acceptability and appropriateness of a provider-facing mobile health application being used under a task-shifting model to identify UAU and provide a four-session brief motivational interviewing intervention are described.

METHOD

The study used a sequential exploratory mixed-methods design with a QUAL → quan structure. First, 15 psychiatric technicians and primary care providers in Mozambique's Nampula Province participated in semi-structured interviews. These interviews were recorded and transcribed. Then, 45 providers completed a 12-item quantitative survey on tablets. Quantitative analysis used descriptive statistic calculation and qualitative analysis used thematic analysis.

RESULTS

Nonspecialized providers found the mobile health app to be acceptable, appropriate, and feasible when delivering a 4-session brief motivational intervention under a task-shifting model. Central benefits of the technology were enhanced standardization and efficiency of sessions as well as feelings of legitimacy when interacting with patients. Main concerns were feasibility of implementing the intervention due to time constraints of workload and internet connectivity issues.

CONCLUSIONS

Provider-facing technology shows promise in supporting task-shifting models that can expand alcohol intervention services and increase access to care in low- and middle-income countries. Providers without specialized training in behavioral health interventions can provide critical services to patients with UAU and provider-facing mobile health applications may help bring such models to scale.

Future Directions in Lay Health Worker Involvement in Children's Mental Health Services in the U.S

Nearly half of children meeting criteria for a mental health disorder in the United States (U.S.) do not receive the treatment they need. Unfortunately, lack of access to and engagement in mental health services can be seen at even higher rates for historically marginalized groups, including low-income, racial, and ethnic minority youth. Lay Health Workers (LHWs) represent a valuable workforce that has been identified as a promising solution to address mental health disparities. LHWs are individuals without formal mental health training who oftentimes share lived experiences with the communities that they serve. A growing body of research has supported the mobilization of LHWs to address service disparities around the globe; however, challenges persist in how to scale-up and sustain LHW models of care, with specific barriers in the U.S. In this paper, we describe LHWs' different roles and involvement in the mental health field as well as the current state of the literature around LHW implementation. We integrate the RE-AIM Framework with a conceptual model of how LHWs address disparities to outline future directions in research and practice to enhance equity in the reach, effectiveness, adoption, implementation, and maintenance of LHW models of care and evidence-based practices for historically marginalized communities within the U.S.