Usability and acceptability of an automated respiratory rate counter to assess children for symptoms of pneumonia: A cross-sectional study in Ethiopia

Health System Considerations for Community-Based Implementation of Automated Respiratory Counters to Identify Childhood Pneumonia in 5 Regions of Ethiopia: A Qualitative Study

BACKGROUND

In Ethiopia, childhood pneumonia is diagnosed in primary healthcare settings by measuring respiratory rate (RR) along with the presence of cough, chest indrawing, difficulty breathing, and fast breathing. Our aim was to identify health system-level lessons from implementing two automated RR counters, Children's Automated Respiration Monitor (ChARM) by Phillips® and Rad-G by Masimo®, to provide considerations for integrating such devices into child health programmes and health systems. This study was part of an initiative called the Acute Respiratory Infection Diagnostic Aids (ARIDA).

METHODS

Key informant interviews (KIIs) were conducted with 57 participants (health workers in communities and facilities, trainers of health workers, district management, and key decision-makers) in five regions of Ethiopia. Data were analyzed in ATLAS.ti using thematic content analysis and themes were categorized using the Tanahashi bottleneck analysis.

RESULTS

All participants recommended scaling up the ARIDA initiative nationally as part of Integrated Management of Newborn and Childhood Illness (IMNCI) in primary healthcare. Health workers perceived the devices as: time saving, acceptable by parents and children, and facilitating diagnosis and referrals. Health workers perceived an increased demand for services and reduced numbers of sick children not seeking care. Participants recommended increasing the number of devices distributed and health workers trained. Strengthening drug supply chains, improving oxygen gas availability, and strengthening referral networks would maximize perceived benefits. While training improved knowledge, more supportive supervision, integration with current guidelines and more guidance related to community engagement was recommended.

CONCLUSION

Automatic RR counters for the decentralized diagnosis of childhood pneumonia could have positive impact on improving the quality of diagnosis and management of pneumonia in children. However, the study has shown that a health system approach is required to ensure all steps along the pneumonia pathway are adequate, including drug and oxygen supply, community engagement, health worker training and support, and referral pathways.

Multi-Modal Portable Respiratory Rate Monitoring Device for Childhood Pneumonia Detection

Accurate assessment of Respiratory Rate (RR) is the most important mechanism in detecting pneumonia in low-resource settings. Pneumonia is a disease with one of the highest mortality rates among young children under five. However, the diagnosis of pneumonia for infants remains challenging, especially in low- and middle-income countries (LMIC). In such situations, RR is most often measured manually with visual inspection. Accurate RR measurement requires the child to remain calm without any stress for a few minutes. The difficulty in achieving this with a sick child in a clinical environment can result in errors and misdiagnosis, even more so when the child is crying and non-cooperating around unfamiliar adults. Therefore, we propose an automated novel RR monitoring device built with textile glove and dry electrodes which can make use of the relaxed posture when the child is resting on the carer's lap. This portable system is non-invasive and made with affordable instrumentation integrated on customized textile glove. The glove has multi-modal automated RR detection mechanism that simultaneously uses bio-impedance and accelerometer data. This novel textile glove with dry electrodes can easily be worn by a parent/carer and is washable. The real-time display on a mobile app shows the raw data and the RR value, allowing a healthcare professional to monitor the results from afar. The prototype device has been tested on 10 volunteers with age variation of 3 years to 33 years, including male and female. The maximum variation of measured RR with the proposed system is ±2 compared to the traditional manual counting method. It does not create any discomfort for either the child or the carer and can be used up to 60 to 70 sessions/day before recharging.

Developing a video expert panel as a reference standard to evaluate respiratory rate counting in paediatric pneumonia diagnosis: protocol for a cross-sectional study

INTRODUCTION

Manual counting of respiratory rate (RR) in children is challenging for health workers and can result in misdiagnosis of pneumonia. Some novel RR counting devices automate the counting of RR and classification of fast breathing. The absence of an appropriate reference standard to evaluate the performance of these devices is a challenge. If good quality videos could be captured, with RR interpretation from these videos systematically conducted by an expert panel, it could act as a reference standard. This study is designed to develop a video expert panel (VEP) as a reference standard to evaluate RR counting for identifying pneumonia in children.

METHODS AND ANALYSIS

Using a cross-sectional design, we will enrol children aged 0-59 months presenting with suspected pneumonia at different levels of health facilities in Dhaka and Sylhet, Bangladesh. We will videorecord a physician/health worker counting RR manually and also using an automated RR counter (Children's Automated Respiration Monitor) from each child. We will establish a standard operating procedure for capturing quality videos, make a set of reference videos, and train and standardise the VEP members using the reference videos. After that, we will assess the performance of the VEP as a reference standard to evaluate RR counting. We will calculate the mean difference and proportions of agreement within±2 breaths per minute and create Bland-Altman plots with limits of agreement between VEP members.

ETHICS AND DISSEMINATION

The study protocol was approved by the National Research Ethics Committee of Bangladesh Medical Research Council, Bangladesh (registration number: 39315022021) and Edinburgh Medical School Research Ethics Committee (EMREC), Edinburgh, UK (REC Reference: 21-EMREC-040). Dissemination of the study findings will be through conference presentations and publications in peer-reviewed scientific journals.

Field Experiences with Handheld Diagnostic Devices to Triage Children under Five Presenting with Severe Febrile Illness in a District Hospital in DR Congo

As part of a field study (NCT04473768) in children presenting with severe febrile illness to Kisantu hospital (DR Congo), we retrospectively compiled user experiences (not performance) with handheld diagnostic devices assisting triage: tympanic thermometer, pulse oximeter (measuring heart rate, respiratory rate and oxygen saturation), hemoglobinometer and glucometer. Guidance documents for product selection were generic and scattered. Stock rupture, market withdrawal and unaffordable prices interfered with procurement. Challenges at implementation included environmental temperature, capillary blood sampling (antisepsis, order of multiple tests, filling microcuvettes and glucose strips), calibration (environmental temperature, cold chain) and liability-oriented communication with a manufacturer. Instructions for use were readable and contained symbol keys; two devices had printed French-language instructions. Shortcomings were poor integration of figures with text and distinct procedures for the oximeter and its sensor. Usability interview revealed appreciations for quick results, visibility of the display and memory function (three devices) but also problems of capillary blood sample transfer, cleaning, too long of a time-to-results (respiratory rate) and size, fitting and disposal of thermometer probes. Pictorial error messages were preferred over alphanumeric error codes but interpretation of symbols was poor. Alarm sounds of the oximeter caused unrest in children and caretakers perceived the device as associated with poor prognosis.

Performance of Automated Point-of-Care Respiratory Rate Counting versus Manual Counting in Children under Five Admitted with Severe Febrile Illness to Kisantu Hospital, DR Congo

To improve the early recognition of danger signs in children with severe febrile illness in low resource settings, WHO promotes automated respiratory rate (RR) counting, but its performance is unknown in this population. Therefore, we prospectively evaluated the field performance of automated point-of-care plethysmography-based RR counting in hospitalized children with severe febrile illness (<5 years) in DR Congo. A trained research nurse simultaneously counted the RR manually (comparative method) and automatically with the Masimo Rad G pulse oximeter. Valid paired RR measurements were obtained in 202 (83.1%) children, among whom 43.1% (87/202) had fast breathing according to WHO criteria based on manual counting. Automated counting frequently underestimated the RR (median difference of -1 breath/minute; p2.5-p97.5 limits of agreement: -34-6), particularly at higher RR. This resulted in a failure to detect fast breathing in 24.1% (21/87) of fast breathing children (positive percent agreement: 75.9%), which was not explained by clinical characteristics (p > 0.05). Children without fast breathing were mostly correctly classified (negative percent agreement: 98.3%). In conclusion, in the present setting the automated RR counter performed insufficiently to facilitate the early recognition of danger signs in children with severe febrile illness, given wide limits of agreement and a too low positive percent agreement.

Usability and acceptability of an automated respiratory rate counter to assess children for symptoms of pneumonia: A cross-sectional study in Ethiopia

AIM

Manually counting respiratory rate (RR) is commonly practiced by community health workers to detect fast breathing, an important sign of childhood pneumonia. Correctly counting and classifying breaths manually is challenging, often leading to inappropriate treatment. This study aimed to determine the usability of a new automated RR counter (ChARM) by health extension workers (HEWs), and its acceptability to HEWs, first-level health facility workers (FLHFWs) and caregivers in Ethiopia.

METHODS

A cross-sectional study was conducted in one region of Ethiopia between May and August 2018. A total of 131 HEWs were directly observed conducting 262 sick child consultations after training and 337 after 2 months. Usability was measured as adherence to the WHO requirements to assess fast breathing and device manufacturer instructions for use (IFU). Acceptability was measured through semi-structured interviews.

RESULTS

After 2 months, HEWs were shown to adhere to the requirements in 74.6% consultations; an increase of 18.6% after training (P < .001). ChARM is acceptable to users and caregivers, with HEWs suggesting that ChARM increased client flow and stating a willingness to use ChARM in future.

CONCLUSION

Further research on the performance, cost-effectiveness and implementation of this device is warranted to inform policy decisions in countries with a high childhood pneumonia burden.

Usability and acceptability of an automated respiratory rate counter to assess childhood pneumonia in Nepal

AIM

Pneumonia is the leading cause of child death after the neonatal period, resulting from late care seeking and inappropriate treatment. Diagnosis involves counting respiratory rate (RR); however, RR counting remains challenging for health workers and miscounting, and misclassification of RR is common. We evaluated the usability of a new automated RR counter, the Philips Children's Respiratory Monitor (ChARM), to Female Community Health Volunteers (FCHVs), and its acceptability to FCHVs and caregivers in Nepal.

METHODS

A cross-sectional study was conducted in Jumla district, Nepal. About 133 FCHVs were observed between September and December 2018 when using ChARM during 517 sick child consultations, 264 after training and 253 after 2 months of routine use of ChARM. Acceptability of the ChARM was explored using semi-structured interviews.

RESULTS

FCHV adherence to guidelines after 2 months of using ChARM routinely was 52.8% (95% CI 46.6-58.9). The qualitative findings suggest that ChARM is acceptable to FCHVs and caregivers; however, capacity constraints such as older age and low literacy and impacted device usability were mentioned.

CONCLUSION

Further research on the performance, cost-effectiveness and implementation feasibility of this device is recommended, especially among low-literate CHWs.