Performance of Four Respiratory Rate Counters to Support Community Health Workers to Detect the Symptoms of Pneumonia in Children in Low Resource Settings: A Prospective, Multicentre, Hospital-Based, Single-Blinded, Comparative Trial

Introducing the Pi-CON Methodology to Overcome Usability Deficits during Remote Patient Monitoring

The adoption of telehealth has soared, and with that the acceptance of Remote Patient Monitoring (RPM) and virtual care. A review of the literature illustrates, however, that poor device usability can impact the generated data when using Patient-Generated Health Data (PGHD) devices, such as wearables or home use medical devices, when used outside a health facility. The Pi-CON methodology is introduced to overcome these challenges and guide the definition of user-friendly and intuitive devices in the future. Pi-CON stands for passive, continuous, and non-contact, and describes the ability to acquire health data, such as vital signs, continuously and passively with limited user interaction and without attaching any sensors to the patient. The paper highlights the advantages of Pi-CON by leveraging various sensors and techniques, such as radar, remote photoplethysmography, and infrared. It illustrates potential concerns and discusses future applications Pi-CON could be used for, including gait and fall monitoring by installing an omnipresent sensor based on the Pi-CON methodology. This would allow automatic data collection once a person is recognized, and could be extended with an integrated gateway so multiple cameras could be installed to enable data feeds to a cloud-based interface, allowing clinicians and family members to monitor patient health status remotely at any time.

Implementation of a fast triage score for patients arriving to a low resource hospital in Uganda

Background

The Kitovu Fast Triage (KFT) score predicts imminent mortality from mental status, gait and either respiratory rate or oxygen status. As some non-life-threatening conditions require immediate attention, the South African Triage System (SATS) assigns arbitrary rankings of urgency for specific patient presentations.

Aim

Establish the feasibility of determining and then comparing the KFT score and explicitly defined SATS urgency rankings.

Methods

A computerized proforma used standardized methods of assessing and measuring mental status and gait, and respiratory rate and collected explicitly defined clinical presentations and SATS urgency rankings on 4,842 patients at the time of their arrival to the hospital.

Results

75 % of patients were awake and able to count the months backwards from December to September. Respiratory rates measured by a computer application had no clustering of values or digit preference; however, oximetry failed in 14 % of patients, making the score based on respiratory rate the most practical in our setting. Determining the SATS acuity ranking and both KFT scores usually took <90 s; the commonest complaints were pain, dyspnoea, and fever, which often occurred together; overall 3574 (73.8 %) patients had at least one of these symptoms as did 96.4 % of those with the highest KFT score based on respiratory rate. 12 % of patients with the lowest KFT score based on respiratory rate had one or more very urgent SATS rankings, 52 % of whom had non-severe chest pain. Only 5.7 % of patients complaining of fever had a temperature >38 °C.

Conclusion

Whilst the KFT score based on respiratory rate could be rapidly determined in all patients, it identified some patients as low acuity who had very urgent SATS rankings. However, most of these patients had non-severe chest pain, which may not be a very urgent presentation in our setting as ischaemic heart disease remains uncommon in sub-Saharan Africa.

Health System Considerations for Community-Based Implementation of Automated Respiratory Counters to Identify Childhood Pneumonia in 5 Regions of Ethiopia: A Qualitative Study

BACKGROUND

In Ethiopia, childhood pneumonia is diagnosed in primary healthcare settings by measuring respiratory rate (RR) along with the presence of cough, chest indrawing, difficulty breathing, and fast breathing. Our aim was to identify health system-level lessons from implementing two automated RR counters, Children's Automated Respiration Monitor (ChARM) by Phillips® and Rad-G by Masimo®, to provide considerations for integrating such devices into child health programmes and health systems. This study was part of an initiative called the Acute Respiratory Infection Diagnostic Aids (ARIDA).

METHODS

Key informant interviews (KIIs) were conducted with 57 participants (health workers in communities and facilities, trainers of health workers, district management, and key decision-makers) in five regions of Ethiopia. Data were analyzed in ATLAS.ti using thematic content analysis and themes were categorized using the Tanahashi bottleneck analysis.

RESULTS

All participants recommended scaling up the ARIDA initiative nationally as part of Integrated Management of Newborn and Childhood Illness (IMNCI) in primary healthcare. Health workers perceived the devices as: time saving, acceptable by parents and children, and facilitating diagnosis and referrals. Health workers perceived an increased demand for services and reduced numbers of sick children not seeking care. Participants recommended increasing the number of devices distributed and health workers trained. Strengthening drug supply chains, improving oxygen gas availability, and strengthening referral networks would maximize perceived benefits. While training improved knowledge, more supportive supervision, integration with current guidelines and more guidance related to community engagement was recommended.

CONCLUSION

Automatic RR counters for the decentralized diagnosis of childhood pneumonia could have positive impact on improving the quality of diagnosis and management of pneumonia in children. However, the study has shown that a health system approach is required to ensure all steps along the pneumonia pathway are adequate, including drug and oxygen supply, community engagement, health worker training and support, and referral pathways.

Performance and usability of a new mobile application for measuring respiratory rate in young children with acute lower respiratory infections

OBJECTIVES

Respiratory rate (RR) measurement is critical to diagnosing pneumonia in resource-constrained settings, but accurate RR measurement is challenging. The acute lower respiratory illness treatment and evaluation (ALRITE) mobile phone application (app), designed to help healthcare workers (HCWs) manage pediatric respiratory illnesses, includes a semiautomated RR counter. This study aimed to evaluate the accuracy and usability of the ALRITE RR counter and a commercially available RR counter app, RRate, with a reference standard.

METHODS

This was a cross-sectional observational study of HCWs. Participants used both apps to measure the RR of pediatric patients from standardized videos. The reference standard was determined by consensus of a manual 1-min count by two providers. We assessed agreement using Spearman's rank correlation coefficient and constructed Bland-Altman plots to determine bias and limits of agreement. Participants completed a usability survey.

RESULTS

Thirty-nine HCWs participated. The agreement between the apps and reference standard (Spearman's coefficient) was 0.83 (95% confidence interval [CI]: 0.78-0.87) for ALRITE and 0.62 (95% CI: 0.52-0.70) for RRate. ALRITE had a bias of -2 breaths/min (lower limit of agreement [LoA] -16 to +12) and RRate had a bias of -0.4 breaths/min (LoA -24 to +23) compared to the reference standard. Both apps had a poorer agreement at higher RRs. Based on usability survey responses, 95% found ALRITE easy to use.

CONCLUSIONS

The ALRITE RR counter has acceptable accuracy for counting RR in infants with respiratory distress, appears to be more accurate than a commercially available option, and was user-friendly. The ALRITE RR counter is a promising tool for meriting evaluation in real-world settings.

Developing a video expert panel as a reference standard to evaluate respiratory rate counting in paediatric pneumonia diagnosis: protocol for a cross-sectional study

INTRODUCTION

Manual counting of respiratory rate (RR) in children is challenging for health workers and can result in misdiagnosis of pneumonia. Some novel RR counting devices automate the counting of RR and classification of fast breathing. The absence of an appropriate reference standard to evaluate the performance of these devices is a challenge. If good quality videos could be captured, with RR interpretation from these videos systematically conducted by an expert panel, it could act as a reference standard. This study is designed to develop a video expert panel (VEP) as a reference standard to evaluate RR counting for identifying pneumonia in children.

METHODS AND ANALYSIS

Using a cross-sectional design, we will enrol children aged 0-59 months presenting with suspected pneumonia at different levels of health facilities in Dhaka and Sylhet, Bangladesh. We will videorecord a physician/health worker counting RR manually and also using an automated RR counter (Children's Automated Respiration Monitor) from each child. We will establish a standard operating procedure for capturing quality videos, make a set of reference videos, and train and standardise the VEP members using the reference videos. After that, we will assess the performance of the VEP as a reference standard to evaluate RR counting. We will calculate the mean difference and proportions of agreement within±2 breaths per minute and create Bland-Altman plots with limits of agreement between VEP members.

ETHICS AND DISSEMINATION

The study protocol was approved by the National Research Ethics Committee of Bangladesh Medical Research Council, Bangladesh (registration number: 39315022021) and Edinburgh Medical School Research Ethics Committee (EMREC), Edinburgh, UK (REC Reference: 21-EMREC-040). Dissemination of the study findings will be through conference presentations and publications in peer-reviewed scientific journals.

Development and an initial validation of the Responses to Illness Severity Quantification (RISQ) score for severely malnourished children

Aim

To develop and perform an initial validation of a score to measure the severity of illness in hospitalised children with severe acute malnutrition (SAM).

Methods

A prospective study enrolled SAM children aged 6–59 months hospitalised in Borno State, Nigeria. Candidate items associated with inpatient mortality were combined and evaluated as candidate scores. Clinical and statistical methods were used to identify a preferred score.

Results

The 513 children enrolled had a mean age of 15.6 months of whom 48 (9%) died. Seven of the 10 evaluated items were significantly associated with mortality. Five different candidate scores were tested. The final score, Responses to Illness Severity Quantification (RISQ), included seven items: heart rate, respiratory rate, respiratory effort, oxygen saturation, oxygen delivery, temperature and level of consciousness. The mean RISQ score on admission was 2.6 in hospital survivors and 7.3 for children dying <48 h. RISQ scores <24 h before death had an area under the receiver operating characteristic curve (AUROC) of 0.93. The RISQ score performed similarly across differing clinical conditions with AUROCs 0.77–0.98 for all conditions except oedema.

Conclusion

The RISQ score can identify high‐risk malnourished children at and during hospital admission. Clinical application may help prioritise care and potentially improve survival.

Accuracy of non-physician health workers in respiratory rate measurement to identify paediatric pneumonia in low- and middle-income countries: A systematic review and meta-analysis

Background

Methods

Results

Conclusions

Variability of respiratory rate measurements in neonates- every minute counts

Background

Respiratory rate is difficult to measure, especially in neonates who have an irregular breathing pattern. The World Health Organisation recommends a one-minute count, but there is limited data to support this length of observation. We sought to evaluate agreement between the respiratory rate (RR) derived from capnography in neonates, over 15 s, 30 s, 120 s and 300 s, against the recommended 60 s.

Methods

Neonates at two hospitals in Nairobi were recruited and had capnograph waveforms recorded using the Masimo Rad 97. A single high quality 5 min epoch was randomly chosen from each subject. For each selected epoch, the mean RR was calculated using a breath-detection algorithm applied to the waveform. The RR in the first 60 s was compared to the mean RR measured over the first 15 s, 30 s, 120 s, full 300 s, and last 60 s. We calculated bias and limits of agreement for each comparison and used Bland-Altman plots for visual comparisons.

Results

A total of 306 capnographs were analysed from individual subjects. The subjects had a median gestation age of 39 weeks with slightly more females (52.3%) than males (47.7%). The majority of the population were term neonates (70.1%) with 39 (12.8%) having a primary respiratory pathology. There was poor agreement between all the comparisons based on the limits of agreement [confidence interval], ranging between 11.9 [− 6.79 to 6.23] breaths per minute in the one versus 2 min comparison, and 34.7 [− 17.59 to 20.53] breaths per minute in the first versus last minute comparison. Worsening agreement was observed in plots with higher RRs.

Conclusions

Neonates have high variability of RR, even over a short period of time. A slight degradation in the agreement is noted over periods shorter than 1 min. However, this is smaller than observations done 3 min apart in the same subject. Longer periods of observation also reduce agreement. For device developers, precise synchronization is needed when comparing devices to reduce the impact of RR variation. For clinicians, where possible, continuous or repeated monitoring of neonates would be preferable to one time RR measurements.

Performance of Automated Point-of-Care Respiratory Rate Counting versus Manual Counting in Children under Five Admitted with Severe Febrile Illness to Kisantu Hospital, DR Congo

To improve the early recognition of danger signs in children with severe febrile illness in low resource settings, WHO promotes automated respiratory rate (RR) counting, but its performance is unknown in this population. Therefore, we prospectively evaluated the field performance of automated point-of-care plethysmography-based RR counting in hospitalized children with severe febrile illness (<5 years) in DR Congo. A trained research nurse simultaneously counted the RR manually (comparative method) and automatically with the Masimo Rad G pulse oximeter. Valid paired RR measurements were obtained in 202 (83.1%) children, among whom 43.1% (87/202) had fast breathing according to WHO criteria based on manual counting. Automated counting frequently underestimated the RR (median difference of -1 breath/minute; p2.5-p97.5 limits of agreement: -34-6), particularly at higher RR. This resulted in a failure to detect fast breathing in 24.1% (21/87) of fast breathing children (positive percent agreement: 75.9%), which was not explained by clinical characteristics (p > 0.05). Children without fast breathing were mostly correctly classified (negative percent agreement: 98.3%). In conclusion, in the present setting the automated RR counter performed insufficiently to facilitate the early recognition of danger signs in children with severe febrile illness, given wide limits of agreement and a too low positive percent agreement.

An openly available wearable, a diaper cover, monitors infant's respiration and position during rest and sleep

AIM

To describe and test the accuracy of respiratory rate assessment in long-term surveillance using an open-source infant wearable, NAPping PAnts (NAPPA).

METHODS

We recorded 24 infants aged 1-9 months using our newly developed infant wearable that is a diaper cover with an integrated programmable electronics with accelerometer and gyroscope sensors. The sensor collects child's respiration rate (RR), activity and body posture in 30-s epochs, to be downloaded afterwards into a mobile phone application. An automated RR quality measure was also implemented using autocorrelation function, and the accuracy of RR estimate was compared with a reference obtained from the simultaneously recorded capnography signal that was part of polysomnography recordings.

RESULTS

Altogether 88 h 27 min of data were recorded, and 4147 epochs (39% of all data) were accepted after quality detection. The median of patient wise mean absolute errors in RR estimates was 1.5 breaths per minute (interquartile range 1.1-2.6 bpm), and the Blandt-Altman analysis indicated an RR bias of 0.0 bpm with the 95% limits of agreement of -5.7-5.7 bpm.

CONCLUSION

Long-term monitoring of RR and posture can be done with reasonable accuracy in out-of-hospital settings using NAPPA, an openly available infant wearable.

Performance of five pulse oximeters to detect hypoxaemia as an indicator of severe illness in children under five by frontline health workers in low resource settings - A prospective, multicentre, single-blinded, trial in Cambodia, Ethiopia, South Sudan, and Uganda

BACKGROUND

Low blood oxygen saturation (SpO₂), or hypoxaemia, is an indicator of severe illness in children. Pulse oximetry is a globally accepted, non-invasive method to identify hypoxaemia, but rarely available outside higher-level facilities in resource-constrained countries. This study aims to evaluate the performance of different types of pulse oximeters amongst frontline health workers in Cambodia, Ethiopia, South Sudan, and Uganda.

METHODS

Five pulse oximeters (POx) which passed laboratory testing, out of an initial 32 potential pulse oximeters, were evaluated by frontline health workers for performance, defined as agreement between the SpO₂ measurements of the test device and the reference standard. The study protocol is registered with the Australia New Zealand Clinical Trials Registry (Ref: ACTRrn12615000348550).

FINDINGS

Two finger-tip pulse oximeters (Contec and Devon), two handheld pulse oximeters (Lifebox and Utech), and one phone pulse oximeter (Masimo) passed the laboratory testing. They were evaluated for performance on 1,313 children under five years old by 207 frontline health workers between February and May 2015. Phone and handheld pulse oximeters had greater overall agreement with the reference standard (56%; 95% CI 0.52 - 0.60 to 68%; 95% CI 0.65 - 0.71) than the finger-tip POx (31%; 95% CI 0.26 to 0.36 and 47%; 95% CI 0.42 to 0.52). Fingertip POx performance was substantially lower in the 0-2 month olds; having just 17% and 25% agreement. The finger-tip devices more often underreported SpO₂ readings (mean difference -7.9%; 95%CI -8.6,-7.2 and -3.9%; 95%CI -4.4,-3.4), and therefore over diagnosed hypoxaemia in the children assessed.

INTERPRETATION

While the Masimo phone pulse oximeter performed best, all handheld POx with age-specific probes performed well in the hands of frontline health workers, further highlighting their suitability as a screening tool of severe illness. The poor performance of the fingertip POx suggests they should not be used in children under five by frontline health workers. It is essential that POx are performance tested on children in routine settings (in vivo), not only in laboratories or controlled settings (in vitro), before being introduced at scale.

FUNDING

Bill & Melinda Gates Foundation [OPP1054367].

Evaluating the Interrater Agreement and Acceptability of a New Reference Tool for Assessing Respiratory Rate in Children under Five with Cough and/or Difficulty Breathing

BACKGROUND

Manual assessment of respiratory rate (RR) in children is unreliable, but remains the main method to diagnose pneumonia in low-resource settings. While automated RR counters offer a potential solution, there is currently no gold standard to validate these diagnostic aids. A video-based reference tool is proposed that allows users to annotate breaths and distortions including movement periods, allowing the exclusion of distortions from the computation of RR measures similar to how new diagnostic aids account for distortions automatically. This study evaluated the interrater agreement and acceptability of the new reference tool.

METHODS

Annotations were based on previously recorded reference videos of children under five years old with cough and/or difficulty breathing (n = 50). Five randomly selected medical experts from a panel of ten annotated each video. RR measures (breaths per minute, bpm) were computed as the number of annotated certain breaths divided by the length of calm periods after removing annotated distorted periods.

RESULTS

Reviewers showed good interrater agreement on continuous RR {standard error of measurement (SEM) [4.8 (95%CI 4.4-5.3)]} and substantial agreement on classification of fast breathing (Fleiss kappa, κ 0.71). Agreement was lowest in the youngest age group [< 2 months: SEM 6.2 (5.4-7.4) bpm, κ 0.48; 2-11 months: 4.7 (4.0-5.8) bpm, κ 0.84; 12-59 months: 2.6 (2.2-3.1) bpm, κ 0.8]. Reviewers found the functionalities of the tool helpful in annotating breaths, but remained uncertain about the validity of their annotations.

CONCLUSIONS

Before the new tool can be considered a reference standard for RR assessments, interrater agreement in children younger than 2 months must be improved.

Identification of thresholds for accuracy comparisons of heart rate and respiratory rate in neonates

Background: Heart rate (HR) and respiratory rate (RR) can be challenging to measure accurately and reliably in neonates. The introduction of innovative, non-invasive measurement technologies suitable for resource-constrained settings is limited by the lack of appropriate clinical thresholds for accuracy comparison studies. Methods: We collected measurements of photoplethysmography-recorded HR and capnography-recorded exhaled carbon dioxide across multiple 60-second epochs (observations) in enrolled neonates admitted to the neonatal care unit at Aga Khan University Hospital in Nairobi, Kenya. Trained study nurses manually recorded HR, and the study team manually counted individual breaths from capnograms. For comparison, HR and RR also were measured using an automated signal detection algorithm. Clinical measurements were analyzed for repeatability. Results: A total of 297 epochs across 35 neonates were recorded. Manual HR showed a bias of -2.4 (-1.8%) and a spread between the 95% limits of agreement (LOA) of 40.3 (29.6%) compared to the algorithm-derived median HR. Manual RR showed a bias of -3.2 (-6.6%) and a spread between the 95% LOA of 17.9 (37.3%) compared to the algorithm-derived median RR, and a bias of -0.5 (1.1%) and a spread between the 95% LOA of 4.4 (9.1%) compared to the algorithm-derived RR count. Manual HR and RR showed repeatability of 0.6 (interquartile range (IQR) 0.5-0.7), and 0.7 (IQR 0.5-0.8), respectively. Conclusions: Appropriate clinical thresholds should be selected a priori when performing accuracy comparisons for HR and RR. Automated measurement technologies typically use median values rather than counts, which significantly impacts accuracy. A wider spread between the LOA, as much as 30%, should be considered to account for the observed physiological nuances and within- and between-neonate variability and different averaging methods. Wider adoption of thresholds by data standards organizations and technology developers and manufacturers will increase the robustness of clinical comparison studies.

The Importance of Respiratory Rate Monitoring: From Healthcare to Sport and Exercise

Respiratory rate is a fundamental vital sign that is sensitive to different pathological conditions (e.g., adverse cardiac events, pneumonia, and clinical deterioration) and stressors, including emotional stress, cognitive load, heat, cold, physical effort, and exercise-induced fatigue. The sensitivity of respiratory rate to these conditions is superior compared to that of most of the other vital signs, and the abundance of suitable technological solutions measuring respiratory rate has important implications for healthcare, occupational settings, and sport. However, respiratory rate is still too often not routinely monitored in these fields of use. This review presents a multidisciplinary approach to respiratory monitoring, with the aim to improve the development and efficacy of respiratory monitoring services. We have identified thirteen monitoring goals where the use of the respiratory rate is invaluable, and for each of them we have described suitable sensors and techniques to monitor respiratory rate in specific measurement scenarios. We have also provided a physiological rationale corroborating the importance of respiratory rate monitoring and an original multidisciplinary framework for the development of respiratory monitoring services. This review is expected to advance the field of respiratory monitoring and favor synergies between different disciplines to accomplish this goal.

Does Chest Attachment of an Automated Respiratory Rate Monitor Influence the Actual Respiratory Rate in Children Under Five?

Pneumonia is one of the leading causes of death in children under 5 years worldwide. In resource-limited settings, WHO recommendations state that pneumonia can be presumptively diagnosed through the presence of cough and/or difficult breathing and a respiratory rate (RR) that is higher than age-specific cutoffs. As a new diagnostic aid the children's automated respiration monitor (ChARM) can automatically measure and classify RR in children under 5 years, but the effect of its chest attachment on the RR has not been studied. The aim of this study was to understand if misclassification of the true RR occurred by ChARM attachment. Two hundred eighty-seven children at a health center in South Ethiopia were screened for eligibility, with 188 children aged 2-59 months enrolled in the study. The RR was measured manually before and 1, 3, and 5 minutes after ChARM attachment. The proportion of children with fast or normal RR classification at baseline and the change between RR classifications over time were analyzed. Eight (4.9%; 95% CI 2.1, 9.4) of 163 children changed RR classification from normal to fast between the baseline RR count and the 1 minute RR count. Results from this study suggest that ChARM has a minor influence on the RR of children immediately after attachment, in most cases without clinical importance.