Performance of five pulse oximeters to detect hypoxaemia as an indicator of severe illness in children under five by frontline health workers in low resource settings - A prospective, multicentre, single-blinded, trial in Cambodia, Ethiopia, South Sudan, and Uganda

Community health worker and caregiver experiences and perceptions of a multimodal handheld pulse oximeter used in sick child consultations in rural Burundi: A qualitative evaluation

Community Health Workers (CHWs) in low- and middle-income countries are essential in providing primary health care to remote communities. However, due to limited diagnostic tools, CHWs often struggle to correctly identify childhood illnesses, especially pneumonia. We conducted a prospective pilot study and used qualitative research methods to evaluate acceptability and feasibility of a multimodal pulse oximeter used by CHWs during their integrated community case management (iCCM) of childhood illness consultations in rural Burundi. We used purposive sampling to recruit CHWs and trained them to use the oximeters during household iCCM consultations for children 6-59 months of age. After eight weeks of using the devices, we conducted eight focus group discussions to evaluate experiences and perceptions of the device among CHWs and caregivers. Our thematic analysis, based upon deductive and inductive reasoning, identified the following themes: durability, storability, trust, self-efficacy, child agitation, ease of using the device, and interpretation of parameters. CHWs deemed the devices highly acceptable and took pride in safely storing them but reported challenges in utilizing respiration rate, pulse, and oxygen saturation (though temperature was understood). Child agitation was a barrier to oximeter use, especially among children 6-12 months. Additional CHW capacity-building on interpreting parameters is needed when using oximeters during household iCCM consultations in Burundi, including an iCCM job aid (decision-making tree) with oxygen saturation and respiratory rate cut-offs for treatment and/or referral. Training and using child-calming techniques could be an important strategy for obtaining quality measurements. While CHWs and caregivers highly valued the oximeters during sick child visits, the devices may be better utilized and scalable at the health facility level.

A pilot observational study of the association of 24-hour mortality with the subjective assessment of the forearm skin temperature and moisture compared to other bedside indicators of illness severity

Background

Although the association of peripheral skin temperature with infection, serious illness and death have been recognised for centuries, few studies have explicitly compared this finding with other bedside indicators of illness severity. This study compared subjectively assessed dorsal forearm skin temperature and moisture with other indicators of illness severity.

Methods

Non-interventional observational study of acutely ill medical patients admitted to a low-resource Ugandan hospital, which examined the association of subjectively assessed dorsal forearm skin temperature and other bedside findings with death within 24 h.

Results

While in hospital 653 patients had 2,104 observations; the dorsal forearm skin was subjectively felt to be abnormally hot or cold at 239 observations, and this finding was associated with 24-hour mortality (odds ratio 4.48, 95% CI 1.89-10.46); this increased risk of death was comparable to the increased mortality risk associated with tachypnoea, hypoxia, and a Shock Index >1.0, but considerably lower than that associated with a Kitovu Fast Triage score >0. When stratified according to both temperature and wetness, 'cold and wet' and 'hot and wet' skin were associated with higher early warning scores. Cold or hot forearm skin had a specificity for 24-hour mortality of 0.83, but a sensitivity of only 0.34; therefore, its absence does not rule-out the chance of imminent death.

Conclusion

Touching and feeling the skin temperature and moisture is a valuable clinical sign, which can be rapidly determined at the bedside. However, although it has high specificity, its sensitivity for imminent death is low.

Implementation of a fast triage score for patients arriving to a low resource hospital in Uganda

Background

The Kitovu Fast Triage (KFT) score predicts imminent mortality from mental status, gait and either respiratory rate or oxygen status. As some non-life-threatening conditions require immediate attention, the South African Triage System (SATS) assigns arbitrary rankings of urgency for specific patient presentations.

Aim

Establish the feasibility of determining and then comparing the KFT score and explicitly defined SATS urgency rankings.

Methods

A computerized proforma used standardized methods of assessing and measuring mental status and gait, and respiratory rate and collected explicitly defined clinical presentations and SATS urgency rankings on 4,842 patients at the time of their arrival to the hospital.

Results

75 % of patients were awake and able to count the months backwards from December to September. Respiratory rates measured by a computer application had no clustering of values or digit preference; however, oximetry failed in 14 % of patients, making the score based on respiratory rate the most practical in our setting. Determining the SATS acuity ranking and both KFT scores usually took <90 s; the commonest complaints were pain, dyspnoea, and fever, which often occurred together; overall 3574 (73.8 %) patients had at least one of these symptoms as did 96.4 % of those with the highest KFT score based on respiratory rate. 12 % of patients with the lowest KFT score based on respiratory rate had one or more very urgent SATS rankings, 52 % of whom had non-severe chest pain. Only 5.7 % of patients complaining of fever had a temperature >38 °C.

Conclusion

Whilst the KFT score based on respiratory rate could be rapidly determined in all patients, it identified some patients as low acuity who had very urgent SATS rankings. However, most of these patients had non-severe chest pain, which may not be a very urgent presentation in our setting as ischaemic heart disease remains uncommon in sub-Saharan Africa.

Predicting the potential impact of scaling up four pneumonia interventions on under-five pneumonia mortality: A prospective Lives Saved Tool (LiST) analysis for Bangladesh, Chad, and Ethiopia

Background

Pneumonia remains the leading cause of mortality in under-five children outside the neonatal period. Progress has slowed down in the last decade, necessitating increased efforts to scale up effective pneumonia interventions.

Methods

We used the Lives Saved Tool (LiST), a modelling software for child mortality in low- and middle-income settings, to prospectively analyse the potential impact of upscaling pneumonia interventions in Bangladesh, Chad, and Ethiopia from 2023 to 2030. We included Haemophilus influenzae type B (Hib) vaccination, pneumococcal conjugate vaccine (PCV), oral antibiotics, pulse oximetry, and oxygen as pneumonia interventions in our analysis. Outcomes of interest were the number of pneumonia deaths averted, the proportion of deaths averted by intervention, and changes in the under-five mortality rate.

Findings

We found that 19 775 lives of children under-five could be saved in Bangladesh, 76 470 in Chad, and 97 343 in Ethiopia by scaling intervention coverages to ≥90% by 2030. Our estimated reductions in pneumonia deaths among children under five range from 44.61% to 57.91% in the respective countries. Increased coverage of oral antibiotics, pulse oximetry, and oxygen show similar effects in all three countries, averting between 18.80% and 23.65% of expected pneumonia deaths. Scaling-up PCV has a prominent effect, especially in Chad, where it could avert 14.04% of expected pneumonia deaths. Under-five mortality could be reduced by 1.42 per 1000 live births in Bangladesh, 22.52 per 1000 live births in Chad, and 5.48 per 1000 live births in Ethiopia.

Conclusions

This analysis shows the high impact of upscaling pneumonia interventions. The lack of data regarding coverage indicators is a barrier for further research, policy, and implementation, all requiring increased attention.

Feasibility and acceptability of the paediatric pulse oximeter in integrated management of neonatal and childhood illnesses (IMNCI) services by public health facilities: A qualitative study in rural Western India

Background

Pneumonia contributes to about 15% of child deaths globally, with 20% of the overall deaths occurring in India. Although WHO recommends the use of pulse oximeters (PO) in first-level facilities for early detection of child pneumonia in low- and middle-income countries (LMICs), this has not yet been implemented in India. We aimed to assess the feasibility and acceptability of introducing PO in integrated management of neonatal and childhood illnesses (IMNCI) services at primary health centres (PHC) in the rural Pune district.

Methods

We identified medical officers (MO) and auxiliary nurse midwives (ANM) from six PHCs as study participants due to their involvement in the treatment of children. We developed in-depth interview (IDI) guides for both groups to explore their IMNCI knowledge and attitude towards the program through a qualitative study. We conducted interviews with MOs (n = 6) and ANMs (n = 6) from each PHC. The PO module was added to explore perceptions about its usefulness in diagnosing pneumonia. After baseline assessment, we conducted training sessions on adapted IMNCI services (including PO use) for MOs and ANMs. PO devices were provided at the study PHCs.

Results

At baseline, no PO devices were being used at study PHCs; PHC staff demonstrated satisfactory knowledge about paediatric pneumonia management and demanded refresher IMNCI training. They also felt the need to reiterate the PO use for early diagnosis of pneumonia in children and highlighted the challenges encountered in managing pneumonia at PHCs, such as health system-related challenges and parents' attitudes towards care seeking. There was positive acceptance of training and PO started to be used immediately in PHCs. There was increased confidence in using PO at endline. PO use in examining symptomatic children increased from 26 to 85%.

Conclusions

Paediatric PO implementation could be integrated successfully at PHC levels; we found pre-implementation training and provision of PO to PHCs to be helpful in achieving this goal. This intervention demonstrated that an algorithm to diagnose pneumonia in children that included PO could improve case management.

Risk and accuracy of outpatient-identified hypoxaemia for death among suspected child pneumonia cases in rural Bangladesh: a multifacility prospective cohort study

BACKGROUND

Hypoxaemic pneumonia mortality risk in low-income and middle-income countries is high in children who have been hospitalised, but unknown among outpatient children. We sought to establish the outpatient burden, mortality risk, and prognostic accuracy of death from hypoxaemia in children with suspected pneumonia in Bangladesh.

METHODS

We conducted a prospective community-based cohort study encompassing three upazila (subdistrict) health complex catchment areas in Sylhet, Bangladesh. Children aged 3-35 months participating in a community surveillance programme and presenting to one of three upazila health complex Integrated Management of Childhood Illness (IMCI) outpatient clinics with an acute illness and signs of difficult breathing (defined as suspected pneumonia) were enrolled in the study; because lower respiratory tract infection mortality mainly occurs in children younger than 1 year, the primary study population comprised children aged 3-11 months. Study physicians recorded WHO IMCI pneumonia guideline clinical signs and peripheral arterial oxyhaemoglobin saturations (SpO2) in room air. They treated children with pneumonia with antibiotics (oral amoxicillin [40 mg/kg per dose twice per day for 5-7 days, as per local practice]), and recommended oxygen, parenteral antibiotics, and hospitalisation for those with an SpO2 of less than 90%, WHO IMCI danger signs, or severe malnutrition. Community health workers documented the children's vital status and the date of any vital status changes during routine household surveillance (one visit to each household every 2 months). The primary outcome was death at 2 weeks after enrolment in children aged 3-11 months (primary study population) and 12-35 months (secondary study population). Primary analyses included estimating the outpatient prevalence, mortality risk, and prognostic accuracy of hypoxaemia for death in children aged 3-11 months with suspected pneumonia. Risk ratios were produced by fitting a multivariable model that regressed predefined SpO2 ranges (<90%, 90-93%, and 94-100%) on the primary 2-week mortality outcome (binary outcome) using Poisson models with robust variance estimation. We established the prognostic accuracy of WHO IMCI guidelines for death with and without varying SpO2 thresholds.

FINDINGS

Participants were recruited between Sept 1, 2015, to Aug 31, 2017. During the study period, a total of 7440 children aged 3-35 months with the first suspected pneumonia episode were enrolled, of whom 3848 (54·3%) with an attempted pulse oximeter measurement and 2-week outcome were included in our primary study population of children aged 3-11-months. Among children aged 3-11 months, an SpO2 of less than 90% occurred in 102 (2·7%) of 3848 children, an SpO2 of 90-93% occurred in 306 (8·0%) children, a failed SpO2 measurement occurred in 67 (1·7%) children, and 24 (0·6%) children with suspected pneumonia died. Compared with an SpO2 of 94-100% (3373 [87·7%] of 3848), the adjusted risk ratio for death was 10·3 (95% CI 3·2-32·3; p<0·001) for an SpO2 of less than 90%, 4·3 (1·5-11·8; p=0·005) for an SpO2 of 90-93%, and 11·4 (3·1-41·4; p<0·001) for a failed measurement. When not considering pulse oximetry, of the children who died, WHO IMCI guidelines identified only 25·0% (95% CI 9·7-46·7; six of 24 children) as eligible for referral to hospital. For identifying deaths, in children with an SpO2 of less than 90% WHO IMCI guidelines had a 41·7% sensitivity (95% CI 22·1-63·4) and 89·7% specificity (88·7-90·7); for children with an SpO2 of less than 90% or measurement failure the guidelines had a 54·2% sensitivity (32·8-74·4) and 88·3% specificity (87·2-89·3); and for children with an SpO2 of less than 94% or measurement failure the guidelines had a 62·5% sensitivity (40·6-81·2) and 81·3% specificity (80·0-82·5).

INTERPRETATION

These findings support pulse oximeter use during the outpatient care of young children with suspected pneumonia in Bangladesh as well as the re-evaluation of the WHO IMCI currently recommended threshold of an SpO2 less than 90% for hospital referral.

FUNDING

Fogarty International Center of the National Institutes of Health (K01TW009988), The Bill & Melinda Gates Foundation (OPP1084286 and OPP1117483), and GlaxoSmithKline (90063241).

Defining the role of host biomarkers in the diagnosis and prognosis of the severity of childhood pneumonia: a prospective cohort study

Reliable tools to inform outpatient management of childhood pneumonia in resource-limited settings are needed. We investigated the value added by biomarkers of the host infection response to the performance of the Liverpool quick Sequential Organ Failure Assessment score (LqSOFA), for triage of children presenting with pneumonia to a primary care clinic in a refugee camp on the Thailand-Myanmar border. 900 consecutive presentations of children aged ≤ 24 months meeting WHO pneumonia criteria were included. The primary outcome was receipt of supplemental oxygen. We compared discrimination of a clinical risk score (LqSOFA) to markers of endothelial injury (Ang-1, Ang-2, sFlt-1), immune activation (CHI3L1, IP-10, IL-1ra, IL-6, IL-8, IL-10, sTNFR-1, sTREM-1), and inflammation (CRP, PCT), and quantified the net benefit of including biomarkers alongside LqSOFA. We evaluated the differential contribution of LqSOFA and host biomarkers to the diagnosis and prognosis of pneumonia severity. 49/900 (5.4%) presentations met the primary outcome. Discrimination of LqSOFA and Ang-2, the best performing biomarker, were comparable (AUC 0.82 [95% CI 0.76-0.88] and 0.81 [95% CI 0.74-0.87] respectively). Combining Ang-2 with LqSOFA improved discrimination (AUC 0.91; 95% CI 0.87-0.94; p < 0.001), and resulted in greater net benefit, with 10-30% fewer children who required oxygen supplementation incorrectly identified as safe for community-based management. Ang-2 had greater prognostic utility than LqSOFA to identify children requiring supplemental oxygen later in their illness course. Combining Ang-2 and LqSOFA could guide referrals of childhood pneumonia from resource-limited community settings. Further work on test development and integration into patient triage is required.

Usability of pulse oximeters used by community health and primary care workers as screening tools for severe illness in children under five in low resource settings: A cross-sectional study in Cambodia, Ethiopia, South Sudan, and Uganda

Timely recognition and referral of severely ill children is especially critical in low-resource health systems. Pulse-oximeters can improve health outcomes of children by detecting hypoxaemia, a severity indicator of the most common causes of death in children. Cost-effectiveness of pulse-oximeters has been proven in low-income settings. However, evidence on their usability in community health settings is scarce.This study explores the usability of pulse-oximeters for community health and primary care workers in Cambodia, Ethiopia, South Sudan, and Uganda. We collected observational data, through a nine-task checklist, and survey data, using a five-point Likert scale questionnaire, capturing three usability aspects (effectiveness, efficiency, and satisfaction) of single-probe fingertip and multi-probe handheld devices. Effectiveness was determined by checklist completion rates and task completion rates per checklist item. Efficiency was reported as proportion of successful assessments within three attempts. Standardized summated questionnaire scores (min = 0, max = 100) determined health worker's satisfaction. Influencing factors on effectiveness and satisfaction were explored through hypothesis tests between independent groups (device type, cadre of health worker, country). Checklist completion rate was 78.3% [CI 72.6-83.0]. Choosing probes according to child age showed the lowest task completion rate of 68.7% [CI 60.3%-76.0%]. In 95.6% [CI 92.7%-97.4%] of assessments a reading was obtained within three attempts. The median satisfaction score was 95.6 [IQR = 92.2-99.0]. Significantly higher checklist completion rates were observed with single-probe fingertip devices (p<0.001) and children 12-59 months (p<0.001). We found higher satisfaction scores in South Sudan (p<0.001) and satisfaction varied slightly between devices. From a usability perspective single-probe devices for all age groups should be prioritized for scaled implementation. Further research on easy to use and accurate devices for infants is much needed.

Cost-effectiveness and sustainability of improved hospital oxygen systems in Nigeria

Introduction

Improving hospital oxygen systems can improve quality of care and reduce mortality for children, but we lack data on cost-effectiveness or sustainability. This study evaluated medium-term sustainability and cost-effectiveness of the Nigeria Oxygen Implementation programme.

Methods

Prospective follow-up of a stepped-wedge trial involving 12 secondary-level hospitals. Cross-sectional facility assessment, clinical audit (January–March 2021), summary admission data (January 2018–December 2020), programme cost data. Intervention: pulse oximetry introduction followed by solar-powered oxygen system installation with clinical and technical training and support. Primary outcomes: (i) proportion of children screened with pulse oximetry; (ii) proportion of hypoxaemic (SpO₂ <90%) children who received oxygen. Comparison across three time periods: preintervention (2014–2015), intervention (2016–2017) and follow-up (2018–2020) using mixed-effects logistic regression. Calculated cost-effectiveness of the intervention on child pneumonia mortality using programme costs, recorded deaths and estimated counterfactual deaths using effectiveness estimates from our effectiveness study. Reported cost-effectiveness over the original 2-year intervention period (2016–2017) and extrapolated over 5 years (2016–2020).

Results

Pulse oximetry coverage for neonates and children remained high during follow-up (83% and 81%) compared with full oxygen system period (94% and 92%) and preintervention (3.9% and 2.9%). Oxygen coverage for hypoxaemic neonates/children was similarly high (94%/88%) compared with full oxygen system period (90%/82%). Functional oxygen sources were present in 11/12 (92%) paediatric areas and all (8/8) neonatal areas; three-quarters (15/20) of wards had a functional oximeter. Of 32 concentrators deployed, 23/32 (72%) passed technical testing and usage was high (median 10 797 hours). Estimated 5-year cost-effectiveness US$86 per patient treated, $2694–4382 per life saved and $82–125 per disability-adjusted life year-averted. We identified practical issues for hospitals and Ministries of Health wishing to adapt and scale up pulse oximetry and oxygen.

Conclusion

Hospital-level improvements to oxygen and pulse oximetry systems in Nigerian hospitals have been sustained over the medium-term and are a highly cost-effective child pneumonia intervention.

Development and an initial validation of the Responses to Illness Severity Quantification (RISQ) score for severely malnourished children

Aim

To develop and perform an initial validation of a score to measure the severity of illness in hospitalised children with severe acute malnutrition (SAM).

Methods

A prospective study enrolled SAM children aged 6–59 months hospitalised in Borno State, Nigeria. Candidate items associated with inpatient mortality were combined and evaluated as candidate scores. Clinical and statistical methods were used to identify a preferred score.

Results

The 513 children enrolled had a mean age of 15.6 months of whom 48 (9%) died. Seven of the 10 evaluated items were significantly associated with mortality. Five different candidate scores were tested. The final score, Responses to Illness Severity Quantification (RISQ), included seven items: heart rate, respiratory rate, respiratory effort, oxygen saturation, oxygen delivery, temperature and level of consciousness. The mean RISQ score on admission was 2.6 in hospital survivors and 7.3 for children dying <48 h. RISQ scores <24 h before death had an area under the receiver operating characteristic curve (AUROC) of 0.93. The RISQ score performed similarly across differing clinical conditions with AUROCs 0.77–0.98 for all conditions except oedema.

Conclusion

The RISQ score can identify high‐risk malnourished children at and during hospital admission. Clinical application may help prioritise care and potentially improve survival.

Paediatric pneumonia research priorities in the context of COVID-19: An eDelphi study

Background

Pneumonia remains the leading cause of infectious deaths in children under-five globally. We update the research priorities for childhood pneumonia in the context of the COVID-19 pandemic and explore whether previous priorities have been addressed.

Methods

We conducted an eDelphi study from November 2019 to June 2021. Experts were invited to take part, targeting balance by: gender, profession, and high (HIC) and low- and middle-income countries (LMIC). We followed a three-stage approach: 1. Collating questions, using a list published in 2011 and adding newly posed topics; 2. Narrowing down, through participant scoring on importance and whether they had been answered; 3. Ranking of retained topics. Topics were categorized into: prevent and protect, diagnosis, treatment and cross-cutting.

Results

Overall 379 experts were identified, and 108 took part. We started with 83 topics, and 81 further general and 40 COVID-19 specific topics were proposed. In the final ranking 101 topics were retained, and the highest ranked was to “explore interventions to prevent neonatal pneumonia”. Among the top 20 topics, epidemiological research and intervention evaluation was commonly prioritized, followed by the operational and implementation research. Two COVID-19 related questions were ranked within the top 20. There were clear differences in priorities between HIC and LMIC respondents, and academics vs non-academics.

Conclusions

Operational research on health system capacities, and evaluating optimized delivery of existing treatments, diagnostics and case management approaches are needed. This list should act as a catalyst for collaborative research, especially to meet the top priority in preventing neonatal pneumonia, and encourage multi-disciplinary partnerships.

Hypoxaemia prevalence and management among children and adults presenting to primary care facilities in Uganda: A prospective cohort study

Hypoxaemia (low blood oxygen) is common among hospitalised patients, increasing the odds of death five-fold and requiring prompt detection and treatment. However, we know little about hypoxaemia prevalence in primary care and the role for pulse oximetry and oxygen therapy. This study assessed the prevalence and management of hypoxaemia at primary care facilities in Uganda. We conducted a cross sectional prevalence study and prospective cohort study of children with hypoxaemia in 30 primary care facilities in Uganda, Feb-Apr 2021. Clinical data collectors used handheld pulse oximeters to measure blood oxygen level (SpO2) of all acutely unwell children, adolescents, and adults. We followed up a cohort of children aged under 15 years with SpO2<93% by phone after 7 days to determine if the patient had attended another health facility, been admitted, or recovered. Primary outcome: proportion of children under 5 years of age with severe hypoxaemia (SpO2<90%). Secondary outcomes: severe (SpO2<90%) and moderate hypoxaemia (SpO2 90-93%) prevalence by age/sex/complaint; number of children with hypoxaemia referred, admitted and recovered. We included 1561 children U5, 935 children 5-14 years, and 3284 adolescents/adults 15+ years. Among children U5, the prevalence of severe hypoxaemia was 1.3% (95% CI 0.9 to 2.1); an additional 4.9% (3.9 to 6.1) had moderate hypoxaemia. Performing pulse oximetry according to World Health Organization guidelines exclusively on children with respiratory complaints would have missed 14% (3/21) of severe hypoxaemia and 11% (6/55) of moderate hypoxaemia. Hypoxaemia prevalence was low among children 5-14 years (0.3% severe, 1.1% moderate) and adolescents/adults 15+ years (0.1% severe, 0.5% moderate). A minority (12/27, 44%) of severely hypoxaemic patients were referred; 3 (12%) received oxygen. We followed 87 children aged under 15 years with SpO2<93%, with complete data for 61 (70%), finding low rates of referral (6/61, 10%), hospital attendance (10/61, 16%), and admission (6/61, 10%) with most (44/61, 72%) fully recovered at day 7. Barriers to referral included caregiver belief it was unnecessary (42/51, 82%), cost (8/51, 16%), and distance or lack of transport (3/51, 6%). Hypoxaemia is common among acutely unwell children under five years of age presenting to Ugandan primary care facilities. Routine pulse oximetry has potential to improve referral, management and clinical outcomes. Effectiveness, acceptability, and feasibility of pulse oximetry and oxygen therapy for primary care should be investigated in implementation trials, including economic analysis from health system and societal perspectives.