Training and standardization of general practitioners in the use of lung ultrasound for the diagnosis of pediatric pneumonia

Lung Ultrasound Protocol and Quality Control of Image Interpretation Using an Adjudication Panel in the Household Air Pollution Intervention Network (HAPIN) Trial

OBJECTIVE

Lung ultrasound (LUS) is an alternative to chest radiography to confirm a diagnosis of pneumonia. For research and disease surveillance, methods to use LUS to diagnose pneumonia are needed.

METHODS

In the Household Air Pollution Intervention Network (HAPIN) trial, LUS was used to confirm a clinical diagnosis of severe pneumonia in infants. We developed a standardized definition of pneumonia, protocols for recruitment and training of sonographers, along with LUS image acquisition and interpretation. We use a blinded panel approach to interpretation with LUS cine-loops randomized to non-scanning sonographers with expert review.

DISCUSSION

We obtained 357 lung ultrasound scans: 159, 8 and 190 scans were collected in Guatemala, Peru and Rwanda, respectively. The diagnosis of primary endpoint pneumonia (PEP) required an expert tie breaker in 181 scans (39%). PEP was diagnosed in 141 scans (40%), not diagnosed in 213 (60%), with 3 scans (<1%) deemed uninterpretable. Agreement among the two blinded sonographers and the expert reader in Guatemala, Peru and Rwanda was 65%, 62% and 67%, with a prevalence-and-bias-corrected kappa of 0.30, 0.24 and 0.33, respectively.

CONCLUSION

Use of standardized imaging protocols, training and an adjudication panel resulted in high confidence for the diagnosis of pneumonia using LUS.

The utility of chest x-ray and lung ultrasound in the management of infants and children presenting with severe pneumonia in low-and middle-income countries: A pragmatic scoping review

Background

Chest x-ray (CXR) is commonly used (when available) to support clinical management decisions for child pneumonia and provide a reference standard for diagnosis in research studies. However, its diagnostic and technical limitations for both purposes are well recognised. Recent evidence suggests that lung ultrasound (LUS) may have diagnostic utility in pneumonia. This systematic scoping review of research on the utility of CXR and LUS in the management of severe childhood pneumonia aims to inform pragmatic guidelines for low- and middle-income countries (LMICs) and identify gaps in knowledge.

Methods

We included peer-reviewed studies published between 2000 and 2020 in infants and children aged from one month to nine years, presenting with severe pneumonia. CXR studies were limited to those from LMICs, while LUS studies included any geographic region. LUS and CXR articles were mapped into the following themes: indications, role in diagnosis, role in management, impact on outcomes, and practical considerations for LMIC settings.

Results

85 articles met all eligibility criteria, including 27 CXR studies and 58 LUS studies. CXR studies were primarily observational and examined associations between radiographic abnormalities and pneumonia aetiology or outcomes. The most consistent finding was an association between CXR consolidation and risk of mortality. Difficulty obtaining quality CXR images and inter-reader variability in interpretation were commonly reported challenges. Research evaluating indications for CXR, role in management, and impact on patient outcomes was very limited. LUS studies primarily focused on diagnostic accuracy. LUS had higher sensitivity for identification of consolidation than CXR. There are gaps in knowledge regarding diagnostic criteria, as well as the practical utility of LUS in the diagnosis and management of pneumonia. Most LUS studies were conducted in HIC settings with experienced operators; however, small feasibility studies indicate that good inter-operator reliability may be achieved by training of novice clinicians in LMIC settings.

Conclusions

The available evidence does not support the routine use of CXR or LUS as essential tools in the diagnosis and initial management of severe pneumonia. Further evaluation is required to determine the clinical utility and feasibility of both imaging modalities in low-resource settings.

Training for Pediatric Cardiac and Pulmonary Point of Care Ultrasound in Eastern Uganda

Caring for children with acute illness is a challenge in limited-resource settings, especially when diagnostic imaging is limited or unavailable. We developed a training program in cardiac and lung point-of-care ultrasound (POCUS) for pediatric patients in eastern Uganda. Fourteen trainees including physicians, resident physicians and midlevels received training in cardiac and lung POCUS. Training included formal lectures, hands-on skills practice and individualized teaching sessions. Assessment included written knowledge assessment, direct observation and longitudinal image review. Blinded review of 237 consecutive ultrasound studies revealed satisfactory image quality (94.2% for lung and 93% for cardiac) and accurate image interpretation. Sensitivity and specificity of image interpretation were 0.93 (0.75-0.99) and 0.94 (0.78-0.99) for lung and 0.86 (0.71-0.95) and 0.94 (0.84-0.99) for cardiac compared with expert review. All trainees passed written knowledge assessments. After training, 100% of trainees reported that they would use POCUS in clinical activity and thought it would improve patient outcomes. Our training program indicated that trainees were able to perform high-quality cardiac and lung POCUS for pediatric patients with accurate interpretation. This builds a foundation for future studies addressing how POCUS can change outcomes for children in limited-resource settings.

Effectiveness of the 10-valent pneumococcal conjugate vaccine on pediatric pneumonia confirmed by ultrasound: a matched case-control study

Background

Bangladesh introduced the 10-valent pneumococcal conjugate vaccine (PCV10) for children aged < 1 year in March 2015. Previous vaccine effectiveness (VE) studies for pneumonia have used invasive pneumococcal disease or chest X-rays. None have used ultrasound. We sought to determine the VE of PCV10 against sonographically-confirmed pneumonia in three subdistrict health complexes in Bangladesh.

Methods

We conducted a matched case–control study between July 2015 and September 2017 in three subdistricts of Sylhet, Bangladesh. Cases were vaccine-eligible children aged 3–35 months with sonographically-confirmed pneumonia, who were matched with two types of controls by age, sex, week of diagnosis, subdistrict health complex (clinic controls) or distance from subdistrict health complex (community controls) and had an illness unlikely due to Streptococcus pneumoniae (clinic controls) or were healthy (community controls). VE was measured using multivariable conditional logistic regression.

Results

We evaluated 8926 children (average age 13.3 months, 58% boys) with clinical pneumonia by ultrasound; 2470 had pneumonia with consolidations ≥ 1 cm; 1893 pneumonia cases were matched with 4238 clinic controls; and 1832 were matched with 3636 community controls. VE increased with the threshold used for consolidation size on ultrasound: the adjusted VE of ≥ 2 doses vs. non-recipients of PCV10 against pneumonia increased from 15.8% (95% CI 1.6–28.0%) for consolidations ≥ 1 cm to 29.6% (12.8–43.2%) for consolidations ≥ 1.5 cm using clinic controls and from 2.7% (− 14.2–17.2%) to 23.5% (4.4–38.8%) using community controls, respectively.

Conclusions

PCV10 was effective at reducing sonographically-confirmed pneumonia in children aged 3–35 months of age when compared to unvaccinated children. VE increased with the threshold used for consolidation size on ultrasound in clinic and community controls alike. This study provides evidence that lung ultrasound is a useful alternative to chest X-ray for case–control studies evaluating the effectiveness of vaccines against pneumonia.

Usefulness of Lung Ultrasound in Paediatric Respiratory Diseases

Respiratory infection diseases are among the major causes of morbidity and mortality in children. Diagnosis is focused on clinical presentation, yet signs and symptoms are not specific and there is a need for new non-radiating diagnostic tools. Among these, lung ultrasound (LUS) has recently been included in point-of-care protocols showing interesting results. In comparison to other imaging techniques, such as chest X-ray and computed tomography, ultrasonography does not use ionizing radiations. Therefore, it is particularly suitable for clinical follow-up of paediatric patients. LUS requires only 5-10 min and allows physicians to make quick decisions about the patient's management. Nowadays, LUS has become an early diagnostic tool to detect pneumonia during the COVID-19 pandemic. In this narrative review, we show the most recent scientific literature about advantages and limits of LUS performance in children. Furthermore, we discuss the major paediatric indications separately, with a paragraph fully dedicated to COVID-19. Finally, we mention potential future perspectives about LUS application in paediatric respiratory diseases.

Education of general practitioners in the use of point-of-care ultrasonography: a systematic review

OBJECTIVE

To systematically review and synthesize the published literature regarding the education of general practitioners (GPs) and GPs in training (GPTs) in the use of ultrasonography.

DESIGN

This systematic review was prospectively registered in PROSPERO, conducted according to the Cochrane recommendations. We combined studies identified in a previous systematic review with studies from an updated literature search using the same search string. We searched the following databases: MEDLINE via Pubmed, EMBASE via OVID, Cinahl via Ebsco, Web of Science and Cochrane Register of Controlled Trials using the words 'ultrasonography' and 'general practice'. Two reviewers independently screened articles, extracted data and assessed the quality of included papers according to the Down and Black quality assessment tool. Disagreements were resolved by involving a third reviewer.

RESULTS

Thirty-three papers were included. Ultrasound training was described to include both theoretical and practical training sessions. Theoretical training was achieved through introductory e-learning and/or didactic lectures. Practical training included focussed hands-on training sessions, while some papers described additional longitudinal practical training through proctored scans during clinical work or through self-study practice with continuous feedback on recorded scans.

CONCLUSION

There was a large variation in ultrasound training programs for GPs and GPTs, with an overall emphasis on focussed practical training. Few studies included a longitudinal learning process in the training program. However, diagnostic accuracy seemed to improve with hours of practical training, and studies including continuous feedback on scans conducted during clinical patient encounters showed superior results.

Performance of lung ultrasound in the diagnosis of pediatric pneumonia in Mozambique and Pakistan

INTRODUCTION

Improved pneumonia diagnostics are needed in low-resource settings (LRS); lung ultrasound (LUS) is a promising diagnostic technology for pneumonia. The objective was to compare LUS versus chest radiograph (CXR), and among LUS interpreters, to compare expert versus limited training with respect to interrater reliability.

METHODS

We conducted a prospective, observational study among children with World Health Organization (WHO) Integrated Management of Childhood Illness (IMCI) chest-indrawing pneumonia at two district hospitals in Mozambique and Pakistan, and assessed LUS and CXR examinations. The primary endpoint was interrater reliability between LUS and CXR interpreters for pneumonia diagnosis among children with WHO IMCI chest-indrawing pneumonia.

RESULTS

Interrater reliability was excellent for expert LUS interpreters, but poor to moderate for expert CXR interpreters and onsite LUS interpreters with limited training.

CONCLUSIONS

Among children with WHO IMCI chest-indrawing pneumonia, expert interpreters may achieve substantially higher interrater reliability for LUS compared to CXR, and LUS showed potential as a preferred reference standard. For point-of-care LUS to be successfully implemented for the diagnosis and management of pneumonia in LRS, the clinical environment and amount of appropriate user training will need to be understood and addressed.

Training physicians in India to interpret pediatric chest radiographs according to World Health Organization research methodology

BACKGROUND

Chest radiography is the standard for diagnosing pediatric lower respiratory infections in low-income and middle-income countries. A method for interpreting pediatric chest radiographs for research endpoints was recently updated by the World Health Organization (WHO) Chest Radiography in Epidemiological Studies project. Research in India required training local physicians to interpret chest radiographs following the WHO method.

OBJECTIVE

To describe the methodology for training Indian physicians and evaluate the training's effectiveness.

MATERIALS AND METHODS

Twenty-nine physicians (15 radiologists and 14 pediatricians) from India were trained by two WHO Chest Radiography in Epidemiological Studies members over 3 days in May 2019. Training materials were adapted from WHO Chest Radiography in Epidemiological Studies resources. Participants followed WHO methodology to interpret 60 unique chest radiographs before and after the training. Participants needed to correctly classify ≥80% of radiographs for primary endpoint pneumonia on the post-training test to be certified to interpret research images. We analyzed participant performance on both examinations.

RESULTS

Twenty-six of 29 participants (89.7%) completed both examinations. The average score increased by 9.6% (95% confidence interval [CI] 5.0-14.1%) between examinations (P<0.001). Participants correctly classifying ≥80% of images for primary endpoint pneumonia increased from 69.2% (18/26) on the pretraining to 92.3% (24/26) on the post-training examination (P=0.003). The mean scores of radiologists and pediatricians on the post-training examination were not statistically different (P=0.43).

CONCLUSION

Our results demonstrate this training approach using revised WHO definitions and tools was successful, and that non-radiologists can learn to apply these methods as effectively as radiologists. Such capacity strengthening is important for enabling research to support national policy decision-making in these settings. We recommend future research incorporating WHO chest radiograph methodology to consider modelling trainings after this approach.

Consensus on the Application of Lung Ultrasound in Pneumonia and Bronchiolitis in Children

This evidence-based consensus aims to establish the role of point-of-care lung ultrasound in the management of pneumonia and bronchiolitis in paediatric patients. A panel of thirteen experts form five Polish tertiary pediatric centres was involved in the development of this document. The literature search was done in PubMed database. Statements were established based on a review of full-text articles published in English up to December 2019. The development of this consensus was conducted according to the GRADE (Grading of Recommendations, Assessment, Development and Evaluations)-adopted and Delphi method. Initially, 22 proposed statements were debated over 3 rounds of on-line discussion and anonymous voting sessions. A total of 17 statements were agreed upon, including four statements referring to general issues, nine referring to pneumonia and four to bronchiolitis. For five statements experts did not achieve an agreement. The evidence supporting each statement was evaluated to assess the strength of each statement. Overall, eight statements were rated strong, five statements moderate, and four statements weak. For each statement, experts provided their comments based on the literature review and their own experience. This consensus is the first to establish the role of lung ultrasound in the diagnosis and management of pneumonia and bronchiolitis in children as an evidence-based method of imaging.

Design and conduct of facility-based surveillance for severe childhood pneumonia in the Household Air Pollution Intervention Network (HAPIN) trial

Pneumonia is both a treatable and preventable disease but remains a leading cause of death in children worldwide. Household air pollution caused by burning biomass fuels for cooking has been identified as a potentially preventable risk factor for pneumonia in low- and middle-income countries. We are conducting a randomised controlled trial of a clean energy intervention in 3200 households with pregnant women living in Guatemala, India, Peru and Rwanda. Here, we describe the protocol to ascertain the incidence of severe pneumonia in infants born to participants during the first year of the study period using three independent algorithms: the presence of cough or difficulty breathing and hypoxaemia (≤92% in Guatemala, India and Rwanda and ≤86% in Peru); presence of cough or difficulty breathing along with at least one World Health Organization-defined general danger sign and consolidation on chest radiography or lung ultrasound; and pneumonia confirmed to be the cause of death by verbal autopsy. Prior to the study launch, we identified health facilities in the study areas where cases of severe pneumonia would be referred. After participant enrolment, we posted staff at each of these facilities to identify children enrolled in the trial seeking care for severe pneumonia. To ensure severe pneumonia cases are not missed, we are also conducting home visits to all households and providing education on pneumonia to the mother. Severe pneumonia reduction due to mitigation of household air pollution could be a key piece of evidence that sways policymakers to invest in liquefied petroleum gas distribution programmes.