The World Heart Federation criteria raise the threshold of diagnosis for mild rheumatic heart disease: Three reviewers are better than one

The Echocardiographic Diagnosis of Rheumatic Heart Disease: A Review of the Performance of the World Heart Federation Criteria 2012-2023

Background

The World Heart Federation (WHF) published the first evidence-based guidelines on the echocardiographic diagnosis of rheumatic heart disease (RHD) in 2012. These guidelines have since been applied internationally in research and clinical practice. Substantial research has assessed the utility of the 2012 WHF criteria, including its applicability in low-resource settings. This article summarises the evidence regarding the performance of the guidelines.

Methods

A scoping review assessing the performance of the guidelines was performed. Cochrane, Embase, Medline, PubMed Lilacs, Sielo, and Portal BVS databases were searched for studies on the performance of the guidelines between January 2012-March 2023, and 4047 manuscripts met the search criteria, of which 34 were included. This included papers assessing the specificity, inter-rater reliability, application using hand-carried ultrasound, and modification of the criteria for simplicity. The review followed the PRISMA Extension for Scoping Reviews guideline.

Results

The WHF 2012 criteria were 100% specific for definite RHD when applied in low-prevalence populations. The criteria demonstrated substantial and moderate inter-rater reliability for detecting definite and borderline RHD, respectively. The inter-rater reliability for morphological features was lower than for valvular regurgitation. When applied to hand-carried ultrasound performed by an expert, modified versions of the criteria demonstrated a sensitivity and specificity range of 79-90% and 87-93% respectively for detecting any RHD, performing best for definite RHD. The sensitivity and the specificity were reduced when performed in task-sharing but remains moderately accurate.

Conclusion

The WHF 2012 criteria provide clear guidance for the echocardiographic diagnosis of RHD that is reproducible and applicable to a range of echocardiographic technology. Furthermore, the criteria are highly specific and particularly accurate for detecting definite RHD. There are limitations in applying all aspects of the criteria in specific settings, including task-sharing. This summary of evidence can inform the updated version of the WHF guidelines to ensure improved applicability in all RHD endemic regions.

Echocardiographic Screening for Rheumatic Heart Disease: A Brief History and Implications for the Future

Transthoracic echocardiography is the gold standard for early detection of rheumatic heart disease (RHD) in asymptomatic children living in high-risk regions. Advances in technology allowing miniaturisation and increased portability of echocardiography devices have improved the accessibility of this vital diagnostic tool in RHD-endemic locations. Automation of image optimisation techniques and simplified RHD screening protocols permit use by non-experts after a brief period of training. While these changes are welcome advances in the battle to manage RHD, it is important that the sensitivity and specificity of RHD detection be maintained by all echocardiography users on any device to ensure accurate and timely diagnosis of RHD to facilitate initiation of appropriate therapy. This review of the evolution of echocardiography and its use in the detection of rheumatic valve disease may serve as a reminder of the key strengths and potential pitfalls of this increasingly relied-upon diagnostic test.

Application of Transthoracic Echocardiography for Cardiac Safety Evaluation in the Clinical Development Process of Vaccines Against Streptococcus pyogenes

Superficial infections with Streptococcus pyogenes (Strep A), pharyngitis and impetigo can induce acute rheumatic fever, an autoimmune sequela manifesting mostly with arthritis and rheumatic carditis. Valvular heart damage can persist or advance following repeated episodes of acute rheumatic fever, causing rheumatic heart disease. Acute rheumatic fever and rheumatic heart disease disproportionately affect children and young adults in developing countries and disadvantaged communities in developed countries. People living with rheumatic heart disease are at risk of experiencing potentially fatal complications such as heart failure, bacterial endocarditis or stroke. Transthoracic echocardiography plays a central role in diagnosing both rheumatic carditis and rheumatic heart disease. Despite the obvious medical need, no licensed Strep A vaccines are currently available, as their clinical development process faces several challenges, including concerns for cardiac safety. However, the development of Strep A vaccines has been recently relaunched by many vaccine developers. In this context, a reliable and consistent safety evaluation of Strep A vaccine candidates, including the use of transthoracic echocardiography for detecting cardiac adverse events, could greatly contribute to developing a safe and efficacious product in the near future. Here, we propose a framework for the consistent use of transthoracic echocardiography to proactively detect cardiac safety events in clinical trials of Strep A vaccine candidates.

High burden of rheumatic heart disease confirmed by echocardiography among Pacific adults living in New Zealand

BACKGROUND

Despite numerous echocardiographic screening studies of children in high incidence acute rheumatic fever (ARF)/rheumatic heart disease (RHD) communities, little is known about the prevalence of RHD in adults in these populations.We sought to determine the prevalence of RHD in an urban area of South Auckland, New Zealand, where previous studies had shown the prevalence of RHD in children to be around 2%.

METHODS

A cross-sectional screening study was conducted between 2014 and 2016. Echocardiography clinics were conducted at an urban Pacific-led primary healthcare clinic in New Zealand. Eligible persons aged 16-40 years were recruited according to a stratified randomised approach. Echocardiograms were performed with a standardised image acquisition protocol and reported by cardiologists.

RESULTS

There were 465 individuals who underwent echocardiograms. The overall prevalence of RHD (define and borderline) was 56 per 1000 (95% CI 36 to 78 per 1000). Definite RHD was found in 10 individuals (4 of whom were already under cardiology review at a hospital clinic) with a prevalence of 22 per 1000 (95% CI 9 to 36 per 1000). Non-rheumatic cardiac abnormalities were found in 29 individuals.

CONCLUSIONS

There is a high burden of both rheumatic and non-rheumatic cardiac abnormalities in this population. Rates described in New Zealand are as high as lower-middle-income countries in Africa. Addressing knowledge gaps regarding the natural history of RHD detected by echocardiography in adults is a priority issue for the international RHD community.

Comparison of approaches to determine echocardiographic outcomes for children with latent rheumatic heart disease

BACKGROUND

Screening programmes using echocardiography offer opportunity for intervention through identification and treatment of early (latent) rheumatic heart disease (RHD). We aimed to compare two methods for classifying progression or regression of latent RHD: serial review method and blinded, side-by-side review.

METHODS

A four-member expert panel reviewed 799 enrolment (in 2018) and completion (in 2020) echocardiograms from the GOAL Trial of latent RHD in Uganda to make consensus determination of normal, borderline RHD or definite RHD. Serial interpretations (enrolment and completion echocardiograms read at two different time points, 2 years apart, not beside one another) were compared with blinded side-by-side comparisons (enrolment and completion echocardiograms displayed beside one another in random order on same screen) to determine outcomes according to prespecified definitions of disease progression (worsening), regression (improving) or no change. We calculated inter-rater agreement using Cohen's kappa.

RESULTS

There were 799 pairs of echocardiogram assessments included. A higher number, 54 vs 38 (6.8% vs 4.5%), were deemed as progression by serial interpretation compared with side-by-side comparison. There was good inter-rater agreement between the serial interpretation and side-by-side comparison methods (kappa 0.89). Disagreement was most often a result of the difference in classification between borderline RHD and mild definite RHD. Most discrepancies between interpretation methods (46 of 47, 98%) resulted from differences in valvular morphological evaluation, with valves judged to be morphologically similar between enrolment and final echocardiograms when compared side by side but classified differently on serial interpretation.

CONCLUSIONS

There was good agreement between the methods of serial and side-by-side interpretation of echocardiograms for change over time, using the World Heart Federation criteria. Side-by-side interpretation has higher specificity for change, with fewer differences in the interpretation of valvular morphology, as compared with serial interpretation.

Single-View Echocardiography by Nonexpert Practitioners to Detect Rheumatic Heart Disease: A Prospective Study of Diagnostic Accuracy

Supplemental Digital Content is available in the text.

Background:

Echocardiographic screening can detect asymptomatic cases of rheumatic heart disease (RHD), facilitating access to treatment. Barriers to implementation of echocardiographic screening include the requirement for expensive equipment and expert practitioners. We aimed to evaluate the diagnostic accuracy of an abbreviated echocardiographic screening protocol (single parasternal-long-axis view with a sweep of the heart) performed by briefly trained, nonexpert practitioners using handheld ultrasound devices.

Methods:

Participants aged 5 to 20 years in Timor-Leste and the Northern Territory of Australia had 2 echocardiograms: one performed by an expert echocardiographer using a GE Vivid I or Vivid Q portable ultrasound device (reference test), and one performed by a nonexpert practitioner using a GE Vscan handheld ultrasound device (index test). The accuracy of the index test, compared with the reference test, for identifying cases with definite or borderline RHD was determined.

Results:

There were 3111 enrolled participants; 2573 had both an index test and reference test. Median age was 12 years (interquartile range, 10–15); 58.2% were female. Proportion with definite or borderline RHD was 5.52% (95% CI, 4.70–6.47); proportion with definite RHD was 3.23% (95% CI, 2.61–3.98).

Compared with the reference test, sensitivity of the index test for definite or borderline RHD was 70.4% (95% CI, 62.2–77.8), specificity was 78.1% (95% CI, 76.4–79.8).

Conclusions:

Nonexpert practitioners can be trained to perform single parasternal-long-axis view with a sweep of the heart echocardiography. However, the specificity and sensitivity are inadequate for echocardiographic screening. Improved training for nonexpert practitioners should be investigated.

Echocardiography for latent rheumatic heart disease in first degree relatives of children with acute rheumatic fever: Implications for active case finding in family members

BACKGROUND

Individuals with Acute Rheumatic Fever (ARF) often report a family history of ARF or Rheumatic Heart Disease (RHD) however the degree of familial susceptibility to RHD is poorly defined. This study aimed to determine RHD prevalence among first degree relatives of ARF patients using echocardiography.

METHODS

Children with ARF were recruited from Auckland, New Zealand. Parents and siblings ≥ 4years were offered echocardiography. Echocardiograms were reported according to World Heart Federation 2012 criteria. RHD prevalence in first degree relatives was compared to previously established population rates in the region.

FINDINGS

In total, 70 index cases with ARF were recruited. Echocardiography was performed in 94 parents and 132 siblings. There were 3 siblings with definite RHD and 9 with borderline RHD. There were 4 parents with definite RHD. Overall prevalence of RHD (definite and borderline) in siblings was 90/1,000 (95% CI 45-143/1,000) compared to 36/1,000 (95% CI 30-42/1,000) in New Zealand children from high ARF incidence populations (p 0.001). Prevalence of definite RHD in parents was 42/1,000 (95% CI 7-87/1,000) compared to 22/1,000 (95% CI 9-36/1,000) in adults from a high ARF incidence New Zealand population (p 0.249).

INTERPRETATION

RHD prevalence in siblings and parents of ARF cases is significantly greater than in comparable background populations. The contribution of hereditary versus environmental risk factors remains uncertain. We recommend targeted echocardiographic case-finding among siblings and parents of ARF/RHD cases in order to detect previously unrecognized latent RHD.

The inter-rater reliability and individual reviewer performance of the 2012 world heart federation guidelines for the echocardiographic diagnosis of latent rheumatic heart disease

BACKGROUND

In 2012, the World Heart Federation (WHF) published guidelines for the echocardiographic diagnosis of rheumatic heart disease (RHD). This study assesses individual reviewer performance and inter-rater agreement and reliability on the presence of any RHD, as well classification of RHD based on the 2012 WHF criteria.

METHODS

Four cardiologists individually reviewed echocardiograms in the context of a randomized clinical trial (ClinicalTrials.gov:NCT03346525) and participated in a blinded adjudication panel. Panel decision was the reference standard for diagnosis. Performance of individual reviewers to panel adjudication was compared through sensitivity and specificity analyses and inter-rater reliability was assessed between individual panelists using Fleiss free marginal multirater kappa.

RESULTS

Echocardiograms from 784 children had two independent reports and panel adjudication. The accuracy of independent reviewers for any RHD had high sensitivity (94%, 95% CI 93-95%) and moderate specificity (62%, 95% CI 53-70%). Sensitivity and specificity for definite RHD was 61.3 (95% CI, 55.3-67.1) and 93.1 (95% CI, 91.6-94.4), with 86.8 (84.7-88.7) and 65.8 (61.0-70.4) for borderline RHD. There was moderate inter-rater agreement (κ = 0.66) on the presence of any RHD while agreement for specific 2012 WHF classification was only fair (κ = 0.51).

CONCLUSIONS

The 2012 WHF guidelines are moderately reproducible when used by expert cardiologists. More cases of RHD were diagnosed by an consensus panel than by individual reviewers. A revision to the criteria is now warranted to further increase the reliability of the WHF criteria.

Echocardiographic screening to determine progression of latent rheumatic heart disease in endemic areas: A systematic review and meta-analysis

BACKGROUND

The World Health Organisation previously recommended routine screening in school-aged children in countries with a high prevalence of rheumatic heart disease (RHD); however, it is unclear if screening-detected (latent) valve disease will inevitably evolve to a pathological lesion. Understanding the natural history of latent RHD is essential prior to recommendation of screening in endemic areas. Studies documenting the progression of latent RHD have had contrasting conclusions about the pathogenicity of latent valvular lesions. This review provides estimates of rates of progression of latent RHD.

METHODS AND FINDINGS

In this systematic review and meta-analysis, we searched EMBASE, MEDLINE, Global Index Medicus, Africa Wide, Cochrane Database of Systematic Reviews and Global Health Database for studies published before April 30, 2019. Study data were extracted from all studies which reported follow-up data on progression of latent valve lesions. Studies with control cohorts were used to calculate comparative prevalence ratios. This study is registered with PROSPERO, number CRD42019119427. We identified 12 studies reporting follow-up data on latent RHD for 950 people in 9 countries. The estimated pooled prevalence rate for progression per year of latent RHD was 5%/year (95% CI 2-8). Eight studies reported on the progression of borderline latent RHD with an estimated pooled prevalence of 2%/year (95% CI 0-4). Three studies included control groups. There was a significant increase in the risk of progression of valvular disease in the latent group compared with controls (RR = 3.57 (95%CI = 1.65-7.70, P = 0.001). The overall risk of bias was low. Given most studies included penicillin administration we were unable to document the natural history of latent RHD. Furthermore, we were unable to perform a sensitivity analysis to determine the effect of administering penicillin prophylaxis on progression of valve disease given prescription of penicillin was not standardised.

CONCLUSION

Latent RHD has a slow rate of progression but it is significantly higher compared to controls, with definite latent RHD having a higher rate of progression compared with borderline latent disease. There are a massive number of individuals at risk for RHD in the developing world as well as logistical challenges of screening and delivering penicillin prophylaxis. The low rate of progression from untargeted screening may be an important consideration in resource-constrained environments.

The RECARDINA Study protocol: diagnostic utility of ultra-abbreviated echocardiographic protocol for handheld machines used by non-experts to detect rheumatic heart disease

INTRODUCTION

Rheumatic heart disease (RHD) causes significant morbidity and mortality in young people from disadvantaged populations. Early detection through echocardiography screening can facilitate early access to treatment. Large-scale implementation of screening could be feasible with the combination of inexpensive standalone ultrasound transducers and upskilling non-expert practitioners to perform abbreviated echocardiography.

METHODS AND ANALYSIS

A prospective cross-sectional study will evaluate an abbreviated echocardiography screening protocol for the detection of latent (asymptomatic) RHD in high-risk populations. The study will evaluate the diagnostic accuracy of health worker conducted single parasternal long axis view with a sweep using handheld devices (SPLASH) (Philips Lumify S4-1 phased array transducer). Each participant will have at least one reference test performed on the same day by an expert echocardiographer. Diagnosis of RHD will be determined by a panel of three experts, using 2012 World Heart Federation criteria. Sensitivity and specificity of the index test will be calculated with 95% CIs, to determine diagnostic accuracy of a screen-and-refer approach to echocardiography screening for RHD. Remote review of SPLASH images obtained by health workers will facilitate evaluation of the sensitivity and specificity of an alternative approach, using external review of health worker obtained SPLASH images to decide onward referral.

ETHICS AND DISSEMINATION

Ethics approval was obtained from the Human Research Ethics Committee of the Northern Territory Department of Health and Menzies School of Health Research, for the project to be carried out in Timor-Leste (HREC 2019-3399), and in Australia, following review by the Aboriginal Ethics subcommittee (HREC 2019-334). Ethical and technical approval was granted in Timor-Leste, by the Institute National of Health Research Ethics and Technical Committee (1073-MS-INS/GDE/VII/2019). Study results will be disseminated in the communities involved in the study, and through peer-reviewed publications and conference abstracts.

TRIAL REGISTRATION NUMBER

The Australia New Zealand Clinical Trials Registry (ACTRN12620000122954).