Performance of an enzyme immunoassay test and anaerobic culture for detection of group A streptococci in a pediatric practice versus a hospital laboratory

Rapid antigen detection test for group A streptococcus in children with pharyngitis

BACKGROUND

Group A streptococcus (GAS) accounts for 20% to 40% of cases of pharyngitis in children; the remaining cases are caused by viruses. Compared with throat culture, rapid antigen detection tests (RADTs) offer diagnosis at the point of care (within five to 10 minutes).

OBJECTIVES

To determine the diagnostic accuracy of RADTs for diagnosing GAS in children with pharyngitis. To assess the relative diagnostic accuracy of the two major types of RADTs (enzyme immunoassays (EIA) and optical immunoassays (OIA)) by indirect and direct comparison.

SEARCH METHODS

We searched CENTRAL, MEDLINE, EMBASE, Web of Science, CDSR, DARE, MEDION and TRIP (January 1980 to July 2015). We also conducted related citations tracking via PubMed, handsearched reference lists of included studies and relevant review articles, and screened all articles citing included studies via Google Scholar.

SELECTION CRITERIA

We included studies that compared RADT for GAS pharyngitis with throat culture on a blood agar plate in a microbiology laboratory in children seen in ambulatory care.

DATA COLLECTION AND ANALYSIS

Two review authors independently screened titles and abstracts for relevance, assessed full texts for inclusion, and carried out data extraction and quality assessment using the QUADAS-2 tool. We used bivariate meta-analysis to estimate summary sensitivity and specificity, and to investigate heterogeneity across studies. We compared the accuracy of EIA and OIA tests using indirect and direct evidence.

MAIN RESULTS

We included 98 unique studies in the review (116 test evaluations; 101,121 participants). The overall methodological quality of included studies was poor, mainly because many studies were at high risk of bias regarding patient selection and the reference standard used (in 73% and 43% of test evaluations, respectively). In studies in which all participants underwent both RADT and throat culture (105 test evaluations; 58,244 participants; median prevalence of participants with GAS was 29.5%), RADT had a summary sensitivity of 85.6%; 95% confidence interval (CI) 83.3 to 87.6 and a summary specificity of 95.4%; 95% CI 94.5 to 96.2. There was substantial heterogeneity in sensitivity across studies; specificity was more stable. There was no evidence of a trade-off between sensitivity and specificity. Heterogeneity in accuracy was not explained by study-level characteristics such as whether an enrichment broth was used before plating, mean age and clinical severity of participants, and GAS prevalence. The sensitivity of EIA and OIA tests was comparable (summary sensitivity 85.4% versus 86.2%). Sensitivity analyses showed that summary estimates of sensitivity and specificity were stable in low risk of bias studies.

AUTHORS' CONCLUSIONS

In a population of 1000 children with a GAS prevalence of 30%, 43 patients with GAS will be missed. Whether or not RADT can be used as a stand-alone test to rule out GAS will depend mainly on the epidemiological context. The sensitivity of EIA and OIA tests seems comparable. RADT specificity is sufficiently high to ensure against unnecessary use of antibiotics. Based on these results, we would expect that amongst 100 children with strep throat, 86 would be correctly detected with the rapid test while 14 would be missed and not receive antibiotic treatment.

Importance of inoculum size and sampling effect in rapid antigen detection for diagnosis of Streptococcus pyogenes pharyngitis

Current recommendations suggest that negative rapid Streptococcus pyogenes antigen tests be backed up with a culture, reflecting evidence that culture may have a higher sensitivity and also that testing of a second swab may yield a different (i.e., a positive) result because of variation in sample size or distribution. If the latter is common, the sensitivities of current antigen detection tests might be improved by simply increasing the amount of sample tested. The present study assessed the effect of antigen testing of two swabs extracted together compared to independent testing of each swab extracted separately for children with clinical pharyngitis. S. pyogenes grew from one or both swabs for 198 (37%) of 537 children. The combined culture was significantly (P < 0.05) more sensitive than culture of either swab alone. Compared to combined culture, antigen testing of two swabs extracted and tested together was significantly more sensitive than two single swab extractions (94.1 versus 80%; P = 0.03); however, the specificity was decreased (81.5 versus 89.8 to 92.7%; P < 0.05). This study suggests that sample size and/or uneven sample distribution may have influenced the apparent sensitivities of prior studies that compared antigen tests to a single plate culture. A strategy, such as the one used in the present study, that increases the sample size available for antigen testing (i.e., extraction of samples from both swabs) may improve detection rates to a level that will better approximate true disease status and obviate the need for backup cultures if specificity can be improved.

Evaluation of the patient with sore throat, earache, and sinusitis: an evidence based approach

Sore throat, earache, and sinusitis are common presenting complaints in the emergency department, and all fall within the top ten in the United States. These complaints usually have a benign course but rarely can be a symptom of a serious disease process. This article provides an evidence-based review of the literature regarding the diagnosis of pharyngitis, otitis media, and sinusitis.

Comparison of two rapid streptococcal antigen detection assays with culture for diagnosis of streptococcal pharyngitis

In this study, 801 pharyngeal specimens were cultured for group A streptococci and tested with the Biostar Strep A Optical Immunoassay (Strep A OIA). The respective sensitivities and specificities were as follows: culture, 97.1 and 100%; Strep A OIA, 91.5 and 94.8%. Of the 801 specimens, 597 were also tested with the Abbott TestPack Strep A Assay (TP-ST). For those specimens tested by all three methods, the respective sensitivities and specificities were as follows: culture, 98.1 and 100%; Strep A OIA, 92.3 and 95.4%; and TP-ST, 79.4 and 100%. The Strep A OIA is significantly more sensitive than TP-ST and compares favorably with culture.

Evaluation of a new immunologic test kit for rapid detection of group A streptococci, the Abbott Testpack Strep A plus

We compared the Testpack Strep A plus (TPSAP) enzyme-linked immunosorbent assay test for group A beta-hemolytic streptococcal (GAS) antigen rapid detection with blood agar culture in 454 pediatric patients with clinical pharyngitis. Of the 454 patients, 118 (25.9%) had positive oropharyngeal cultures for GAS. TPSAP sensitivity was 89.9% (106 of 118) and specificity was 95.8% (322 of 336). We conclude that the TPSAP is specific enough to indicate treatment for a patient with a positive test but that a negative test should be confirmed by culture.

Streptococcal pharyngitis: a review of pathophysiology, diagnosis, and management

Pharyngitis is an illness frequently treated by emergency physicians and primary care practitioners. It is the subject of much controversy regarding optimal treatment in the acute care setting. This review discusses pertinent aspects of the pathophysiology, clinical features, diagnosis, and treatment based on available literature. This review is also meant to serve as a bibliographic resource for some of the controversies of this complex topic.

Comparison of direct specimen testing utilizing TestPack strep A with testing of specimens following a two-hour broth enrichment

In a previous study, we demonstrated that a 2-h enrichment of throat swabs in broth followed by a direct fluorescent antibody test was significantly more sensitive than the Abbott TestPack Strep A for the detection of group-A streptococci. In this study, in an effort to simplify the technique, we utilized broth enrichment with an enzyme immunoassay detection method. A total of 1017 pharyngeal specimens were tested with TestPack Strep A (DTP), culture on a selective streptococcal agar, and a 2-h broth enrichment in Todd-Hewitt broth (THB) followed by TestPack Strep A (ETP). Subculture of the THB was used to arbitrate discordant test results. The sensitivities and specificities respectively were as follows: DTP (69% and 99%), ETP (90% and 98%), and SSA (97% and 100%). This enrichment method offers significantly greater sensitivity than direct testing for antigen yet still allows the potential for finalized same-day reporting of results.

Verification bias in pediatric studies evaluating diagnostic tests

Improperly designed evaluations of diagnostic tests may lead to inaccurate conclusions about a test's accuracy. One problem, verification bias, occurs if subjects are not equally likely to have the diagnosis verified by a gold-standard evaluation and if selection for further evaluation is dependent on the diagnostic test result. To determine whether verification bias is a problem in pediatric studies of diagnostic tests, we conducted a critical appraisal of all studies evaluating diagnostic tests published in three pediatric journals during a 3-year period. Thirty-six percent were subject to verification bias. The most prevalent cause was restriction of the patient sample to those whose diagnosis had been verified by a gold standard evaluation, when the decision to obtain the gold standard was influenced by the diagnostic test result. Verification bias may have serious effects on the estimated sensitivity and specificity of a test. Improved awareness of the potential for verification bias may help physicians improve their selection and interpretation of diagnostic tests and thereby improve the quality and efficiency of patient care.

Comparison of three methods for detection of group A streptococci in throat swabs

Group A streptococci are generally detected in throat swabs by (i) rapid antigen tests, (ii) conventional culture, or (iii) combinations of both. Direct fluorescent-antibody testing of a 2-h enrichment broth (FA/EN) was an accepted method for same-day results before the advent of rapid antigen tests. We compared FA/EN in Todd-Hewitt Broth (THB) with conventional culture and a rapid antigen test, TestPack Strep A (TPS). Nine hundred seventy specimens were evaluated in this study. Cultures were performed for 48 h on sheep blood agar (SBA) incubated aerobically and on a selective agar for group A streptococci (SSA) incubated in 5 to 10% CO2. Following a 2-h incubation, the fluorescent-antibody test was performed. A subculture of the centrifuged sediment from the THB enrichment was also done. In comparison with a positive culture on SBA or SSA or subculture of the THB pellet, the sensitivities and specificities of the different methods were as follows: SBA, 92 and 100%; SSA, 92 and 100%; TPS, 68 and 99%; FA/EN, 88 and 98%. The FA/EN method offers the potential for definitive finalized reports on the same day as specimen collection with greater sensitivity than TPS. This study included sequential plating and rapid antigen testing of a single swab. In a separate set of experiments to validate this study design, it was shown that recovery of streptococci from swabs plated sequentially on five plates did not vary with the order of plating and the actual proportion of organisms recovered from a swab on a single plate was only 1%.

Comparison of TestPack Plus Strep A with selective and nonselective culture media for detection of group-A streptococci

The TestPack Plus Strep A (TPPSA), an immunoassay method, was compared with conventional culture methods including nonselective trypticase soy agar with 5% sheep blood and selective SXT blood agar for detection of group-A streptococci (GAS). A total of 452 throat swabs was evaluated, of which 261 (57.7%) and 191 (42.3%) were compared with culture using nonselective and selective media, respectively. Of 261 specimens evaluated on nonselective media, 71 (27.1%) were culture positive for GAS. TPPSA demonstrated a sensitivity of 91.6% and a specificity of 94.2% with positive and negative predictive values of 85.5% and 96.8%, respectively. Of 191 specimens evaluated on selective media, 44 (23.0%) were culture positive for GAS. TPPSA demonstrated a sensitivity of 93.2% and a specificity of 98.0% with positive and negative predictive values of 93.2% and 98.0%, respectively. The performance of TPPSA when compared with nonselective and selective media demonstrated a similar sensitivity, but a higher specificity was seen when compared to selective media. Overall, TPPSA was extremely easy to perform, had built-in procedural controls, required minimal technologist time, and was easy to interpret. With an accuracy of 93.5% when compared with nonselective media and 96.9% when compared with selective media, TPPSA could be recommended as a reliable method for detection of GAS.

Evaluation of the modified Visuwell Strep-A enzyme immunoassay for detection of group-A Streptococcus from throat swabs

The modified Visuwell Strep-A enzyme immunoassay (EIA) was compared with culture for detection of group-A Streptococcus from throat swabs. Throat swabs in modified Stuarts medium obtained after culture at two institutions were tested in Visuwell. Cumulative results were n = 417, sensitivity 87.8%, specificity 89.9% predictive value positive (PVP) 67.9%, predictive value negative (PVN) 96.8%, and accuracy 89.5%. At another site, swabs were delivered to the laboratory without transport medium, cultured, and subsequently tested by Visuwell (n = 202, sensitivity 79.6%, specificity 84.5%, PVP 65.2%, PVN 91.9%, accuracy 83.2%). When 1+ culture-positive specimens were considered negative, the sensitivity and PVN increased from 79.6% to 90.2% and 91.9% to 97.1% respectively. Overall performance of the modified Visuwell was comparable with that of the initial assay for throat swabs transported with or without modified Stuarts medium. Cross reaction with organisms other than group-A Streptococcus normally found in the oropharynx was negligible in Visuwell and the limit of detection of group-A Streptococcus was 5 x 10(4) colony-forming units.

Detection of group A streptococci by aerobic culture and a new simplified immunoassay in three pediatric practices and a hospital laboratory

Duplicate throat swabs for detection of group A streptococci were collected in three pediatric offices from 1,035 patients with symptoms of pharyngitis. In the collecting office and in the hospital laboratory, one swab from each patient was first inoculated to sheep blood agar (incubated at 35 degrees C aerobically for 2 days) and then tested for group A streptococcal antigen by using the SMART enzyme immunoassay technique (New Horizons Diagnostics Corp) incubated for up to 24 hours. Group A streptococci were recovered in culture (from one or both swabs) and serologically identified from 444 (42.9%) of the patients. Pediatric offices numbers 1, 2, and 3 detected 84.4%, 84.6%, and 82.2%, respectively, of their patients who had positive cultures (in the office and/or laboratory) by using their own culture system and 82.6%, 71.1%, and 84.9%, respectively, of these same patients by using the SMART technique. In the laboratory, SMART test sensitivity and specificity were 71.4% and 98.7%, respectively, after 5 minutes of test incubation. However, SMART test sensitivity improved to 86.5% after overnight incubation of the immunoassay and to 91.3% if the data from one defective lot of seven SMART production lots studied were excluded. SMART test results which are negative after 5 minutes of incubation should therefore be confirmed both by reincubation of the antigen test up to 24 hours and by culture.

Detection of group A streptococcal antigen from throat swabs with five diagnostic kits in general practice

During a 5-month period, 248 general practitioners from 164 general practice offices obtained duplicate throat swabs from 2469 patients with acute pharyngotonsillitis. At the general practice office, one of the swabs was assayed for the presence of group A streptococcal antigen, using one of five commercially available diagnostic kits. (The participants did not receive instruction in the use of the kits). The other swab was cultured in our laboratory for the presence of group A streptococci. The diagnostic parameters for the five kits were as follows: Abbott TestPack Strep A--sensitivity, 79% (110/139) and specificity, 98% (490/501); Direct Strep A EIA (Roche)--sensitivity, 79% (104/132) and specificity, 63% (178/281); Respirastick--sensitivity, 55% (46/84) and specificity, 96% (298/309); Reveal Colour Strep A--sensitivity, 82% (114/139) and specificity, 83% (223/268); Tandem ICON Strep A--sensitivity, 78% (111/143) and specificity, 98% (362/368). The antigen detection test results were heavily influenced by the clinical prediction of a streptococcal or viral etiology. It is concluded that in the absence of a standard throat culture, the Abbott TestPack Strep A kit and the Tandem ICON Strep A kit both offer a more safe diagnostic alternative than clinical assessment. Depending on the current prevalence of group A streptococci, the additional use of a throat swab culture should be considered in case of negative antigen detection test results.

Evaluation of two ELISA tests for the rapid detection of group A streptococci

We examined 579 oropharyngeal swab specimens from children presenting with pharyngitis in order to compare two rapid diagnostic ELISA tests for group A streptococcal antigen: the TestPack Strep A (TPSA), and the Direct Strep A EIA (DSAE), with an anaerobically incubated sheep blood agar culture. The sensitivities of the methods were respectively 60.8% (TPSA) and 64.4% (DSAE), the specificities 98.3% (TPSA) and 93.2% (DSAE), the positive predictive values 88.6% (TPSA) and 70.3% (DSAE) and the negative predictive values 92.0% (TPSA) and 91.2% (DSAE). We conclude that the TPSA is easy to interpret and is sufficiently specific to initiate treatment in patients with a positive test. It is not sufficiently sensitive to ensure negative or intermediate results. The performance of the DSAE test is similar but the specificity is slightly lower and more false positive results occur.

Comparison of the Directigen 1-2-3 Group A Strep Test with culture for detection of group A beta-hemolytic streptococci

The Directigen 1-2-3 Group A Strep Test (DGAST; BBL Microbiology Systems, Cockeysville, Md.) was compared with conventional culture procedures on Trypticase soy agar with 5% sheep blood (BBL) and Selective Streptococcal Agar (ssA; BBL) for detection of group A beta-hemolytic streptococci (GABHS) for 1,006 patients complaining of sore throat. The DGAST was performed at five acute-care clinics according to the instructions of the manufacturer; interpretation of the cultures was done at the central microbiology laboratory. Of 924 patients with complete data, 243 (26.3%) were positive for GABHS on culture when both sheep blood agar and ssA were used. Of the patients with positive cultures, 159 were detected by the DGAST, yielding a sensitivity of 65.4%, a specificity of 84.7%, a positive predictive value of 60.5%, and a negative predictive value of 87.3%. The greater the number of colonies on culture, the greater the sensitivity of the DGAST, and the more intense the positive reaction on the DGAST, the higher the positive predictive value of the test. For the identification of GABHS, sheep blood agar was superior to ssA by 12.9% at 24 h and by 3.4% at 48 h of incubation.