Clinical validation of full genotyping CLART® HPV4S assay on SurePath and ThinPrep collected screening samples according to the international guidelines for human papillomavirus test requirements for cervical screening

Evaluation of the Allplex HPV assay's adherence to international guidelines for cervical cancer screening in clinician-collected samples

Clinically validated human papillomavirus (HPV) assays are crucial in cervical cancer screening. In this study, we evaluated the Allplex HPV HR Detection assay (Seegene, SouthKorea) for its clinical accuracy and reproducibility according to the international criteria, using the RealTime High Risk HPV m2000 assay (Abbott, USA) as standard comparator. The Allplex HPV HR assay exhibits significant non-inferior sensitivity to detect cervical intraepithelial neoplasia grade (CIN) 2 or worse (CIN2+) with a ratio of 1.00 (95% CI: 0.97-1.03, P = 0.006), insignificant non-inferior sensitivity to detect CIN3+ with a ratio of 1.00 (95% CI: 0.88-1.13, P = 0.098), and non-inferior specificity to exclude CIN2+ with a ratio of 0.99 (95% CI: 0.99-1.00, P < 0.001) compared to the standard comparator. In addition, the assay shows an excellent reproducibility within the same laboratory [96.5% (95% CI: 94.6-97.9) with a kappa value of 0.91 (95% CI: 0.87-0.95)] and between laboratories [96.7% (95% CI: 94.8-98.0) with a kappa value of 0.91 (95% CI: 0.87-0.95)] for overall high-risk HPV positivity as well as for each individual HPV type. Pooling our study data with those of another independent study supports the consistency of our findings. We conclude that both the clinical accuracy to detect cervical precancer and the reproducibility of Allplex HPV HR Detection assay fulfill the international validation criteria of use in cervical cancer screening.IMPORTANCEThe clinical validation of human papillomavirus (HPV) assays in accordance with well-established international guidelines is crucial to ensure that only validated assays are used in the context of screening (Meijer et al., Int J Cancer, 2009). The guidelines, developed by an international consortium, require that a novel HPV assay has non-inferior accuracy against a standard comparator test for the detection of cervical intraepithelial neoplasia grade (CIN) 2 or worse (CIN2+). Additionally, a new HPV assay should meet specific criteria for both intra- and inter-laboratory reproducibility to ensure the assay consistently exhibits technical precision and robust performance. Pooling our study data with those of another independent study supports the consistency of our findings. In conclusion, both the clinical accuracy to detect cervical precancer and the reproducibility of Allplex HPV HR Detection assay fulfill the international validation criteria of use in cervical cancer screening.

Allplex HPV HR Detection assay fulfils all clinical performance and reproducibility validation requirements for primary cervical cancer screening

Human papillomavirus (HPV)-based screening offers better protection against cervical cancer compared to cytology, but HPV screening assays must adhere to validation requirements of the international guidelines to ensure optimal performance. Allplex HPV HR Detection (Allplex) assay, launched in the late 2022, is a fully automated real-time PCR-based assay utilizing innovative technology that enables quantification and concurrent distinction of 14 high-risk HPV genotypes (HPV16,18,31,33,35,39,45,51,52,56,58,59,66 and 68). We assessed the validity of the Allplex for cervical cancer screening purposes, via comparison to a clinically validated comparator assay (Hybrid Capture 2; HC2), and through assessment of intra-laboratory reproducibility and inter-laboratory agreement. A clinical validation panel comprised of 973 residual ThinPrep samples was obtained from women aged 30-64 years participating in the organized Slovenian screening program, of these 863 were from women undergoing their regular screening visit after a previous negative screen test while 110 were from women with underlying cervical intraepithelial neoplasia grade 2 or worse (CIN2+) lesions. The Allplex's relative clinical sensitivity for detection of CIN2+ and CIN3+ were 1.01 (95%CI;0.98-1.04) and 0.98 (95%CI;0.95-1.02), compared to that of HC2. At recommended thresholds of ≥98% and ≥90%, the Allplex's clinical sensitivity and specificity (p=0.0004 and p=0.02, respectively) were non-inferior to HC2. High intra-laboratory reproducibility and inter-laboratory agreement, both overall (98.1% and 97.9%, respectively) and at genotype level (>98.7%) was observed. In addition, analytical genotype-specific performance of Allplex was compared to that of its predecessor Anyplex HPV HR; high overall agreement was observed (96.3%; kappa value 0.88), with some variations in performance. In conclusion, Allplex met all validation criteria described in the international guidelines on sensitivity, specificity and laboratory reproducibility and can be considered clinically validated for primary cervical cancer screening.

The Clinical Utility of Circulating HPV DNA Biomarker in Oropharyngeal, Cervical, Anal, and Skin HPV-Related Cancers: A Review

Human papillomavirus (HPV) is recognized as being related to a wide variety of known cancers: cervical, oropharyngeal, anal, vaginal, penile, and skin. For some of these cancers, rigorous algorithms for screening, therapeutical interventions, and follow-up procedures have been established. Vaccination using the nonvalent anti-HPV vaccine, which prevents infection regarding the most frequently involved high-risk HPV types (16, 18, 31, 33, 45, 52, and 58) and low-risk HPV types (6 and 11), has also extensively prevented, controlled, and even eradicated HPV infections. Still, even with all of these multidisciplinary interventions, the burden of HPV cancers is still high worldwide. The circulating DNA of HPV-induced cancers is thought to be an adequate biomarker for optimizing the control of these virus-related cancers. We analyzed the literature published in the last 5 years regarding ctDNA and four of the above-mentioned cancers. The most frequently used assay for ctDNA detection was the droplet digital PCR assay, used for the management of therapy in the late stages of cancer. ctDNA could not be used for early detection in any of the studied cancers. The OPSCCs were the most frequent cancers analyzed via ctDNA assays. Larger, properly designed cohort studies might establish the clinical utility of this biomarker.

Papilloplex HR-HPV test has non-inferior clinical performance for detection of human papillomavirus infection: assessment using the VALGENT framework

AIM

The Papilloplex high-risk human papillomavirus (hrHPV) test (Genefirst, Oxford, UK) is a single tube real-time HPV test which provides multiplex detection and separate identification of 14 hrHPV types. Here, we present the clinical validation of the test in SurePath samples in comparison to a clinically validated reference test, the GP5+/6+Enzyme ImmunoAssay (GP5+/6+EIA) using the VALGENT (VALidation of HPV GENotyping Tests) framework.

METHODS

Clinical performance was assessed using 998 unselected, cervical screening samples enriched with 297 cytologically abnormal specimens (100 atypical squamous cells of unspecified significance, 100 low-grade squamous intraepithelial lesions, 97 high-grade squamous intraepithelial lesions). Cases were defined as women diagnosed with histologically confirmed cervical intraepithelial neoplasia two or more (≥CIN2, N=119) and controls defined as women with two subsequent negative cytology results (N=834).

RESULTS

The Papilloplex HR-HPV test has non-inferior sensitivity for detection of cervical precancer (p=0.0001 for ≥CIN2 and p=0.0005 for ≥CIN3) and non-inferior specificity, compared with GP5+/6+EIA (pni=0.0167)). The assay also showed excellent or good agreement for overall hrHPV and nearly all individual HPV types as compared with GP5+/6+EIA/Luminex.

CONCLUSION

The Papilloplex HR-HPV applied on cervical specimens stored in SurePath medium fulfils the international clinical accuracy criteria for use in cervical cancer screening.

Does full HPV genotyping perform similarly well in clinician-collected cervical samples and self-collected vaginal samples when using the CLART HPV4S assay?

BACKGROUND

Studies comparing self-collected vaginal samples with clinician-collected cervical samples with respect to high-risk human papillomavirus (HPV) detection and genotype agreement based on clinically validated full HPV genotype assays (e.g. the CLART HPV4S) are limited. This study compared the two types of samples using the CLART assay with respect to HPV detection and genotype agreement in a referral population.

METHODS

A total of 212 women aged 30-59 years and diagnosed with atypical squamous cells of undetermined significance (ASC-US) within the Danish cervical cancer screening programme had a cervical sample taken at their general practitioner. Afterwards, the women took a vaginal sample with the Evalyn Brush device at home. The paired samples were HPV-tested with the full genotyping CLART HPV4S assay. Histological results, i.e. cervical intraepithelial neoplasia of grade 2 or worse (CIN2+) were available for 14 women with HPV-positive clinician-collected samples.

RESULTS

The study found the same HPV prevalence in self-collected vaginal samples compared to clinician-collected cervical samples (19.3%, 95% CI 14.3-25.3% vs 18.4%, 95% CI 13.4-24.3%). The CLART HPV4S assay detected approximately the same number of CIN2+ cases in the self-collected vaginal samples compared to the clinician-collected cervical samples (13 vs 11 cases). Exactly the same genotypes were detected in 75% (21/28) of the HPV-positive paired samples, while at least one identical genotype was found in the remaining 25% (7/28) of the paired samples.

CONCLUSIONS

The CLART HPV4S assay performed similarly well in self-collected vaginal samples as in clinician-collected cervical samples with respect to both HPV detection and genotype agreement when using the Evalyn Brush and the CLART HPV4S assay in a referral population. Although further evaluation is needed, the findings suggest that full HPV genotyping based on the CLART assay can be useful when establishing HPV genotype-specific referral strategies for women tested HPV-positive by self-sampling.

Clinical Validation of the Fully Automated NeuMoDx HPV Assay for Cervical Cancer Screening

The NeuMoDx HPV assay is a novel fully automated, real-time PCR-based assay for the qualitative detection of high-risk human papillomavirus (HPV) DNA in cervical specimens. The assay specifically identifies HPV16 and HPV18 and concurrently detects 13 other high-risk HPV types at clinically relevant infection levels. Following the international guidelines, the clinical performance of the NeuMoDx HPV assay for cervical intraepithelial neoplasia grade 2 or worse (CIN2+) against the reference standard Hybrid Capture 2, as well as intra- and inter-laboratory reproducibility were assessed on PreservCyt samples. The clinical accuracy of the assay was additionally evaluated against the clinically validated Alinity m HR HPV and COBAS 4800 HPV Test on PreservCyt samples, and against the clinically validated HPV-Risk assay on SurePath samples. The NeuMoDx HPV assay performance for CIN2+ was non-inferior to the reference methods on both sample types (all p < 0.05), and showed excellent intra- and inter-laboratory reproducibility (95.7%; 95% CI: 93.9−97.3; kappa value 0.90 (95% CI: 0.86−0.94); and 94.5%; 95% CI: 92.6−96.2; kappa value 0.87 (95% CI: 0.82−0.92), respectively). In conclusion, the NeuMoDx HPV assay meets international guideline criteria for cross-sectional accuracy and reproducibility, and performs equally well on cervical screening specimens collected in two widely used collection media. The NeuMoDx HPV assay fulfils the requirements to be used for primary cervical screening.

Clinical Performance of the Full Genotyping Agena MassARRAY HPV Assay Using SurePath Screening Samples within the VALGENT4 Framework

The clinical performance evaluation of the novel MassARRAY human papillomavirus (MA-HPV) assay was performed using Danish SurePath cervical cancer screening samples under the fourth Validation of HPV Genotyping Tests (VALGENT) framework. The MA-HPV assay is a mass array-based assay that individually detects 14 oncogenic HPV genotypes and five nononcogenic types. The MA-HPV assay was validated using the VALGENT4 panel, which constitutes 997 consecutive samples from a screening population in addition to 297 disease-enriched samples with abnormal cytology findings. The clinical accuracy of the MA-HPV assay for sensitivity and specificity was assessed relative to that of the general primer 5+/6+ PCR enzyme immunoassay (GP-EIA), by a noninferiority test. The type-specific concordance of the MA-HPV assay was assessed as well. The relative sensitivity of the MA-HPV assay for cervical intraepithelial neoplasia ≥2 or ≥3 was 1.02 (95% CI, 0.98-1.05) and 1.01 (95% CI, 0.99-1.04), respectively. The sensitivity of the MA-HPV was noninferior to that of the GP-EIA (P = 0.0001), whereas the specificity of the MA-HPV was inferior (0.89; 95% CI, 0.85-0.91; P > 0.99). The MA-HPV assay is a clinical sensitive assay with a lower clinical specificity compared with the GP-EIA. The assay in its current form seems more suited to play a role where specificity is of lesser importance but where high sensitivity is paramount.

2020 list of human papillomavirus assays suitable for primary cervical cancer screening

BACKGROUND

Only clinically validated HPV assays can be accepted in cervical cancer screening.

OBJECTIVES

To update the list of high-risk HPV assays that fulfil the 2009 international validation criteria (Meijer-2009).

DATA SOURCES

PubMed/Medline, Embase, Scopus, references from selected studies; published in January 2014 to August 2020.

STUDY ELIGIBILITY CRITERIA

HPV test validation studies and primary screening studies, involving testing with an index HPV test and a comparator HPV test with reporting of disease outcome (occurrence of histologically confirmed cervical precancer; CIN2+).

PARTICIPANTS

Women participating in cervical cancer screening.

INTERVENTIONS

Testing with an index and a comparator HPV test of clinician-collected cervical specimens and assessment of disease outcome (

METHODS

Assessment of relative clinical accuracy (including non-inferiority statistics index vs comparator assay) and test reproducibility in individual studies; random effects meta-analyses of the relative clinical sensitivity and specificity of index vs comparator tests.

RESULTS

Seven hrHPV DNA tests consistently fulfilled all validation criteria in multiple studies using predefined test positivity cut-offs (Abbott RealTime High Risk HPV, Anyplex II HPV HR Detection, BD Onclarity HPV Assay, Cobas 4800 HPV Test, HPV-Risk Assay, PapilloCheck HPV-Screening Test and Xpert HPV). Another assay (Alinity m HR HPV Assay) was fully validated in one validation study. The newer Cobas 6800 HPV Test, was validated in two studies against Cobas 4800. Other tests partially fulfilled the international validation criteria (Cervista HPV HR Test, EUROArray HPV, Hybribio's 14 High-Risk HPV, LMNX Genotyping Kit GP HPV, MALDI-TOF, RIATOL qPCR and a number of other in-house developed assays) since the non-inferior accuracy was reached after a posteriori cut-off optimization, inconsistent accuracy findings in different studies, and/or insufficient reproducibility assessment. The APTIMA HPV Assay targeting E6/E7 mRNA of hrHPV was fully validated in one formal validation study and showed slightly lower pooled sensitivity but higher specificity than the standard comparator tests in seven screening studies. However, the current international validation criteria relate to DNA assays. The additional requirement for longitudinal performance data required for non-DNA based HPV assays was not assessed in this review.

CONCLUSIONS

Eleven hrHPV DNA assays fulfil all requirements for use in cervical cancer screening using clinician-collected specimens.

Collapse

Key Words

• Cervical cancer
• Cervical cancer screening
• Diagnostic test accuracy: validation of tests
• Human papillomavirus
• Meta-analysis
• Systematic review

Collapse

MESH Headings

• Alphapapillomavirus
• Early Detection of Cancer
• Female
• Genotyping Techniques
• Humans
• Papillomaviridae/isolation & purification
• Papillomavirus Infections/diagnosis
• Reproducibility of Results
• Sensitivity and Specificity
• Uterine Cervical Neoplasms/diagnosis
• Uterine Cervical Neoplasms/virology

Collapse

Grants

• 001 World Health Organization

Collapse

Affiliation(s)

Marc Arbyn Unit of Cancer Epidemiology, Belgian Cancer Centre, Scientific Institute of Public Health, Brussels, Belgium; Department of Human Structure and Repair, Faculty of Medicine and Health Sciences, University Ghent, Ghent, Belgium.
Marie Simon Haute Autorité de Santé, Saint Denis, France
Eliana Peeters Unit of Cancer Epidemiology, Belgian Cancer Centre, Scientific Institute of Public Health, Brussels, Belgium
Lan Xu Unit of Cancer Epidemiology, Belgian Cancer Centre, Scientific Institute of Public Health, Brussels, Belgium; School of Public Health, Shanghai Jiao Tong University School of Medicine, Shanghai, China
Chris J L M Meijer Department of Pathology, Amsterdam University Medical Centre, location VUMC, Amsterdam, the Netherlands
Johannes Berkhof Department of Clinical Epidemiology and Biostatistics, VU University Medical Centre, Amsterdam, the Netherlands
Kate Cuschieri Scottish HPV Reference Laboratory, Royal Infirmary of Edinburgh, Edinburgh, UK
Jesper Bonde Molecular Pathology Laboratory, Department of Pathology, Copenhagen University Hospital, Hvidovre, Denmark
Anja Ostrbenk Vanlencak Institute of Microbiology and Immunology, Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia
Fang-Hui Zhao Department of Cancer Epidemiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
Remila Rezhake Unit of Cancer Epidemiology, Belgian Cancer Centre, Scientific Institute of Public Health, Brussels, Belgium; Department of Cancer Epidemiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China; The 3rd Affiliated Teaching Hospital of Xinjiang Medical University (Affiliated Cancer Hospital), Urumqi, China
Murat Gultekin Hacettepe University Faculty of Medicine, Department of Obstetrics and Gynecology, Division of Gynaecological Oncology, Ankara, Turkey
Joakim Dillner Department of Laboratory Medicine, Karolinska Institutet, Stockholm, Sweden
Silvia de Sanjosé National Cancer Institute, Rockville, USA
Karen Canfell Cancer Research Division, Cancer Council NSW, Sydney, Australia; School of Public Health, University of Sydney, Sydney, Australia
Peter Hillemanns Departments of Gynaecology and Obstetrics, Hannover Medical School, Germany
Maribel Almonte International Agency for Research on Cancer, Lyon, France
Nicolas Wentzensen Division of Cancer Epidemiology and Genetics, National Cancer, Institute, Bethesda, MD, USA
Mario Poljak Institute of Microbiology and Immunology, Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia

Collapse

Clinical and analytical performance of the CLART HPV 4S assay with SurePath screening samples from the Danish cervical cancer screening program using the VALGENT framework

The CLART HPV4S (CLART4S) is a novel full genotyping assay, based on PCR/microarray technology. We assessed the clinical accuracy of the CLART4S assays under the fourth installment of the VALGENT framework. The VALGENT cohort comprised 998 consecutive cervical samples from women participating in the Danish screening programme enriched with 297 samples with abnormal cytology (100 ASCUS, 100 LSIL, 97 HSIL). The CLART4S assay detects 16 HPV genotypes individually: 14 oncogenic and two non-oncogenic HPV types. The GP5+/6+ PCR Enzyme-Immuno-Assay (GP-EIA) and GP5+/6+ PCR with Luminex genotyping (GP-LMNX) were used as comparator tests for clinical accuracy and HPV genotype concordance, respectively. The sensitivity for ≥ CIN2 for the CLART4S assay was 96.7 % (GP-EIA: 92.6 %) with a relative sensitivity of 1.04 (1.00-1.09). The sensitivity for ≥ CIN3 was 98.8 % (GP-EIA: 94.0 %), with relative sensitivity of 1.05 (1.00-1.10). The specificity for <CIN2 was 88.6 % (GP-EIA: 89.2 %) with a relative specificity of 0.99 (0.98-1.01). The CLART 4S was found to be non-inferior to that of GP-EIA for both sensitivity (p < 0.0001) and specificity (p = 0.0452). The overall oncogenic HPV concordance between CLART4S and GP-LMNX was high, however when looking at individual genotype agreement the concordance was more diverse, with the highest agreement found in the Screening population.

Urine collection in cervical cancer screening - analytical comparison of two HPV DNA assays

Background

To reach non-participants, reluctant to undergo clinician-based cervical cancer screening and vaginal self-sampling, urine collection for high-risk human papillomavirus detection (hrHPV) may be valuable. Using two hrHPV DNA assays, we evaluated the concordance of hrHPV positivity in urine samples in comparison with vaginal self-samples and cervical cytology samples taken by the general practitioner (GP). We also studied women’s acceptance of urine collection and preferences towards the different sampling procedures.

Methods

One hundred fifty paired self-collected urine and vaginal samples and GP-collected cervical cytology samples were obtained from 30 to 59-year-old women diagnosed with ASC-US within the Danish cervical cancer screening program. After undergoing cervical cytology at the GP, the women collected first-void urine and vaginal samples at home and completed a questionnaire. Each sample was hrHPV DNA tested by the GENOMICA CLART® and COBAS® 4800 assays. Concordance in hrHPV detection between sample types was determined using Kappa (k) statistics. Sensitivity and specificity of hrHPV detection in urine was calculated using cervical sampling as reference.

Results

With the COBAS assay, urine showed good concordance to the vaginal (k = 0.66) self-samples and cervical samples (k = 0.66) for hrHPV detection. The corresponding concordance was moderate (k = 0.59 and k = 0.47) using CLART. Compared to cervical sampling, urinary hrHPV detection had a sensitivity of 63.9% and a specificity of 96.5% using COBAS; compared with 51.6 and 92.4% for CLART. Invalid hrHPV test rates were 1.8% for COBAS and 26.9% for CLART. Urine collection was well-accepted and 42.3% of the women ranked it as the most preferred future screening procedure.

Conclusions

Urine collection provides a well-accepted screening option. With COBAS, higher concordance between urine and vaginal self-sampling and cervical sampling for hrHPV detection was found compared to CLART. Urinary hrHPV detection with COBAS is feasible, but its accuracy may need to be improved before urine collection at home can be offered to non-participants reluctant to both cervical sampling and vaginal self-sampling.