Sexually Transmitted Diseases:
Clinical Evaluation of the BD ProbeTec™ Neisseria gonorrhoeae Qx Amplified DNA Assay on the BD Viper™ System With XTR™ Technology
Van Der Pol, Barbara PhD, MPH*,†; Taylor, Stephanie N. MD‡; LeBar, William MS§; Davis, Thomas MD¶; Fuller, Deanna MS, MT(ASCP), CCRC¶; Mena, Leandro MD, MPH‖; Fine, Paul MD**; Gaydos, Charlotte A. DrPH††; Martin, David H. MD‡; Hook, Edward W. III MD‡‡,§§
From the *Indiana University Division of Epidemiology & Biostatistics, Bloomington, IN; †Indiana University School of Medicine, Division of Infectious Diseases, Indianapolis, IN; ‡Section of Infectious Diseases, Louisiana State University Health Sciences Center, New Orleans, LA; §Department of Pathology, University of Michigan, Ann Arbor, MI; ¶Wishard Health Services, Indianapolis, IN; ‖Planned Parenthood Houston, Houston, TX; **University of Mississippi, Jackson, MS; ††Department of Medicine, Johns Hopkins University, Baltimore, MD; ‡‡University of Alabama at Birmingham, Birmingham, AL; and §§Jefferson County Department of Health, Birmingham, AL
Supported by BD Diagnostics, Sparks, MD.
Correspondence: Barbara Van Der Pol, PhD, MPH, Indiana University Division of Epidemiology & Biostatistics, 1025 E Seventh Street, Suite 112, Bloomington, IN 47405. E-mail: firstname.lastname@example.org.
Received for publication May 31, 2011, and accepted September 7, 2011.
Supplemental digital content is available for this article. Direct URL citations appear in the printed text, and links to the digital files are provided in the HTML text of this article on the journal's Web site (http://www.stdjournal.com).
Background: The excellent sensitivity and specificity of commercially available nucleic acid amplification tests (NAATs) for the identification of Neisseria gonorrhoeae have been demonstrated. This study evaluated the performance of the BD ProbeTec™ N. gonorrhoeae Qx (GCQ) Amplified DNA Assay on the BD Viper™ System with XTR™ Technology in a multicenter study.
Methods: Specimens were collected at 7 geographically diverse clinical sites from 1846 women and men attending sexually transmitted disease, family planning, and obstetrics and gynecology clinics. There were 1768 evaluable participants, 994 women and 774 men. GCQ results from female endocervical, self-collected vaginal, male urethral swab specimens, and male and female neat (unpreserved) urine specimens, as well as those obtained using the urine preservative transport (UPT) tube for the GCQ assay were compared with patient infected status (PIS). For each participant, PIS was determined based on the combined results from the reference assays Aptima Combo 2® (AC2) and BD ProbeTec™ ET GC Amplified DNA Assay (PT).
Results: The sensitivity versus PIS for endocervical, vaginal, and female UPT urine, and female neat urine samples was 98.5%, 100.0%, 98.5%, and 96.9%, respectively; the specificity was 99.7%, 99.1%, 99.7%, and 99.5%, respectively. The sensitivity versus PIS for male urethral swabs and both male UPT and neat urine was 100.0%, with specificities of 99.1% for the urethral swab and UPT urine and 98.9% for the neat urine. The overall GCQ assay performance was not statistically different from that of AC2 or PT.
Conclusions: The GCQ assay demonstrated performance characteristics comparable with other commercially available nucleic acid–based tests such as AC2 and PT. Vaginal swabs, endocervical swabs, urethral swabs, and urine specimens may all be used for gonorrhea screening.
Since peaking in 1978 at over a million cases, reported gonorrhea rates in the United States have declined. Nonetheless, infections caused by Neisseria gonorrhoeae remain the second most common infection reported to the Centers for Disease Control and Prevention. In 2009, 301,174 cases were reported which, due to underreporting represent a likely incidence of more than 600,000 cases. 1 However, available data suggest that progress in efforts to control gonorrhea is slowing. In the decade between 1989 and 1999, reported US gonorrhea rates declined 48% from 690,042 cases to 360,831, whereas over the subsequent decade the rates declined only 17%, to 301,174 cases. Slowing declines in US gonorrhea rates as well as progressive development of antimicrobial resistance suggest that further emphasis on gonorrhea control is needed.
The starting point for control of any sexually transmitted disease (STD) is detection of infection to guide therapy for infected persons and their sexual partners. Nucleic acid amplification tests (NAATs) are more sensitive than traditional culture, permit more acceptable specimen collection for testing using voided urine or self-obtained vaginal swabs, 2–9 and are less susceptible to test performance problems due to specimen transport issues. Use of NAATs for diagnosis of gonococcal and chlamydial infections continues to evolve as manufacturers have developed tests which are both more accurate than earlier NAATs for STD diagnosis and which are technically easier to perform within the laboratory. While these improvements are well described for Chlamydia trachomatis assays, there are fewer studies of newer NAATs for diagnosis of N. gonorrhoeae infections. We report on the findings of a large, multicenter trial evaluating the recently improved BD N. gonorrhoeae Qx Amplified DNA Assay (GCQ) that can be run simultaneously with the chlamydia assay using a variety of specimen types as performed on a fully automated platform (Viper).
Participants were enrolled from 7 geographically diverse sites that included both traditionally high- and low-risk populations (Table S1, Supplemental Digital Content, online only, available at: http://links.lww.com/OLQ/A28). Consenting men and women between the ages of 16 to 64 years who presented with urogenital symptoms or were being screened for chlamydia (CT) and gonorrhea (GC) were enrolled between November 26, 2007 and March 21, 2008. Asymptomatic male enrollment continued until November 20, 2008.
After exclusions for protocol nonadherence and unavailable specimens, there were 994 women with evaluable results. Sixty-five women were excluded for inclusion/exclusion criteria violations (16), transport/storage errors (8), and for protocol deviations (41) in specimen collection or aliquoting. The number of men included after exclusion for nonadherence to protocol or unavailable specimens was 774. Thirteen men were excluded for inclusion/exclusion criteria violations (4), transport/storage errors (2), and specimen collection errors (7). Protocol violations resulting in exclusion included urination within an hour of specimen collection, taking antibiotics in the past 21 days, prior study enrollment, failure to provide informed consent or if they were below the age requirement approved by each site's Institutional Review Board. Three sites performed GCQ masked-testing for specimens collected at their own site and/or specimens that were referred from the other collection sites (Table S1, online only). Reference method testing was performed at 5 of the 7 clinical centers, and 2 sites served as specimen collection sites and performed no testing. One additional site served as a specimen testing site only and performed no collection.
Specimen Collection, Transport, and Storage
For each female participant, a first-catch, as opposed to midstream clean catch, urine sample was collected, followed by a self-collected vaginal swab, and then 3 clinician-obtained endocervical swabs collected with each manufacturer's collect kit. For each male participant, 2 or 3 urethral swabs (collection center dependent but using the manufacturer's collection devices) were obtained followed by a first-catch urine collection. Swab collection order was randomized throughout the study to minimize the effect sample order on performance estimates. For female participants, 1 endocervical swab was tested on the reference Aptima Combo 2 (AC2) assay, 1 was tested on the reference PT assay with an amplification control, and the third swab was tested using the GCQ assay. Self-collected vaginal swabs were tested only with the GCQ assay. For the male participants from whom only 2 swabs were collected, the reference method was randomized at the collection stage to either the PT or the AC2 assay and the other swab specimen was always evaluated using the GCQ assay. Endocervical, vaginal, and urethral swabs for the PT and AC2 assays were stored and tested according to their respective manufacturer's package inserts as described previously. 10–12 For the GCQ assay, urethral and endocervical swabs were stored at 2 to 30°C for up to 14 days before testing. Vaginal swabs were stored at 2 to 30°C for up to 7 days before testing. These storage conditions are identical to those described in the PT package insert.
Urine volumes were recorded for all specimens and ranged from 20 to 69 mL with the lower limit set by study design and manufacturer's package inserts, whereas the upper limit was the maximum volume of the collection cup. Urine samples were divided into aliquots and tested with the urine specimen transport tube with the AC2 assay (UTT), the PT assay (UPT urine), and the GCQ assay with neat and UPT urine. Urine processing, storage and testing were performed in accordance with the respective manufacturer's package inserts.
The details of the GCQ assay are identical to those of the C. trachomatis Qx assay which has been described elsewhere. 13 Briefly, the steps of the assay are as follows. Samples are warmed to dissolve mucous and homogenize the specimen matrix. After cooling, the specimens were loaded onto the Viper which then performed all steps necessary for extraction and amplification of target DNA without further user intervention. 14 The GCQ assay targets the Pilin gene within the genome of N. gonorrhoeae, which is also the gene targeted by the PT assay. However, the 2 assays amplify and detect different sequences. The target sequences that are amplified/detected for the 2 assays are adjacent but do not overlap. Measurements of fluorescent signal were taken approximately once every minute over the course the amplification process and positive/negative results were determined by comparing the maximum relative fluorescent signal (MaxRFU) obtained from a given specimen to a predetermined threshold.
Determination of Patient Infected Status
The definition of the patient infected status (PIS) for evaluation of GCQ performance was based on the reference swab and urine specimen results obtained using the PT assay (DNA target) and AC2 assay (16S rRNA target) which allowed for 4 reference results, 2 from each system. The definition specified by the Food and Drug Administration for submission considered a participant infected with N. gonorrhoeae if a minimum of 1 positive result was reported by each of the reference NAAT assays (i.e., a positive from both the PT assay and AC2 assay). Sensitivity analyses were performed as part of this study to assess the impact of alternate methods for defining PIS. For assay comparison, the performance characteristics of each reference method were estimated by using a PIS defined by a positive from each of the other 2 assays (i.e., AC2 estimates were derived by comparison with a PIS that required a positive result from both the PT and GCQ assays, PT estimates were derived by comparison with a PIS that required a positive result from both the GCQ and AC2 assays). This method of a “rotating” PIS standard has been suggested as a useful means of evaluating relative assay performance. 15
For analysis, specimens were categorized by gender, presence, or absence of genitourinary symptoms and specimen type. The performance characteristics of the GCQ assay were calculated for each category by comparing assay results with PIS. Exact confidence intervals (95% confidence level) were calculated based on the binomial distribution. Comparison of performance, sensitivity, and specificity estimates were completed using logistic regression with Hochberg adjustment for multiple comparisons. Alpha = 0.05 was used for all analyses.
A total of 1846 participants were enrolled in the study from 7 sites. After excluding ineligible participant specimens, data for 1768 participants (6284 specimens) were available for analysis. There were 994 women (56%) and 774 men (44%). Genitourinary symptoms suggestive of a sexually transmitted infection (burning/pain upon urination, abnormal discharge, coital pain/difficulty/bleeding, testicular, or scrotum pain/swelling) were present in 544 women (55%) and 257 men (33%). Twenty-seven female participants were known to be pregnant. Of the 774 male participants, 95 (12%) had only 2 urethral swabs collected while the remainder provided 3 urethral swabs.
Gonococcal infection was identified in 6.5% (65/994) women with 58.5% (38/65) of these infections occurring in symptomatic women. The presence or absence of symptoms had no significant effect on gonorrhea prevalence; 6.9% (38) of 544 symptomatic women had gonorrhea, whereas among asymptomatic women gonorrhea prevalence was 6% (27/450). In contrast, the overall prevalence in men was 14.5% (112/774), with the majority of infections 89.3% (100/112) identified from men with symptoms. Across sites, the prevalence of gonococcal infection in the study populations ranged from 1.4% to 19.2% in women and 4.8% to 40.5% in men (Table S1, online only). The effect of collection site was only significant for the female neat urine, with a P value of 0.044. The remaining specimen types across collection sites had P values ranging from 0.0853 to 0.708. For the GCQ assay, there was no statistical difference in performance based on symptomatic status or specimen type for either men or women (P values 0.249–0.8444).
Comparison of All NAATs
The results obtained with the rotating PIS for the PT and AC2 assays are shown in comparison to the estimates for GCQ stratified by specimen type and symptom status in Table 1. Additional analyses were performed to compare sensitivity and specificity of the GCQ, PT, and AC2 assays. The GCQ assay using female urine had significantly higher sensitivity than either the AC2 and PT assays (P = 0.023 and 0.027, respectively). (Fig. 1A). There were no significant differences in sensitivity for endocervical swabs or in specificity for endocervical swabs, urethral swabs, and male urines (Figs. 1A, 2A). There were no differences in the specificity of any of the assays or sample types (Figs. 1B, 2B).
Individual Female Specimen Performance
Sensitivity of the GCQ assay versus the PIS for endocervical swabs was 98.5% (64/65) (Table 1). Self-collected vaginal swabs identified 65/65 (100.0%) of all infections defined by the PIS, whereas urine samples detected 63/65 (96.9%) for neat and 64/65 (98.5%) for UPT in infected women. The specificity of the GCQ assay was at least 99.0% for each specimen type with an overall specificity of 99.5% across combined specimen types (Table 1).
For the 65 women identified as infected using the Food and Drug Administration-required PIS to which GCQ was compared, 54 (83.1%) were positive by all tests for every specimen type, whereas the remaining 11 (16.9%) had between 1 and 4 negative results despite being defined as infected (Table S2, Supplemental Digital Content, online only, available at: http://links.lww.com/OLQ/A29). The overall sensitivity for combined female sample types is 98.5% (256/260) and overall specificity 99.5% (3692/3711).
Individual Male Specimen Performance
The sensitivity of the GCQ assay using male urethral swabs versus PIS was 100.0% (112/112) (Table 1). Specificity of the male urethral swab was 99.1% (647/653). Three of the 6 GCQ positive swabs (650/653) with negative PIS were also positive by one of the reference assays or another specimen type (Table S3, Supplemental Digital Content, online only, available at: http://links.lww.com/OLQ/A30). Male neat and UPT urine specimens also both had sensitivity of 100.0% (112/112). The GCQ assay specificity versus PIS for male UPT and unpreserved urine specimens were 99.1% (656/662) and 98.9% (655/662), respectively. Three of the 6 GCQ positive UPT and all 3 GCQ positive neat specimens with negative PIS were positive by another NAAT or another specimen.
The urine specimen volume requested from participants (men and women) was between 20 and 25 mL, but we processed specimens with volumes of up to 69 mL, which was the limit of the urine collection cup. Based on a previous report of the effect of urine volume on assay sensitivity, 16 an analysis was conducted to determine the impact of urine volume on the GCQ assay. Urine volume was not associated with false-negative results for either the neat or UPT urine specimen types: P values of 0.5627 and 0.7182 for neat and UPT urine, respectively (Table S4, Supplemental Digital Content, online only, available at: http://links.lww.com/OLQ/A31).
There were 21 initial indeterminate urine results (with failed amplification controls) from the PT of which 9 resolved as negative by repeat testing and 12 remained as indeterminate (shown as “I” in Tables S2 and S3, online only). All 21 specimens were negative by GCQ and AC2.
The GCQ assay for detection of gonococcal infection performed well for all specimens tested in this large multicenter study with sensitivities which were at least comparable with those of 2 other currently approved assays for gonorrhea detection. Using the PIS as the standard for comparison, in women vaginal, urine, and endocervical specimens tested using the CGQ detected 100%, 98.5%, and 98.5% of gonococcal infections, respectively. For men, the sensitivity of the GCQ was 100% for both urethral swab and urine specimens. In addition, the specificity of the GCQ assay was high, an important attribute in many locations as a result of declining national gonorrhea prevalence. For laboratorians, the Viper testing instrument, with its “walk away” performance, provides the potential to enhance specimen throughput while providing standardized, reliable test results. The instrument can be used with batch sizes of 48 or 96, thus meeting the needs of medium and high throughput laboratories. When used with the Viper instrument, this test provides relatively rapid (approximately 3.5 hours), reliable results for gonorrhea screening for 94 patient samples. 14
Assessment of test performance can be challenging. In part because multiple anatomical sites may be infected, it is clear that no single specimen will be uniformly positive for all patients with urogenital gonococcal infection. For this study, we incorporated 2 widely used assays that used molecular targets which were both different from each other and from the target used in the GCQ assay to establish a PIS for evaluation of test performance. Using the PIS to determine what proportion of persons with urogenital infections are detected with any specific specimen type is useful in consideration of what tests and specimen types should be used for screening for gonococcal infections. In addition, in studies in which more than 2 different types of assays are used to evaluate performance of newer tests, another possible benefit of such an approach is the opportunity to compare each of the assays used in a study in terms of their performance relative to one another using a rotating standard previously suggested by Martin et al. 15 for comparison of multiple assays. Using this approach to supplement our PIS directed assessment; we found that the GCQ assay performed as well or better than the PT or AC2 assays. In addition, for female samples, which tend to be more complicated to analyze, latent class analysis was performed to obtain an unbiased estimate of sensitivity and specificity (data not shown). These analyses estimated 100% sensitivity (both sample types) and 99.5% to 99.8% specificity, for swab and urines samples from women, respectively.
Several observations made in this study have direct relevance for clinical practice beyond the laboratory performance of the GCQ assay. We found that for at-risk women urogenital symptoms were unrelated to the prevalence of N. gonorrhoeae suggesting that decisions on testing practices should be determined by factors other than symptoms. This finding is consistent with the Centers for Disease Control and Prevention guidelines for STD diagnostics, 17 which recognize that NAATs perform equally well for screening and diagnostic purposes. This observation, combined with the ability to collect reliable specimens from patients of either gender without the need for genital examination or potentially uncomfortable swab specimens (i.e., voided urine or, for women, self-collected vaginal swabs), provides opportunities to simplify and therefore facilitate accurate screening for gonococcal infection.
While the ability to use voided urine for gonorrhea screening is an attribute of NAATs for gonorrhea diagnosis, on occasion patients may collect more than the requested volume of urine. Our analyses demonstrate that the GCQ assay performs as well for N. gonorrhoeae detection when specimens exceed the recommended amount, filling the entire collection cup, as when the recommended volume of urine (20–60 mL) is provided. Thus, the GCQ assay has the potential to obviate the need to qualify test results derived from patients who provide more than the recommended volume of urine for testing.
In summary, the GCQ assay for detection of N. gonorrhoeae infections in both men and women provides highly reliable diagnosis of symptomatic or asymptomatic infection. The Viper instrument for performing these assays represents a further advantage for this testing system, providing walk away NAAT testing, an appealing attribute for busy laboratories where staff are increasingly asked to look for ways to enhance specimen throughput and turnaround time.
1. Centers for Disease Control and Prevention. Sexually Transmitted Disease Surveillance 2009. Atlanta, GA: U.S. Department of Health and Human Services; 2010.
2. Shafer MA, Moncada J, Boyer CB, et al.. Comparing first-void urine specimens, self-collected vaginal swabs, and endocervical specimens to detect Chlamydia trachomatis and Neisseria gonorrhoeae by a nucleic acid amplification test. J Clin Microbiol 2003; 41:4395–4399.
3. Hsieh YH, Howell MR, Gaydos JC, et al.. Preference among female Army recruits for use of self-administered vaginal swabs or urine to screen for Chlamydia trachomatis genital infections. Sex Transm Dis 2003; 30:769–773.
4. Schachter J, McCormack WM, Chernesky MA, et al.. Vaginal swabs are appropriate specimens for diagnosis of genital tract infection with Chlamydia trachomatis. J Clin Microbiol 2003; 41:3784–3789.
5. Chernesky MA, Hook EW, Martin DH, et al.. Women find it easy and prefer to collect their own swabs to diagnose Chlamydia trachomatis and Neisseria gonorrhoeae infectitons. Sex Transm Dis 2005; 32:729–733.
6. Gaydos CA, Crotchfelt KA, Shah N, et al.. Evaluation of dry and wet transported intravaginal swabs in detection of Chlamydia trachomatis and Neisseria gonorrhoeae infections in female soldiers by PCR. J Clin Microbiol 2002; 40:758–761.
7. Rompalo AM, Gaydos CA, Shah N, et al.. Evaluation of use of a single intravaginal swab to detect multiple sexually transmitted diseases in active-duty military women. Clin Infect Dis 2001; 33:1455–1461.
8. Knox J, Tabrizi SN, Miller P, et al.. Evaluation of self-collected samples in contrast to practitioner-collected samples for detection of Chlamydia trachomatis, Neisseria gonorrhoeae, and Trichomonas vaginalis by polymerase chain reaction among women living in remote areas Sex Transm Dis 2002; 29:647–654.
9. Polaneczky M, Quigley C, Pollock L, et al.. Use of self-collected vaginal specimens for detection of Chlamydia trachomatis infection. Obstet Gynecol 1998; 91:375–378.
10. Chernesky MA, Martin DH, Hook EW III, et al.. Ability of new APTIMA CT and APTIMA GC assays to detect Chlamydia trachomatis and Neisseria gonorrhoeae in male urine and urethral swabs. J Clin Microbiol 2005; 43:127–131.
11. Gaydos CA, Quinn TC, Willis D, et al.. Performance of the APTIMA Combo 2 assay for detection of Chlamydia trachomatis and Neisseria gonorrhoeae in female urine and endocervical swab specimens. J Clin Microbiol 2003; 41:304–309.
12. Van Der Pol B, Ferrero DV, Buck-Barrington K, et al.. Multicenter evaluation of the BD ProbeTec ET system for detection of Chlamydia trachomatis and Neisseria gonorrhoeae in urine specimens, female endocervical swabs, and male urethral swabs. J Clin Microbiol 2001; 39:1008–1016.
13. Taylor SN, Van Der Pol B, Lillis R, et al.. Clinical Evaluation of the BD ProbeTec™ Chlamydia trachomatis Qx Amplified DNA Assay on the BD Viper™ System With XTR™ Technology. Sex Transm Dis 2011; 38:603–609.
14. Felder RA, Foster M, Lizzi M, et al.. Process evaluation of a fully automated molecular diagnostics system. JALA 2009; 14:262–268.
15. Moncada J, Chow JM, Schachter J. Volume effect on sensitivity of nucleic acid amplification tests for detection of Chlamydia trachomatis in urine specimens from females. J Clin Microbiol 2003; 41:4842–4843.
16. Martin DH, Nsuami M, Schachter J, et al.. Use of multiple nucleic acid amplification tests to define the infected-patient “gold standard|P' in clinical trials of new diagnostic test for Chlamydia trachomatis infections. J Clin Microbiol 2004; 42:4749–4758.
This article has been cited 2 time(s).
Journal of Clinical MicrobiologyPerformance of the Cepheid CT/NG Xpert Rapid PCR Test for Detection of Chlamydia trachomatis and Neisseria gonorrhoeaeJournal of Clinical Microbiology
Expert Review of Molecular DiagnosticsCobas (R) 4800: a fully automated system for the detection of Chlamydia trachomatis and Neisseria gonorrhoeaeExpert Review of Molecular Diagnostics
Supplemental Digital Content
© Copyright 2012 American Sexually Transmitted Diseases Association