OBJECTIVE: To examine the influence that type of medical training and number of biopsies have on sensitivity of colposcopically guided biopsies.
METHODS: Among 408 women with an adequate enrollment colposcopy and a diagnosis of cervical intraepithelial neoplasia (CIN) 3 or cancer (CIN 3+) over 2 years in the Atypical Squamous Cells of Undetermined Significance/Low-Grade Squamous Intraepithelial Lesions (ASCUS-LSIL) Triage Study, we evaluated factors influencing the sensitivity of the enrollment colposcopic procedure. We used contingency table analysis to examine confounding variables and χ2 tests to ascertain statistical significance.
RESULTS: Overall, 69.9% of women with a cumulative diagnosis of CIN 3+ had a “true-positive” enrollment colposcopically guided biopsy result of CIN 2 or worse (CIN 2+), the threshold that would trigger excisional therapy. The sensitivity of the procedure did not vary significantly by type of colposcopist. However, the sensitivity was significantly greater when the colposcopists took two or more biopsies instead of one (P<.01), a pattern observed across all types of colposcopists. Independent of the severity of the colposcopic impression, the frequency with which colposcopists took two or more biopsies instead of one varied (in descending order) from nurse practitioners to general gynecologists to gynecologic oncology fellows to gynecologic oncologists (P<.01).
CONCLUSION: Colposcopy with guided biopsy or biopsies detects approximately two thirds of CIN 3+. Although the sensitivity of the procedure does not differ significantly by type of medical training, it is greater when two or more biopsies are taken.
LEVEL OF EVIDENCE: II-2
The sensitivity of colposcopy for detecting cervical intraepithelial neoplasia 3 in women with atypical squamous cells of undetermined significance or low-grade squamous intraepithelial lesions cytology improves substantially when more than two biopsy samples are taken.
From the 1Division of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Department of Health and Human Services, Bethesda, Maryland; 2Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland; 3University of Washington School of Public Health and Community Medicine, Department of Epidemiology, Seattle, Washington; 4Department of Pathology, University of Washington, Seattle, Washington; 5Public Health - Seattle/King County, Washington; and 6Division of Cancer Prevention, National Cancer Institute, National Institutes of Health, Department of Health and Human Services, Bethesda, Maryland.
See related editorial on page 246.
* For a complete list of members of The Atypical Squamous Cells of Undetermined Significance/Low-Grade Squamous Intraepithelial Lesions Triage Study (ALTS) Group, see the Appendix.
Supported by the intramural program of the National Cancer Institute, National Institutes of Health, Department of Health and Human Services and contracts CN-55153, CN-55154, CN-55155, CN-55156, CN-55157, CN-55158, CN-55159, and CN-55105.
Some of the equipment and supplies used in this study were donated or provided at reduced cost by Digene Corporation (Gaithersburg, MD), Cytyc Corporation (Marlborough, MA), National Testing Laboratories (Fenton, MD), Denvu (Tucson, AZ), TriPath Imaging, Inc. (Burlington, NC), and Roche Molecular Systems, Inc. (Alameda, CA).
This article is a U.S. Government work and, as such, is in the public domain in the United States of America. The views expressed in this document are those of the authors and do not necessarily reflect those of the National Cancer Institute, National Institutes of Health or the U.S. Department of Health and Human Services.
Corresponding author: Vivien Webb Hanson, MD, University of Washington School of Public Health and Community Medicine, Department of Epidemiology, 4032 Burton Place West, Seattle, WA 98199; e-mail: firstname.lastname@example.org.
Currently, colposcopy is recommended for women with low-grade squamous intraepithelial lesion (LSIL) or worse cytology, or atypical squamous cells of undetermined significance (ASC-US) that persists or is associated with high-risk human papillomavirus (HPV) infection.1–3 The major purpose of colposcopy in the United States is to diagnose precancerous lesions (cervical intraepithelial neoplasia [CIN] 3, especially) that can be treated to prevent cancer. However, colposcopy is a subjective procedure with limited reliability and, in particular, is not optimally sensitive for detection of CIN 3.4–8 Reasons for the poor reproducibility of colposcopic impression and limited accuracy of colposcopically directed biopsy have been questioned for decades.6,9–15 One measure of the accuracy of colposcopically guided biopsy—concordance between cervical biopsy and subsequent, complete histologic diagnosis by conization, loop electrosurgical excision procedure (LEEP), or total hysterectomy—is known to be influenced by the severity of referral Pap test, patient age and menopausal status, visibility of the squamocolumnar junction, lesion size, and endocervical extension.16–19
Recent research has suggested that the limitations of the colposcopic examination can be reduced by taking additional biopsies. Two studies found that taking additional biopsies in quadrants where no lesion was visualized improved sensitivity of the overall colposcopic procedure (Sellors J, Qiao Y, Bao Y, Ren S, Lim J, Zhao F, et al. False-negative colposcopy: quantifying the problem. In: Book of Abstracts: 22nd International HPV Conference and Clinical Workshop 2005; 2005 April 30–May 6; Vancouver, B.C., Canada: UCSF; 2005. Poster Presentation P-490).20 These studies were conducted in underscreened populations and are perhaps not fully applicable to the United States. Additional concern has been expressed regarding the importance of training and experience in colposcopic examinations and the possibility of differences in accuracy among various types of clinicians ranging from primary care to referral practices.14,16,21–26
Within the context of a large clinical trial with several thousand colposcopic examinations and 2 years of follow-up, we were able to study the influences on sensitivity of colposcopic impression and colposcopically guided biopsy relative to a reference disease standard of histologic CIN 3+. In particular we evaluated the importance of varying types of medical training: nurse practitioners, general gynecologists, gynecologic oncology fellows, and gynecologic oncologists. We also examined the extent to which confounding or mediating factors such as the number of biopsies and patient characteristics could explain any differences or similarities in accuracy among types of medical training.
MATERIALS AND METHODS
The Atypical Squamous Cells of Undetermined Significance/Low-Grade Squamous Intraepithelial Lesions (ASCUS-LSIL) Triage Study (ALTS) was a randomized trial directed by the National Cancer Institute (National Institutes of Health, Bethesda, MD) that compared three triage strategies for women with ASCUS or LSIL. Details of the design, methods, and primary results of ALTS have been published extensively elsewhere.1,2,27 Briefly, women with ASCUS or LSIL cytology were recruited to participate in the study at four clinical centers: University of Alabama at Birmingham (Birmingham, AL), Magee-Womens Hospital of the University of Pittsburgh Medical Center Health System (Pittsburgh, PA), the Oklahoma University Health Sciences Center (Oklahoma City, OK), and the University of Washington (Seattle, WA). The National Cancer Institute and local institutional review boards approved the study. A total of 5,060 women enrolled in the study from January 1997 to December 1998. The ALTS participants were followed up at 6-month intervals for 2 years. Routine follow-up and exit visits concluded in January 2001.
At enrollment, the ALTS participants were referred to colposcopy depending on study arm. In the immediate colposcopy arm, all women had colposcopy at, or soon after, the enrollment, regardless of enrollment test results. In the HPV triage arm, women were referred to colposcopy if the enrollment HPV test was positive (56.4%) or missing (3.9%) or if the enrollment cytology was high-grade squamous intraepithelial lesion (HSIL), although cytology added almost no referrals. In the conservative management arm, women were referred to colposcopy if enrollment cytology was interpreted as HSIL. At the semiannual follow-up visits, regardless of randomization arm, colposcopic examinations were triggered only by HSIL cytology. At the exit visit, all women were scheduled for a colposcopic examination. Throughout the trial, women with histologic CIN 2 or worse as defined by the clinical center pathologists were treated by loop electrosurgical excision procedure (LEEP) or more extensive surgery if needed. At exit, women with persistent lower-grade lesions as well were offered LEEP to maximize safety after follow-up ended.
The enrollment examination included a pelvic examination with the collection of cells for cytology and HPV DNA testing as well as high-resolution photography of the cervix for visual screening (Cervicography, National Testing Laboratories, Fenton, MO). After liquid-based ThinPrep (Cytyc Corporation, Marlborough, MA) cytology slides were prepared, 4-mL aliquots of the residual PreservCyt samples were used for HPV DNA testing by Hybrid Capture 2 (Digene Corporation, Gaithersburg, MD). As mentioned, clinical management was based on the clinical center pathologists’ cytologic and histologic diagnoses. In addition, all cytology and histology slides were sent to the Pathology Quality Control Group for independent review. Pathology Quality Control Group histologic diagnoses were masked to cytology results and used in these data analysis to avoid center-specific variation (see below).
Colposcopic examinations were performed by nurse practitioner colposcopists, general gynecologists, gynecologic oncology fellows, or gynecologic oncologists. The standard protocol included conventional visual assessment, application of 5% acetic acid, identification of the squamocolumnar junction and transformation zone, recognition of suspected CIN lesions for biopsy and overall colposcopic impression. The overall colposcopic impression was categorized as normal or benign abnormality (cervicitis/atrophy/polyp), atypical metaplasia, low grade, and high grade or cancer. Clinicians were asked to take colposcopically directed cervical biopsies from the worst of any abnormal-looking areas. They were also asked to take additional biopsies from other areas suspicious for CIN. Endocervical curettage was performed according to the clinicians’ judgment, often in cases where the transformation zone or proximal extent of a cervical lesion was not adequately visualized.
Of the 5,060 women enrolled in ALTS, 2,773 had a colposcopic examination at enrollment or soon thereafter, depending on the results of the enrollment visit. We excluded from our analysis women whose enrollment colposcopic examination (n=13) or Pathology Quality Control Group diagnosis of the biopsy was unsatisfactory (n=19) or lacking (n=5). Women who had a colposcopic impression of low grade or worse but, contrary to protocol, had no Pathology Quality Control Group diagnosis of the biopsy at enrollment (n=46) were excluded. Also excluded were women attended to by a clinician with unrecorded medical training (n=7) or medical training outside the four main types considered in this study (n=8, family practitioners).
We compared accuracy of enrollment colposcopic impression and colposcopically guided biopsy results among nurse practitioners, general gynecologists, gynecologic oncology fellows, and gynecologic oncologists. Endocervical curettage results were not considered, because they detected CIN 3+ in only 1–2% of women for whom biopsies were false-negative. Due to considerable variability among the diagnostic tendencies of pathologists from different clinical centers that confounded the results, we used the standardized Pathology Quality Control Group results. For calculations of sensitivity in detection of precancer, we categorized as “biopsy-positive” any biopsy at enrollment diagnosed by Pathology Quality Control Group as CIN 2+, because less severe diagnoses would not have triggered sufficiently intensive management.
The histologic disease outcome for this analysis included CIN grade 3 and cancer (n=5) as diagnosed by Pathology Quality Control Group for a woman at any time during ALTS. We chose this definition because CIN 3 provided a scientifically rigorous endpoint for analysis.1,2,28 Cervical intraepithelial neoplasia 3+ cases were evenly distributed by study arm over the 2-year study period, unlike less reproducible and more transient CIN 2 lesions exhibiting a wider range of HPV DNA results. Differences in CIN 3+ by study arm were shown to be differences in diagnosis time, not representing incident lesions. Rather, diagnoses during follow-up represented missed prevalent cases.1
We examined primarily the influence of the independent variables, number of biopsies taken and medical training, on the dependent variable, sensitivity of the colposcopically guided biopsies. We took into account possible confounding or mediating variables such as age, oral contraceptive pill (OCP) use, parity, enrollment cytology result, Hybrid Capture 2 result, colposcopic impression, study arm, and lesion size (when available) using standard contingency table analysis with χ2 and Fisher exact test statistics and P values. For improved statistical stability we dichotomized those variables that were not already binary: aged younger than 30 years compared with aged 30 years or older, OCP current users compared with past or never users, parity less than three compared with three or more, cytology of HSIL compared with less than HSIL, colposcopic impression of high grade compared with less than high grade, biopsy number of one compared with two or more. Analyses were performed using Stata 8.0 analytic software (Stata Corp LP, College Station, TX).
Among the analytical group of 2,675 women with adequate enrollment colposcopically guided biopsy results, the 2-year cumulative risk for Pathology Quality Control Group histology diagnosis of CIN 3+ at any time during ALTS was 15.3% (Table 1). Thirty-five clinicians conducted the examinations with more than one third (34.9%) performed by a nurse practitioner, 14.4% by a general gynecologist, 23.9% by a gynecologic oncology fellow, and 26.8% by a gynecologic oncologist. Clinics were staffed by clinicians with different types of medical training: the Pittsburgh study site had more general gynecologists, the Seattle site had mostly nurse practitioners, the Birmingham site had more gynecologic oncologists and both Birmingham and Oklahoma City had gynecologic oncology fellows (Table 1). Because clinic population characteristics and types of medical training covaried by center, patient characteristics differed among types of medical training. For example, patients seeing nurse practitioners (primarily in Seattle) were more likely to be current OCP users, nulliparous and have an enrollment HSIL cytology result, whereas those examined by general gynecologists were more likely to be older and to test negative for a high-risk HPV type by Hybrid Capture 2. Patients attended by a nurse practitioner or gynecologic oncology fellow had a slightly higher 2-year cumulative risk for CIN 3+. We assured that these patient differences did not affect the main conclusions in ancillary analyses discussed below.
Nurse practitioners were most likely to suspect some type of abnormality upon colposcopic evaluation (Table 1) and therefore had a higher sensitivity of colposcopic impression of atypia or worse for detection of 2-year cumulative diagnosis of CIN 3+ (Table 2). The sensitivity of a low-grade or high-grade colposcopic impression did not differ by type of clinician training (Table 2).
The tendency to take more than one biopsy varied by clinician type from (in descending order) nurse practitioners to general gynecologists to gynecologic oncology fellows to gynecologic oncologists. The practice of taking two or more biopsies as opposed to one also varied by colposcopic impression, because clinicians were more likely to take two or more biopsies when a worse lesion was suspected (Fig. 1, far right). Both factors, type of training and colposcopic impression, contributed to an increased tendency to take two or more biopsies (Fig. 1).
The sensitivity of Pathology Quality Control Group biopsy diagnosis from the enrollment colposcopic examination to detect 2-year cumulative CIN 3+ varied depending on the number of biopsies taken (Table 3). Sensitivity is defined as the percent of enrollment colposcopically guided biopsy procedures with a histology result of CIN 2 or more that would trigger LEEP among women eventually found to have CIN 3+. Among all women with a 2-year cumulative occurrence of CIN 3+, those who had only one biopsy were less likely to be diagnosed as having CIN 2 or worse by Pathology Quality Control Group (68.3%) than those who had two (81.8%) or three or more (83.3%) biopsies (comparing one with two or more biopsies, P<.01).
Table 4 examines the sensitivity of a colposcopically guided biopsy by type of medical training and number of biopsies taken. Of the five patients in this ALTS analysis that had cancer, 3 had CIN 2 or worse on their enrollment colposcopically guided biopsy as determined by Pathology Quality Control Group. The calculations of overall sensitivity include 26 women who were eventually found to have CIN 3+ but had no biopsy at enrollment because their colposcopic impression was normal or benign abnormality. Overall sensitivity among clinicians from different types of medical training showed only minor variability, ranging from 67.3% for gynecologic oncology fellows to 76.4% for general gynecologists. Across all types of medical training the sensitivity of colposcopically guided biopsy tended to be greater when two or more biopsies were taken as opposed to one, although these relationships were not statistically significant. When patients for whom no biopsy was taken were included, across all levels of medical training, sensitivity was significantly greater when taking two or more compared with zero or one biopsy (P<.03).
Because the demographic characteristics, screening test results, and colposcopic impression were associated with both type of medical training and biopsy taking as well as sensitivity, we controlled for age, OCP use, parity, enrollment cytology result, Hybrid Capture 2 result, and colposcopic impression through stratified analyses, and our findings remained consistent. In ALTS the best descriptive measure for lesion size is the total dimension score.28 This total dimension score was only analyzed for 246 women (60.3%) because most of the blocks from Seattle, where most nurse practitioners practiced, were not made available. We have no reason to suspect that Seattle had particularly large or small lesions. A trend toward improved sensitivity when two or more biopsies were taken was observed for all but the smallest lesions, but few numbers prevented a stable analysis.
We also looked at the effect of knowledge of cytology and HPV results at the time of colposcopy because sensitivity of the procedure varied considerably by study arm (58.8% in the immediate colposcopy arm, 79.5% in the HPV triage arm, and 80.5% in the conservative management arm, P<.01). In the immediate colposcopy arm, colposcopy was performed before any test results were available. In the conservative management arm, cytology results only were communicated to the clinician. In the HPV triage arm, clinicians were aware of cytology and HPV results. We found that for women with enrollment cytology findings of HSIL, clinician knowledge of the results at colposcopy led them to take more biopsies in the HPV triage and conservative management arms compared with the immediate colposcopy arm. Among HPV-positive women with a final outcome of CIN 3+, there was a suggestion of better targeting of lesions per biopsy (higher sensitivity) in the HPV arm compared with the other two arms (data not shown).
We found substantial improvement of colposcopically guided biopsy sensitivity when clinicians took more biopsies from colposcopically abnormal areas. This trend was observed across all types of medical training. While these findings suggest an important strategy to improve the accuracy of colposcopically guided biopsy with minimal effort, the appropriate location for additional biopsies remains unknown, because limited data are available to guide placement of additional biopsies. As a result of variation in the sensitivity of colposcopy, several authors have suggested taking multiple biopsies.9,10 Some studies suggest that high-grade lesions might not always be at the point of maximal colposcopic abnormality.20,24,29 The question of whether to take additional biopsies around the worst visualized lesion, from abnormal areas outside the worst lesion, from normal areas outside the lesion, or random biopsies of all quadrants even when no lesion is visualized, merits further research in a randomized controlled trial specifically designed to evaluate these aspects. The ALTS was not designed to examine the influence of biopsy-taking practices on sensitivity of colposcopically guided biopsy.
In addition, the best way to optimize taking of biopsies remains an issue. Colposcopy instructors can suggest ways to overcome concerns about taking multiple biopsies because instruments vary in size and sharpness. Frequent sharpening of the biopsy forceps decreases pain and tissue trauma. Proper waiting time after application of topical anesthesia and use of verbal reassurance seem to be helpful in reducing pain. Because the biopsies can be submitted in one vial, multiple sampling would not need to increase the cost of pathology. As an extreme, it would be wrong to conclude that LEEP should be used instead of biopsy because it provides the largest surface area for histology, because the procedure has been associated with uncommon, but significant, short-term and pregnancy complications.30–33
We have found in our clinical colposcopy instruction that most training does not specify if, or when, more than one biopsy should be taken. Although the ALTS protocol encouraged all clinicians to take additional directed biopsies of any suspected lesions, not all clinicians were equally likely to take additional biopsies. The nurse practitioners received training that encouraged additional biopsy-taking. Our data suggest that certain clinicians such as gynecologic oncologists, gynecologist fellows, and to a less degree, general gynecologists feel a greater assurance in their ability to adequately capture the worst lesions with one biopsy. In fact, gynecologic oncologists and gynecologic oncology fellows did have a relatively higher sensitivity on the first biopsy sample (data not shown), although this did not translate into higher sensitivity of the colposcopy procedure as a whole, because general gynecologists and in particular nurse practitioners took more biopsies resulting in comparable overall sensitivities.
There is a belief that clinicians take more biopsies in the beginning of their training and take fewer later in their career as the skill of colposcopic evaluation improves. Another common assumption is that types of medical training, from nurse practitioners to general oncologists to gynecologic oncologists, form a continuum that corresponds to expertise in performing colposcopy. Our findings contradict these notions, because the overall sensitivity of the colposcopy procedure was similar across types of medical training.
This study involved colposcopic examination of women with ASCUS or LSIL cytology and may not be generalizable among women with rarer cytology results such as atypical glandular cells, HSIL or atypical squamous cells, cannot exclude high-grade squamous intraepithelial lesion. Another limitation of this study is the infrequency with which clinicians other than nurse practitioners took two or more biopsies. However, there were consistent trends of increased sensitivity when taking two or more biopsies across types of clinician training and overall, a significant increase in overall sensitivity when taking two or more biopsies. We found that sensitivity was higher among women who were younger, with lower parity, worse cytology, HPV-DNA positivity, and high-grade colposcopic impression. Within levels of each of these variables, the sensitivity of the colposcopic examination still increased with more biopsies taken (although the trends were not always statistically significant). Although we cannot absolutely rule out that differences in sensitivity were due to unmeasured differences in clinic populations such as lesion size, visibility of squamocolumnar junction, or endocervical extension, the patterns were consistent across levels of measured, possible confounding variables.
These results show that across various types of medical training, colposcopic impressions and colposcopically guided biopsies demonstrate similar sensitivities. Colposcopy, like cytology and histology, is subjective, and the number of colposcopically guided biopsies taken is most strongly associated with sensitivity. As women are referred to colposcopy based on increasingly sensitive screening tests, there is a need to have a diagnostic examination with the best accuracy possible.
1. ASCUS-LSIL Triage Study (ALTS) Group. Results of a randomized trial on the management of cytology interpretations of atypical squamous cells of undetermined significance. Am J Obstet Gynecol 2003;188:1383–92.
2. ASCUS-LSIL Triage Study (ALTS) Group. A randomized trial on the management of low-grade squamous intraepithelial lesion cytology interpretations. Am J Obstet Gynecol 2003;188:1393–400.
3. Wright TC Jr, Schiffman M, Solomon D, Cox JT, Garcia F, Goldie S, et al. Interim guidance for the use of human papillomavirus DNA testing as an adjunct to cervical cytology for screening. Obstet Gynecol 2004; 103:304–9.
4. Ang MS, Kaufman RH, Adam E, Riddle G, Irwin JF, Reeves KO, et al. Colposcopically directed biopsy and loop excision of the transformation zone. Comparison of histologic findings. J Reprod Med 1995; 40:167–70
5. Cox JT, Schiffman M, Solomon D; ASCUS-LSIL Triage Study (ALTS) Group. Prospective follow-up suggests similar risk of subsequent cervical intraepithelial neoplasia grade 2 or 3 among women with cervical intraepithelial neoplasia grade 1 or negative colposcopy and directed biopsy. Am J Obstet Gynecol 2003;188:1406–12.
6. Ferris DG, Litaker M; ALTS Group. Interobserver agreement for colposcopy quality control using digitized colposcopic images during the ALTS trial. J Low Genit Tract Dis 2005;9:29–35.
7. Ji HX, Yliskoski M, Vayrynen M, Hippelainen M, Syrjanen S, Syrjanen K. Colposcopic analysis of genital human papillomavirus infections during an 8-year prospective follow-up. Int J Gynaecol Obstet 1991 Dec; 36:291–300.
8. Sideri M, Spolti N, Spinaci L, Sanvito F, Ribaldone R, Surico N, et al. Interobserver variability of colposcopic interpretations and consistency with final histologic results. J Low Genit Tract Dis 2004;8:212–6.
9. Benedet JL, Anderson GH, Boyes DA. Colposcopic accuracy in the diagnosis of microinvasive and occult invasive carcinoma of the cervix. Obstet Gynecol 1985;65:557–62.
10. Hopman EH, Voorhorst FJ, Kenemans P, Meyer CJ, Helmerhorst TJ. Observer agreement on interpreting colposcopic images of CIN. Gynecol Oncol 1995;58:206–9.
11. Hopman EH, Kenemans P, Helmerhorst TJ. Positive predictive rate of colposcopic examination of the cervix uteri: an overview of literature. Obstet Gynecol Surv 1998;53:97–106.
12. Kierkegaard O, Byralsen C, Hansen KC, Frandsen KH, Frydenberg M. Association between colposcopic findings and histology in cervical lesions: the significance of the size of the lesion. Gynecol Oncol 1995;57:66–71.
13. Mitchell MF, Schottenfeld D, Tortolero-Luna G, Cantor SB, Richards-Kortum R. Colposcopy for the diagnosis of squamous intraepithelial lesions: a meta-analysis. Obstet Gynecol 1998; 91:626–31.
14. Sideri M, Schettino F, Spinaci L, Spolti N, Crosignani P. Operator variability in disease detection and grading by colposcopy in patients with mild dysplastic smears. Cancer 1995;76:1601–5.
15. Zahm DM, Nindl I, Greinke C, Hoyer H, Schneider A. Colposcopic appearance of cervical intraepithelial neoplasia is age dependent. Am J Obstet Gynecol 1998; 179:1298–304.
16. Baldauf JJ, Dreyfus M, Ritter J, Philippe E. An analysis of the factors involved in the diagnostic accuracy of colposcopically directed biopsy. Acta Obstet Gynecol Scand 1997;76:468–473.
17. Buxton EJ, Luesley DM, Shafi MI, Rollason M. Colposcopically directed punch biopsy: a potentially misleading investigation. Br J Obstet Gynaecol 1991; 98:1273–6.
18. Costa S, Nuzzo MD, Rubino A, Rambelli V, Marinelli M, Santini D, et al. Independent determinants of inaccuracy of colposcopically directed punch biopsy of the cervix. Gynecol Oncol 2003;90:57–63.
19. Pretorius RG, Belinson JL, Zhang WH, Burchette RJ, Elson P, Qiao YL. The colposcopic impression: is it influenced by the colposcopist’s knowledge of the findings on the referral Papanicolaou smear? J Reprod Med 2001;46:724–8.
20. Pretorius RG, Zhang WH, Belinson JL, Huang MN, Wu LY, Zhang X, et al. Colposcopically directed biopsy, random cervical biopsy, and endocervical curettage in the diagnosis of cervical intraepithelial neoplasia II or worse. Am J Obstet Gynecol 2004;191:430–4.
21. Stellato G, Paavonen J. A colposcopic scoring system for grading cervical lesions. Eur J Gynaecol Oncol 1995;16:296–300.
22. Gifford MS, Stone IK. Quality, access, and clinical issues in a nurse practitioner colposcopy outreach program. Nurse Pract 1993;18:25–9, 33–6.
23. Hartz LE. Quality of care by nurse practitioners delivering colposcopy services. J Am Acad Nurse Pract 1995;7:23–7.
24. Massad LS, Halperin CJ, Bitterman P. Correlation between colposcopically directed biopsy and cervical loop excision. Gynecol Oncol 1996;60:400–3.
25. Morris DL, McLean CH, Bishop SL, Harlow KC. A comparison of the evaluation and treatment of cervical dysplasia by gynecologists and nurse practitioners. Nurse Pract 1998;23:101–2, 108–10, 113–4.
26. Todd RW, Wilson S, Etherington I, Luesley D. Effect of nurse colposcopists on a hospital-based service. Hosp Med 2002;63:218–23.
27. Schiffman M, Adrianza ME. ASCUS-LSIL Triage Study. Design, methods and characteristics of trial participants. Acta Cytol 2000;44:726–42.
28. Sherman ME, Wang SS, Tarone R, Rich L, Schiffman M. Histopathologic extent of cervical intraepithelial neoplasia 3 lesions in the atypical squamous cells of undetermined significance low-grade squamous intraepithelial lesion triage study: implications for subject safety and lead-time bias. Cancer Epidemiol Biomarkers Prev 2003;12:372–9.
29. Guido RS, Jeronimo J, Schiffman M, Solomon D; ALTS Group. The distribution of neoplasia arising on the cervix: results from the ALTS trial. Am J Obstet Gynecol 2005;193:1331–7.
30. Acharya G, Kjeldberg I, Hansen SM, Sorheim N, Jacobsen BK, Maltau JM. Pregnancy outcome after loop electrosurgical excision procedure for the management of cervical intraepithelial neoplasia. Arch Gynecol Obstet 2005;272:109–12.
31. Baldauf JJ, Dreyfus M, Ritter J, Meyer P, Philippe E. Risk of cervical stenosis after large loop excision or laser conization. Obstet Gynecol 1996;88:933–8.
32. Kyrgiou M, Koliopoulos G, Martin-Hirsch P, Arbyn M, Prendiville W, Paraskevaidis E. Obstetric outcomes after conservative treatment for intraepithelial or early invasive cervical lesions: systematic review and meta-analysis. Lancet 2006;367:489–98.
33. Sadler L, Saftlas A, Wang W, Exeter M, Whittaker J, McCowan L. Treatment for cervical intraepithelial neoplasia and risk of preterm delivery. JAMA. 2004;291:2100–6.
Affiliations of The Atypical Squamous Cells of Undetermined Significance/Low-Grade Squamous Intraepithelial Lesions Triage Study (ALTS) Group include the National Cancer Institute, Bethesda, MD (D. Solomon, Project Officer; M. Schiffman, Coproject Officer) and the following Clinical Centers: University of Alabama at Birmingham, Birmingham, AL (E. E. Partridge, Principal Investigator; L. Kilgore, Coprincipal Investigator; and S. Hester, Study Manager); University of Oklahoma, Oklahoma City, OK (J. L. Walker, Principal Investigator; G. A. Johnson, Coprincipal Investigator; and A. Yadack, Study Manager); Magee-Womens Hospital of the University of Pittsburgh Medical Center Health System, Pittsburgh, PA (R. S. Guido, Principal Investigator; K. McIntyre-Seltman, Coprincipal Investigator; R. P. Edwards, Investigator; and J. Gruss, Study Manager); University of Washington, Seattle, WA (N. B. Kiviat, Coprincipal Investigator, L. Koutsky, Coprincipal Investigator; and C. Mao, Investigator); Colposcopy Quality-Control Group (D. Ferris, Principal Investigator [Medical College of George, Augusta, GA]; J. T. Cox, Coinvestigator [University of California at Santa Barbara, Santa Barbara, CA]; and L. Burke, Coinvestigator [Beth Israel Deaconess Medical Center Hospital, Boston, MA]); Human Papillomavirus Quality Control Group (C. M. Wheeler, Principal Investigator [University of New Mexico Health Sciences Center, Albuquerque, NM]; C. Peyton-Goodall, Laboratory Manager [University of New Mexico Health Sciences Center, Albuquerque, NM]; and M. M. Manos, Coinvestigator [Kaiser Permanente, Oakland, CA]); Pathology Quality-Control Group (R. J. Kurman, Principal Investigator [Johns Hopkins Hospital, Baltimore, MD]; D. L. Rosenthal, Coinvestigator [Johns Hopkins Hospital, Baltimore, MD]; M. E. Sherman, Coinvestigator [The National Cancer Institute, Rockville, MD]; and M. H. Stoler, Coinvestigator [University of Virginia Health Science Center, Charlottesville, VA]); Westat, Coordinating Unit, Rockville, MD (J. Rosenthal, Project Director; M. Dunn, Data Management Team Leader; J. Quarantillo, Senior Systems Analyst; and D. Robinson, Clinical Center Coordinator); Quality-of-Life Group (D. M. Harper, Chair [Dartmouth Medical School, Hanover, NH]); Digene Corporation, Gaithersburg, MD (A. T. Lorincz, Senior Scientific Officer); and Information Management Services, Inc., Silver Spring, MD (B. Kramer, Senior Programmer/Analyst). Cited Here...