Secondary Logo

Journal Logo

EPIDEMIOLOGY AND SOCIAL

The long-term efficacy of medical male circumcision against HIV acquisition

Mehta, Supriya D.a; Moses, Stephenb; Agot, Kawangoc; Odoyo-June, Elijahd; Li, Honga; Maclean, Ianb; Hedeker, Donalda; Bailey, Robert C.a

Author Information
doi: 10.1097/01.aids.0000432444.30308.2d
  • Free

Abstract

Introduction

Three randomized controlled trials (RCTs) show that medical male circumcision (MMC) reduces the risk of HIV acquisition in heterosexual men by approximately 60% over 24 months [1–3]. The WHO recommends MMC as an important element of HIV prevention programs [4]. It is estimated that programmatic implementation of adult MMC in several sub-Saharan African countries could in 10 years reduce HIV acquisition in men by at least 60%, with up to a 30–40% reduction in women, potentiating a 40–50% decrease in HIV population prevalence [5]. In Nyanza province, Kenya, 80% MMC uptake over 10 years would result in the female HIV prevalence decreasing from 22 to 10%, and male HIV prevalence decreasing from 17 to 7% [6]. These long-term projections assume a sustained efficacy of circumcision in preventing HIV. The three RCTs were stopped early once efficacy was determined, and participants randomized to the control arm were free to choose circumcision. If men choose to become circumcised differentially, their behavioral risk may mitigate or exaggerate the protective effect of MMC.

We sought to determine the effectiveness of MMC on HIV acquisition over 72 months of follow-up among men participating in the Kisumu trial. If time-varying covariates were associated with the decision to become circumcised and also with risk of HIV acquisition [e.g. condom use, number of sex partners, transactional sex, sexually transmitted infection (STI) history], then this time-varying confounding would not be adequately addressed by simply adjusting for the time-varying covariates [7]. To address this concern, we evaluated the effectiveness of MMC on HIV risk over extended follow-up using marginal structural models [8,9].

Methods

This study was approved by the Institutional Review Boards of the University of Illinois at Chicago, the Kenyatta National Hospital, RTI International, and the University of Manitoba, and was overseen by a Data and Safety Monitoring Board. From 2002 to 2005, the MMC trial in Kisumu enrolled 2784 men aged 18–24 years. For inclusion, men had to be uncircumcised, HIV-negative, sexually active in the previous 12 months, and aged 18–24 years; have a hemoglobin more than 9.0 g/dl; and reside in Kisumu district. Exclusion criteria included foreskin covering less than half of the glans, a bleeding disorder, keloid formation, other conditions that might increase the risks of elective surgery, or a medical indication for circumcision. Participants with STIs or other treatable medical conditions were deferred until cured. Trial recruitment, enrollment, reasons for refusing enrollment, and follow-up have been previously described [1]. Following written informed consent, participants were randomized 1 : 1 to either immediate circumcision or delayed circumcision after a 2-year follow-up period (the control group).

Both groups underwent STI and HIV risk reduction counseling and were provided unlimited supplies of free condoms. Detailed evaluations were conducted at baseline, 1 month, 3 months, and every 6 months from randomization for all men. At each visit, participants underwent a standardized medical history and physical examination. For this analysis, genital ulcer disease (GUD) was defined as clinically detected ulcers or self-reported genital ulcers occurring in the past 6 months. For planned visits occurring 6 months from randomization or later, participants underwent personal interviews to obtain socio-demographic information, measures of sexual behavior and genital hygiene practices, and attitudes toward circumcision. Endorsement of circumcision was assessed through a series of five questions asking who had greater ease of penile cleanliness; protection against HIV; protection against STIs; sexual pleasure for men; and sexual pleasure for women. Response categories were ‘circumcised men’, ‘uncircumcised men’, ‘no difference’, and ‘do not know’. A response that favored circumcision was assigned one point, and points were summed to create a score ranging from zero to five, generated for each study visit.

HIV testing

Testing for HIV infection was conducted using a parallel double rapid test protocol, using Determine HIV 1/2 (Abbott Diagnostic Division, Hoofddorp, The Netherlands), and the Uni-Gold Recombigen HIV Test (Trinity Biotech, Wicklow, Ireland). Men who were concordant negative were eligible for the study. Concordant positive results were confirmed by double ELISA, and men were informed of their HIV status and followed up at the study clinic or referred to the New Nyanza Provincial Hospital. Men with discordant results were followed up with additional tests to determine their HIV status, but were not enrolled. For determination of HIV seroconversion for analysis, positive rapid tests and ELISA test results were confirmed by Health Canada's National HIV Reference Laboratory (Ottawa, Canada) by line immunoassay (INNO-LIA HIV 1/2; Immunogenetics NV, Ghent, Belgium). Specimens indeterminate by line immunoassay were tested by PCR at Health Canada or the Fred Hutchinson Cancer Research Center (Seattle, Washington, USA), with the PCR result deemed to be definitive.

Sexually transmitted infection testing

STI testing methods have been reported in detail previously [10]. Briefly, men were tested for urogenital infection with Neisseria gonorrhoeae, Chlamydia trachomatis, and Trichomonas vaginalis at baseline and each planned 6-month study visit, and at interim visits wherein symptoms or signs of infection were elicited. Men were tested for herpes simplex virus -2 (HSV-2) serum antibody at baseline and at each planned 6-month study visit.

Study sample

On recommendation of the data monitoring and safety board, the trial was stopped at the third interim analysis on 12 December 2006. Of the 1740 men still enrolled and eligible to participate in extended follow-up, 1545 (89%) provided additional consent to do so. Of the 1545 men consenting to extended follow-up, 778 (50.4%) were initially randomized to the control group. The follow-up visit schedule and procedures were identical to those of the trial, with scheduled visits every 6 months that included personal interview, physical examination, and STI and HIV testing. Extended follow-up was completed on 30 September 2010, and the remaining cohort was discharged at that time. This analysis excluded three men found to be HIV-infected at baseline after detailed testing and three HIV-uninfected men who were found to be outside the inclusion age range [1].

Marginal structural model analysis

Marginal structural models reduce the bias introduced by self-selection to become circumcised through application of stabilized weighting at each time point for the time-dependent confounders. The effect of these weights is to create at each time point, a pseudopopulation in which the time-dependent covariates no longer predict HIV seroconversion (i.e., the confounding effect is removed), and the causal association between circumcision status and HIV risk approximates the original randomized population [11]. The denominator of the weights is the probability that each participant was circumcised at a particular time point, given their past circumcision status, and their baseline and time-varying prognostic factors. The numerator of the weight is the probability that each participant was circumcised at each particular time point, conditional on their past circumcision status and baseline covariates. Hernán et al. report that these stabilized inverse-probability-of-treatment-weights (IPTWs) are preferred to the nonstabilized IPTWs for more efficient and accurate 95% confidence intervals (CIs) [7]. For our marginal structural approach, we generated the above described stabilized IPTW and stabilized inverse-probability-of-censoring-weights (IPCWs) to account for time-dependent confounding and loss to follow-up.

To obtain stabilized IPTWs, we fitted a weighted pooled logistic regression model for circumcision using each 6-month study visit as an observation. The weighted logistic model was fitted using generalized estimating equations assuming an exchangeable correlation structure, with robust variance estimation, to account for correlated observations. A similar approach was taken to generate stabilized weights for censoring. Following methods by Hernán et al., the overall weights for participants were calculated as the product of stabilized treatment and censoring weights [7]. Baseline and time-varying covariates used to estimate treatment and censoring probabilities were selected a priori based on a conceptual framework. This approach was taken to avoid the addition of nonconfounding variables, which would decrease statistical efficiency, or the addition of too many confounding variables, which could introduce bias [11]. The marginal structural modeling approach does not adjust for time-varying covariates to avoid overadjustment, as the stabilized weight already considers the effects of the time-varying covariates. Behavioral and sociodemographic data were not collected at the 1-month and 3-month visit. Therefore, HIV seroconversions occurring at the 1-month (n = 3) and 3-month (n = 3) study visits were analyzed as occurring at the 6-month visit so that these seroconversions would be included from analysis.

To identify other risks for HIV seroconversion, we used a conventional Cox regression model to show HIV seroconversion risk as a function of circumcision status, conditional on covariates of interest. Circumcision status was analyzed as a time-varying covariate by status (as treated). The assumption of proportionality for Cox proportional hazards was assessed by graphical inspection of Nelson–Aalen curves and by testing for a nonzero slope in a generalized linear regression of the scaled Schoenfeld residuals on functions of time. Standard errors were estimated using a robust variance estimate. Data were analyzed using Stata/SE 11.2 for Windows (Stata Corporation, College Station, Texas, USA).

Results

As previously reported, the control and treatment arms were well balanced at baseline regarding sociodemographic and behavioral characteristics, STI prevalences, and rates of follow-up (Table 1) [1].

Table 1
Table 1:
Selected baseline sociodemographic characteristics and behaviors by treatment assignment.

Within 12 months of the end of the trial, 24% of the men randomized to delayed circumcision became circumcised, and by the end of the extended follow-up period, approximately 50% (n = 395) had done so (Fig. 1). Circumcision was opted for more frequently by men who were aged 21–24 (vs. 18–20 years) at baseline, those with greater than a primary education, married or cohabiting men, those who lived in Kisumu over follow-up, used condoms at baseline, and had greater endorsement of circumcision at follow-up (Table 2). Circumcision was less likely among men who lived in Kisumu at baseline, had GUD during follow-up, self-reported penile coital injury during follow-up, or had one or more sex partners in the past 6 months during follow-up.

Fig. 1
Fig. 1:
Circumcision status among men originally randomized to control: proportion of men circumcised by study visit.
Table 2
Table 2:
Results of logistic regression models to generate weights for treatment and censoring.a

Posttrial retention among men consenting to extended follow-up was 84% at 36 months, 72% at 48 months, 68% at 60 months, and 52% at 72 months. Censoring by loss to follow-up was less likely among married/cohabiting men, men who were employed, those who lived in Kisumu at baseline, those with greater endorsement of circumcision over follow-up, those who used condoms over follow-up, and those with one or more sex partner in the past 6 months at baseline (Table 2). Men with greater endorsement of circumcision at baseline were more likely to be lost to follow-up.

Medical male circumcision and HIV seroconversion

The cumulative 72-month HIV incidence was 7.21% (95% CI: 5.98–8.68%): 4.81% among circumcised men, 11.0% among uncircumcised men (Fig. 2). The crude hazard ratio was 0.38 (95% CI: 0.26–0.55) (Table 3). The results of Cox regression incorporating weights from the marginal structural model (Table 3) indicate the protective efficacy of MMC against HIV seroconversion was 58% (hazard ratio = 0.42; 95% CI: 0.26–0.66) over 6 years of observation.

Fig. 2
Fig. 2:
Cumulative HIV seroincidence across follow-up visits by circumcision status.
Table 3
Table 3:
Male circumcision status and risk of HIV seroconversion.

A traditional multivariable Cox regression model adjusted for all other variables significant at the P < 0.05 level demonstrated a 55% protective effect of MMC against HIV acquisition [adjusted hazard ratio (aHR) = 0.45; 95% CI: 0.30–0.65]. Other factors associated with HIV seroconversion included HSV-2 infection (aHR = 2.25; 95% CI: 1.54–3.28), GUD (aHR = 3.55; 95% CI: 1.70–7.40), infection with N. gonorrhoeae (aHR = 2.91; 95% CI: 1.33–6.39), and self-reported scratches, cuts, abrasions, or bleeding of the penile skin after sex (aHR = 1.68; 95% CI: 1.14–2.48). Condom use at last sexual intercourse was associated with reduced risk of HIV seroconversion by 42% (aHR = 0.58; 95% CI: 0.39–0.84). Variables that were significant risks for HIV seroconversion (P < 0.05 level) in univariate analysis but not in multivariable analysis included increasing number of sex partners in the past 6 months or past 12 months; and cleaning penis more than 1 h after sexual intercourse. Condom use at last sex violated the proportional hazards assumption. Inclusion of an interaction term for condom use by time period (before or after the end of the trial) produced a main effects measure of aHR equal to 0.38 (95% CI: 0.22–0.65) for condom use at last sex, with a hazard ratio equal to 2.25 (95% CI: 1.06–4.77) for the interaction with time. Inclusion of the interaction term did not alter the magnitude or significance of other terms in the model (aHR for circumcision: 0.44; 95% CI: 0.30–0.65).

Discussion

In this analysis which accounted for differences in who becomes circumcised and differences in who is lost to follow-up, the protective effect of MMC was maintained at 58% over 6 years of observation, virtually the same as the 58% protective effect observed under trial conditions [1]. Our results show that the protective efficacy does not wane at up to 6 years. Programmatic implementation and scale-up of voluntary MMC services in sub-Saharan Africa is relatively recent, beginning largely in 2008 [12]. Because long-term follow-up of circumcised men with an appropriate comparison group of uncircumcised men is generally not feasible in programmatic implementation, surveillance of programmatic effectiveness over time will need to rely on regular cross-sectional surveillance of men's circumcision status and HIV status. Thus, assessment of the long-term effectiveness of MMC is currently limited to data collected through posttrial surveillance. Our results showing long-term protective efficacy of MMC against HIV support the assumptions of studies modeling the population impact of MMC on HIV, and the recommendations for scale-up that are based in part on these model assumptions [5–6,13–15].

In posttrial surveillance of men initially enrolled in the control arm of the Ugandan MMC trial, the protective effect of circumcision against HIV was 67% [16], somewhat stronger than the 57% protective effect of MMC against HIV seroconversion observed in the intention-to-treat analysis under their trial conditions [2]. Although Gray et al.[16] found no differences in sociodemographic or behavioral risks between control arm men who chose circumcision and those who did not, comparisons were restricted to the last visit under randomization, and the authors acknowledge that there may have been unmeasured higher risk among men who chose to remain uncircumcised. Their multivariable analysis adjusted for confounders as time-varying covariates, but did not account for the potential of time-varying confounding associated with choosing circumcision or being lost to follow-up.

In posttrial follow-up, circumcision uptake was approximately 50% among men initially randomized to control in our trial, which may indicate significant selection bias, and is significantly less than the 78% circumcision uptake among Rakai trial participants [16]. Reasons for the disparity in uptake in MMC between the two trial populations may have been due to differences in age (men enrolled in the Rakai trial were aged 15–49 years), factors affecting decision to become circumcised, messages, or delivery of promotion of MMC following the trial. Men opting for MMC may be a mixture of potentially lower risk and higher risk men. We found that control men with potentially lower risk for HIV (at baseline used condoms, were married or cohabiting, were not sexually active) were more likely to choose circumcision during posttrial follow-up, although men with more sex partners over follow-up were more likely to become circumcised. Unsurprisingly, greater endorsement of circumcision over follow-up was associated with greater likelihood of becoming circumcised. The WHO/UNAIDS implementation guidance for rapid MMC scale-up recommends that voluntary MMC programs understand reasons for seeking circumcision (situational analysis) and assessment of behavior and practices related to HIV (monitoring and evaluation), so that additional services may be incorporated as needed [17]. Results of our analyses determined specific sexual risk behaviors were associated with choosing circumcision. This highlights the importance of routine HIV testing, counseling to promote protective behaviors, reinforcing that MMC does not reduce HIV risk completely, and syndromic STI screening and treatment, as essential components of voluntary MMC programmatic scale-up. Moreover, while Kenya is over 50% of the way toward reaching the 80% male circumcision target needed to achieve desired population level reductions in HIV prevalence [12], these results provide insight for advocacy and education that could lead to greater circumcision endorsement to increase service uptake.

In our conventional multivariable Cox regression model, risks for HIV seroconversion were primarily STIs (HSV-2 infection, GUD, and urogenital gonococcal infection), highlighting the need for screening and treatment. Similar to results of our 24-month analysis [18], both HSV-2 infection (aHR = 2.26) and GUD (aHR = 3.59) were strong, independent risks for HIV seroconversion, suggesting HSV-2 and GUD have different mechanisms of increased HIV risk. Approximately, 60% of clinically detected GUD in our trial was not associated with HSV-2, chancroid, or syphilis by PCR and serology [19]. Rather, pyrosequencing of clinically detected genital ulcers demonstrated that such non-STI GUD was associated with specific anaerobic bacteria that have cytotoxic and tissue destructive properties. The extent to which increased risk of HIV acquisition is a function of dermal compromise and/or inflammation may differ between HSV-2 infection and GUD. The increased risk of HIV acquisition associated with HSV-2 may also reflect differential infectivity of the two viruses when exposed to a co-infected partner, and studies involving discordant couples could assess this. Additionally, controlling for HSV-2 serostatus and GUD, self-reported penile epithelial trauma nearly doubled the risk of HIV seroconversion. From our previous analysis, uncircumcised men are more likely to have epithelial disruptions of the penile skin, which are likely to be mechanical in origin [20]. We previously hypothesized this could represent misclassification of HSV-2 or GUD, but results of this analysis and our previous analyses suggest otherwise [18–20]. Further study characterizing this potential dermal compromise and mechanisms of increased HIV risk are needed, as genital mucosal trauma was commonly reported among men in our cohort [18], and in other populations in sub-Saharan Africa [21,22].

Limitations

One of the assumptions of marginal structural models, exchangeability – or the assumption of no measured confounding – cannot be empirically verified [11]. To address this assumption, we attempted to model a sufficient number of joint predictors of becoming circumcised and HIV seroconversion, while balancing this against introduction of too many predictors, which may result in nonpositivity. As reported by Cole and Hernán [11], estimated weights that are not mean centered or have wide range are indicative of nonpositivity or misspecification. Our weights were mean centered with a narrow range of minimums and maximums for both censoring and treatment. To the extent possible, our models were developed to minimize unmeasured confounding, nonpositivity, and misspecification. The application of marginal structural modeling provides confidence in the causal interpretation of the data.

Posttrial retention among men consenting to extended follow-up was high, and although we accounted for the effect of differential circumcision and loss to follow-up, this still affects the generalizability of our findings. Moreover, this analysis reflects men enrolled in a long-term cohort, with counseling on sexual behavioral risk reduction and testing and treatment of STIs every 6 months.

Conclusion

The efficacy of MMC was sustained at 58% at 6 years of follow-up, similar to findings of the three trials under conditions of randomization at 24 months of follow-up. These findings provide an estimate of the long-term efficacy of MMC against HIV acquisition.

Acknowledgements

R.C.B. and S.M. contributed to study concept and design.

K.A., R.C.B., I.M., S.M., and E.O-J. contributed to acquisition of data.

S.D.M. contributed to drafting of the manuscript.

K.A., R.C.B., D.H., H.L., I.M., S.D.M., S.M., and E.O-J. contributed to critical revision of the manuscript for important intellectual content.

D.H., H.L., and S.D.M. contributed to statistical analysis.

R.C.B., D.H., H.L., and S.D.M. contributed to analysis and interpretation of data.

R.C.B. and S.M. obtained funding.

K.A., R.C.B., S.D.M., S.M., and E.O-J. provided administrative, technical, or material support.

This trial was supported by grant number AI50440 from the NIAID, Division of AIDS, NIH; and by grant number HCT 44180 from the Canadian Institutes of Health Research. R.C.B. was partially supported by the Chicago Developmental Center for AIDS Research (D-CFAR), an NIH funded program (P30 AI 082151). The trial is registered at http://www.clinicaltrials.gov under the number NCT0005937. The corresponding author confirms that she had full access to all the data in the study and has final responsibility for the decision to submit for publication.

Conflicts of interest

No conflicts of interest have been declared.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

1. Bailey RC, Moses S, Parker CB, Agot K, Maclean I, Krieger JN, et al. Male circumcision for HIV prevention in young men in Kisumu, Kenya: a randomised controlled trial. Lancet 2007; 369:643–656.
2. Gray RH, Kigozi G, Serwadda D, Makumbi F, Watya S, Nalugoda F, et al. Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial. Lancet 2007; 369:657–666.
3. Auvert B, Taljaard D, Lagarde E, Sobngwi-Tambekou J, Sitta R, Puren A. Randomized, controlled intervention trial of male circumcision for reduction of HIV infection risk: the ANRS 1265 Trial. PLoS Med 2005; 2:e298.
4. World Health Organization. New Data on Male Circumcision and HIV Prevention: Policy and Programme Implications. WHO/UNAIDS Technical Consultation Male Circumcision and HIV Prevention: Research Implications for Policy and Programming: Conclusions and Recommendations. 6–8 March 2007, Montreux. http://www.who.int/hiv/mediacentre/MCrecommendations_en.pdf. [Accessed 28 September 2012].
5. UNAIDS/WHO/SACEMA Expert Group on Modelling the Impact and Cost of Male Circumcision for HIV PreventionMale circumcision for HIV prevention in high HIV prevalence settings: what mathematical models contribute to informed decision making. PLoS Med 2009; 6:e1000109.
6. Nagelkerke NJ, Moses S, de Vlas SJ, Bailey RC. Modelling the public health impact of male circumcision for HIV prevention in high prevalence areas in Africa. BMC Infect Dis 2007; 7:16.
7. Hernán MA, Brumback B, Robins JM. Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men. Epidemiology 2000; 11:561–570.
8. Robins JM. Marginal structural models. 1997 proceedings of the American Statistical Association, Section on Bayesian Statistical Science 1998; Alexandria, VA:American Statistical Association, 1–10. Available from http://biosun1.harvard.edu/∼robins/msm-web.pdf. [Accessed 11 September 2012].
9. Hernán MA, Robins JM. Estimating causal effects from epidemiological data. J Epidemiol Community Health 2006; 60:578–586.
10. Mehta SD, Moses S, Agot K, Parker CB, Ndinya-Achola JO, Maclean I, Bailey RC. Adult male circumcision does not reduce risk of incident Neisseria gonorrhoeae, Chlamydia trachomatis, and Trichomonas vaginalis: results from a randomized controlled trial in Kenya. J Infect Dis 2009; 200:370–378.
11. Cole SR, Hernán MA. Constructing inverse probability weights for marginal structural models. Am J Epidemiol 2008; 168:656–664.
12. Dickson KE, Tran NT, Samuelson JL, Njeuhmeli E, Cherutich P, Dick B, et al. Voluntary medical male circumcision: a framework analysis of policy and program implementation in eastern and southern Africa. PLoS Med 2011; 8:e1001133.
13. Hallett TB, Alsallaq RA, Baeten JM, Weiss H, Celum C, Gray R, Abu-Raddad L. Will circumcision provide even more protection from HIV to women and men? New estimates of the population impact of circumcision interventions. Sex Transm Infect 2011; 87:88–93.
14. Hankins C, Forsythe S, Njeuhmeli E. Voluntary medical male circumcision: an introduction to the cost, impact, and challenges of accelerated scaling up. PLoS Med 2011; 8:e1001127.
15. Njeuhmeli E, Forsythe S, Reed J, Opuni M, Bollinger L, Heard N, et al. Voluntary medical male circumcision: modeling the impact and cost of expanding male circumcision for HIV prevention in eastern and southern Africa. PLoS Med 2011; 8:e1001132.
16. Gray R, Kigozi G, Kong X, Ssempiija V, Makumbi F, Wattya S, et al. The effectiveness of male circumcision for HIV prevention and effects on risk behaviors in a posttrial follow-up study. AIDS 2012; 26:609–615.
17. World Health Organization/Joint United Nations Programme on HIV/AIDSOperational guidance for scaling up male circumcision services for HIV prevention. 2008; Geneva:World Health Organization, http://whqlibdoc.who.int/publications/2008/9789241597463_eng.pdf. [Accessed 28 September 2012].
18. Mehta SD, Moses S, Parker CB, Agot K, Maclean I, Bailey RC. Circumcision status and incident HSV-2 infection, genital ulcer disease, and HIV infection. AIDS 2012; 26:1141–1149.
19. Mehta SD, Green S, Maclean I, Hu H, Bailey RC, Gillevet PM, Spear GT. Microbial diversity of genital ulcer disease in men enrolled in a randomized trial of male circumcision in Kisumu, Kenya. PLoS One 2012; 7:e38991.
20. Mehta SD, Krieger JN, Agot K, Moses S, Ndinya-Achola JO, Parker CB, Bailey RC. Circumcision and reduced risk of self-reported coital injuries: results from a randomized controlled trial in Kisumu, Kenya. J Urol 2010; 184:203–209.
21. Bailey RC, Neema S, Othieno R. Sexual behaviors and other HIV risk factors in circumcised and uncircumcised men in Uganda. J Acquir Immune Defic Syndr 1999; 22:294–301.
22. Kalichman SC, Simbayi LC, Cain D, Cherry C, Jooste S. Coital bleeding and HIV risks among men and women in Cape Town, South Africa. Sex Transm Dis 2006; 33:551–557.
Keywords:

genital ulcer disease; gonorrhea; herpes simplex virus-2; HIV; male circumcision; marginal structural model; penile injury

© 2013 Lippincott Williams & Wilkins, Inc.