JAIDS Journal of Acquired Immune Deficiency Syndromes:
Challenges in the Design of HIV Prevention Trials in the United States
Donnell, Deborah PhD*; Hughes, James P PhD†; Fleming, Thomas R PhD†
From the *Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA; and †Department of Biostatistics, University of Washington, Seattle, WA.
Supported by the HIV Prevention Trials Network sponsored by the National Institute of Allergy and Infectious Diseases, National Institutes of Child Health and Human Development, National Institute on Drug Abuse, National Institute of Mental Health, and Office of AIDS Research of the National Institutes of Health, US Department of Health and Human Services (U01-AI-46745, U01-AI-48054, U01-AI068613).
The authors have no funding or conflicts of interest to disclose.
Correspondence to: Deborah Donnell, PhD, 1100 Fairview Avenue N M2-200, PO Box 19024, Seattle WA 98109 (e-mail: firstname.lastname@example.org).
The design of studies evaluating the safety and efficacy of interventions for HIV prevention is challenging in the US context, where there is low generalized prevalence. HIV incidence is sufficiently high in the at-risk US population of men who have sex with men that prevention trials using HIV infection end points are feasible. In other US populations at higher risk of HIV exposure, efficacy trials of HIV prevention are likely not feasible. However, for interventions where efficacy is already established, conducting trials that test different implementation strategies in these populations could provide definitive evidence about how to achieve high levels of coverage.
PUBLIC HEALTH IMPACT AND HIV PREVENTION
Three elements are essential if an HIV prevention program is to meaningfully reduce the annual rate of new HIV infections in the United States.
1. A large identifiable target population that is at risk for exposure to HIV.
2. An intervention with established effectiveness in the target population.
3. A mechanism for delivery and uptake of the intervention by a substantial fraction of the target population.
Programs to prevent mother-to-child transmission of HIV illustrate a case that has achieved considerable impact: The population of pregnant women with HIV infection is identifiable (although not large in the United States); a variety of antiretroviral regimens in the mother and the newborn infant have efficacies ranging from 33% to 98%1-6; and high coverage has been achieved using existing antenatal care facilities in the United States. In resource-limited countries, however, achieving high coverage remains the greatest impediment to reducing perinatal HIV transmission. In the United States, other HIV prevention interventions that target small or hard-to-reach populations face a fundamental public health challenge, especially if efficacy is modest. As a hypothetical example, suppose a behavioral intervention for stimulant-using men who have sex with men (MSM) achieves a 30% reduction in HIV transmission. If a quarter of the 50% of new HIV infections attributed to MSM in the United States each year7 occur in stimulant-using MSM, and 50% coverage of this target population is achieved, we would expect to avert only 2% of the new infections currently occurring annually in the United States (50% new infections in MSM 3 25% occurring in stimulant using MSM 3 50% coverage 3 30% effectiveness).
In this article, we briefly discuss the challenges of designing HIV prevention trials in the context of the US epidemic, utilizing the 3 elements cited above that determine the public health impact of potential interventions.
ELEMENT 1: TARGETING POPULATIONS AT RISK FOR HIV IN THE UNITED STATES
The first prevention design challenge is identifying a population at substantial HIV risk. The general population in the United States is at very low risk, with estimated 56,300 new infections in 2006 and annual incidence of 22 per 100,000.8 Low event rates necessitate very large studies: In the low incidence setting of the Thai vaccine trial,9 even though 16,402 volunteers were followed for 3 years, only 132 HIV infections occurred. Thus, research evaluating HIV prevention in the United States needs to be conducted in targeted populations having approximately 100-fold the level of HIV risk in the overall population. As noted in the 2008 Centers for Disease Control and Prevention Surveillance Report and Table 1,7 the US subpopulations accounting for the highest proportion of newly detected infections are MSM (55%), especially black and Hispanic MSM (32%), black and Hispanic women, primarily at heterosexual risk (20%), and injection drug users (IDUs) (13%). MSM, women, and IDUs have each been enrolled in HIV trials in the United States. Table 2 summarizes seroincidence rates in targeted HIV risk cohorts since 1995. In MSM cohorts at a high risk of HIV exposure, incidence has consistently been above 1.5 per 100 person-years. Identifying and enrolling such MSM has been shown to be feasible in multiple HIV prevention trials,10-14 and conducting prevention research in this population continues to be viable in the United States.
Although black and Hispanic/Latina women in the United States have heightened HIV risk, the absolute rate of newly detected infections in minority women-56 per 100,000 for blacks and 13 per 100,000 for Hispanic women and Latinas-is low.7 Cohorts of women at heterosexual risk, selected for elevated risk of HIV exposure through personal sexual behavior and risk behavior of their sexual partners, have found low HIV incidence (Table 2). A new strategy for identifying women at risk for HIV according to sociodemographic characteristics is being tested in an ongoing study in the HIV Prevention Trials Network (HPTN), the ISIS study (HPTN 064).20 However, until we can identify characteristics that distinguish women at a high risk for HIV (ie, 20-40 times the background rate) and until we can demonstrate the ability to recruit and retain such women in a trial, the feasibility of conducting studies of the efficacy of new interventions for reducing HIV risk in such US populations is limited.
IDUs in cities with high HIV prevalence are readily identifiable and have been successfully enrolled and retained in HIV seroincidence studies (Table 2). However, the number of new HIV/AIDS cases attributed to injection drug use in the United States has fallen steadily since 1993,21 and recent US cohorts of IDUs with high risk for HIV exposure through needle use have had low HIV incidence, even in settings of high HIV prevalence (Table 2). Ironically, the study of prevention interventions for IDUs cannot proceed unless it is possible to enroll a large IDU population that remains at risk for HIV.
Heterosexual HIV risk can be identified through cohorts of HIV discordant couples. The National Institute of Mental Health's EBAN study enrolled 535 US African American discordant couples in stable relationships. But HIV incidence was low (Table 2), and the study took 4 years to accrue, making this population, too, challenging to be utilized for studying HIV prevention interventions in the United States.
ELEMENT 2: EFFICACY TRIAL DESIGN IN A US TARGET POPULATION
The design of randomized clinical trials to test prevention efficacy is intimately linked to the specifics of an intervention, its intended mechanism, and its target population. An intervention that targets HIV-uninfected individuals is most efficiently studied with an individually randomized design. These have been used in most HIV prevention trials, with targeted intervention efficacies ranging from modest decreases (25%-35%)12,11,22,23 to substantial reductions (50%-60%).24-28 The resources required to evaluate HIV prevention interventions increase exponentially with decreased effectiveness and linearly with decreased incidence of HIV infection: In an individually randomized trial, to achieve 90% power with 1-sided 2.5% false-positive error rates for detecting anticipated effectiveness of 50%, 40%, and 30%, it requires 88, 161, and 330 events, respectively. For a trial with (control arm) incidence of 2.0 per 100 person-years, achieving these targeted numbers of events requires planning for 5866, 10,062, and 19,412 person-years of follow-up, respectively; a rate of 1.0 per 100 person-years requires double the person-years of follow-up. Given these constraints, it would be feasible to conduct individually randomized trials in the United States with HIV incidence end points in MSM populations. But trials in other risk populations in the United States are not feasible until we are able to identify substantial subpopulations with HIV risk levels similar to the risk found in MSM cohorts.
Interventions that target HIV-infected persons to prevent sexual transmission to their HIV-uninfected partners require an HIV discordant couple or community randomized design. The resources required to enroll and follow a discordant couple cohort are close to double that of an individually randomized design, which largely offsets the potential design efficiency achieved from relatively high incidence. It should also be noted that a substantial fraction of the transmissions in the HIV-uninfected partner may occur outside the couple,29 resulting in a dilution of effectiveness and consequently necessitating an increase in the sample size. Finally, discordant couple studies require stable long-term partnerships-short-term partnerships compromise the study design because HIV-uninfected partners who leave the partnership are no longer exposed to the intervention (dilution of the effect) and new partners identified after randomization may be subjected to referral bias. In sub-Saharan Africa, HIV discordant couples have been rapidly accrued, and HIV seroincidence has remained sufficiently high to allow successful completion of prevention trials with HIV end points,29,30 a situation that has not yet been replicated in stable discordant couples in the United States.16 Discordant partner studies appear better suited to generalized epidemic settings such as sub-Saharan Africa, where the high prevalence of stable discordant couples facilitates rapid accrual, rather than to the United States, where the epidemic is concentrated in specific risk populations.
Structural interventions or community-wide delivery of prevention services mandate a community randomized trial (CRT) design to evaluate effectiveness.31-33 However, CRTs are inevitably more costly than individually randomized trials. Several factors lead to increased study size for CRTs: partial coverage and/or adherence lead to effect dilution; correlation of outcomes within a community increases the variance of the estimated intervention effect; and the intervention mechanisms of action are often indirect. For example, in Project ACCEPT (HPTN 043), a CRT of mobile voluntary counseling and testing,33 only a subset of the community (ie, those who receive voluntary counseling and testing) experience the intervention, diluting the anticipated effectiveness. Also, the expected mechanism of action-decreasing risky behavior in HIV-infected individuals through awareness of their infection-results in indirect protection of HIV-uninfected individuals. Finally, underlying variation in the HIV epidemics across communities leads to a need for a large number of participating communities to detect an intervention effect.
Conducting HIV prevention CRTs in the United States presents unique difficulties. First, defining communities in the United States is challenging. The ideal community is closed: to prevent contamination and/or dilution of the intervention effect, neither people nor the intervention would travel among communities during the trial. High mobility and efficient communication in the US adult population makes defining a community problematic and may result in rapid diffusion of the intervention between control and intervention communities. Second, low incidence in the general US population means that HIV incidence must be measured in a sentinel population, raising concerns about bias, retention, and generalizability. These factors are particularly relevant for a HIV prevention community randomized trial because the intervention effect may take several years to be fully realized,34 thereby requiring the communities to remain largely intact (ie, stable, with constant background prevention efforts) for an extended period.
Given the low incidence in most US populations, surrogate end points such as self-reported behaviors, viral load, or acquisition of other sexually transmitted infections are often proposed as more feasible outcomes. Ideally, a surrogate end point lies in the causal pathway between the intervention and the end point (HIV incidence) and captures the entire intervention effect.35 Unfortunately, none of these surrogates have proved reliable as a proxy for HIV incidence, and the use of imperfect surrogates can be misleading. A potentially useful role for surrogate end points in HIV research in the United States might be in the evaluation of strategies for the implementation of known effective interventions.
ELEMENT 3: DESIGNS TO STUDY IMPLEMENTATION STRATEGIES FOR HIV PREVENTION IN THE UNITED STATES
For any intervention that is proven to be effective in a trial outside the United States, important research questions remain about implementation in the US setting. Assuming the evidence for effectiveness from randomized clinical trials is strong and fundamental principles suggest the intervention will be equally effective in US populations, we can conduct rigorous studies that compare methods to achieve high coverage. This addresses the critical third element of public health prevention, delivering the intervention to a substantial fraction of the target population. A comparative study of program implementation strategies is feasible in major populations exposed to HIV risk in the United States, using well-defined program target populations and outcomes that measure program uptake rates.
To illustrate the opportunity for rigorous study of implementation strategies for prevention in the United States, we describe the Test, Link-to-Care Plus Treatment study (HPTN 065: TLC-Plus20), which includes a component designed to assess the impact of financial incentives to achieve high linkage to care and high adherence to antiretroviral therapy for HIV-infected individuals in the United States. Definitive trials are underway to evaluate the efficacy of HIV testing and linkage to care for HIV prevention33 and the efficacy of antiretroviral treatment for prevention of HIV transmission.36 However, there is clear therapeutic benefit for the HIV-infected person in improved linkage to care and treatment.
TLC-Plus will compare the use of financial incentives to the standard of care for linking newly diagnosed and out-of-care HIV-infected patients to a medical provider, using a cluster randomized trial design, with 40 HIV test facilities assigned at random to either strategy. For HIV-infected participants who have initiated antiretroviral therapy, 40 medical care facilities will be cluster-randomized to compare financial incentives with the standard of care for achieving viral suppression, which for most is achieved through high adherence to antiretroviral therapy. In most prevention trials, specific procedures and facilities must be developed for collecting outcome data. TLC-Plus will use the US national HIV/AIDS surveillance systems maintained by local health departments and funded and supported by the Centers for Disease Control and Prevention to evaluate key trial end points-the proportion of cases linked to care for each test facility and the proportion of a care facility's patients with suppressed viral load-using laboratory tests captured in the surveillance data. Using these process outcomes, the trial is well powered to assess the financial incentive strategies.
HIV prevention efficacy trials can be conducted efficiently only in large target populations having HIV incidence rates that are at least as high as approximately 2 per 100 person-years; the only risk population in the United States that currently meets this requirement is MSM. Ongoing efforts are needed to understand how to target high-risk subgroups within other major populations affected by HIV.
Rigorous trials for evaluating how to implement effective HIV prevention interventions are feasible within the United States because coverage and uptake are the primary outcomes of interest. These trials are likely to be community based and conducted in tandem with pilot program implementation. Compared with efficacy trials, such trials could be rapidly completed. The national HIV/AIDS surveillance data provide a unique and promising resource for assessment of community-based implementation trials within the HIV-infected population.
1. Leroy V, Karon JM, Alioum A, et al. Twenty-four month efficacy of a maternal short-course zidovudine regimen to prevent mother-to-child transmission of HIV-1 in West Africa. AIDS
2. Jackson JB, Musoke P, Fleming T, et al. Intrapartum and neonatal single-dose nevirapine compared with zidovudine for prevention of mother-to-child transmission of HIV-1 in Kampala, Uganda: 18-month follow-up of the HIVNET 012 randomised trial. Lancet
. 2003;362:859-868. doi:10.1016/S0140-6736(03)14341-3.
3. Gaillard P, Fowler MG, Dabis F, et al. Use of antiretroviral drugs to prevent HIV-1 transmission through breast-feeding: from animal studies to randomized clinical trials. J Acquir Immune Defic Syndr
4. Dorenbaum A, Cunningham CK, Gelber RD, et al. Two-dose intrapartum/newborn nevirapine and standard antiretroviral therapy to reduce perinatal HIV transmission: a randomized trial. JAMA
5. Cooper ER, Charurat M, Mofenson L, et al. Combination antiretroviral strategies for the treatment of pregnant HIV-1-infected women and prevention of perinatal HIV-1 transmission. J Acquir Immune Defic Syndr
6. Petra Study Team. Efficacy of three short-course regimens of zidovudine and lamivudine in preventing early and late transmission of HIV-1 from mother to child in Tanzania, South Africa, and Uganda (Petra study): a randomised, double-blind, placebo-controlled trial. Lancet
. 2002;359:1178-1186. doi:10.1016/S0140-6736(02)08214-4.
7. Centers for Disease Control and Prevention. Diagnoses of HIV Infection and AIDS in the United States and Dependent Areas, 2008
. HIV Surveillance Report
. Vol 20. Atlanta, GA: Division of HIV/AIDS Prevention, National Center for HIV/AIDS, Viral Hepatitis, STD, and TB Prevention, Centers for Disease Control and Prevention; 2010. Available at: http://www.cdc.gov/hiv/surveillance/resources/reports/2008report/
. Accessed August 12, 2010.
8. Hall HI, Song R, Rhodes P, et al. Estimation of HIV incidence in the United States. JAMA
9. Rerks-Ngarm S, Pitisuttithum P, Nitayaphan S, et al. Vaccination with ALVAC and AIDSVAX to prevent HIV-1 infection in Thailand. N Engl J Med
. 2009;361:2209-2220. doi:10.1056/NEJMoa0908492.
10. Seage GR III, Holte SE, Metzger D, et al. Are US populations appropriate for trials of human immunodeficiency virus vaccine? The HIVNET Vaccine Preparedness Study. Am J Epidemiol
11. Koblin B, Chesney M, Coates T; and the EXPLORE Study Team. Effects of a behavioural intervention to reduce acquisition of HIV infection among men who have sex with men: the EXPLORE randomised controlled study. Lancet
. 2004;364:41-50. doi:10.1016/S0140-6736(04)16588-4.
12. Flynn NM, Forthal DN, Harro CD, et al. Placebo-controlled phase 3 trial of a recombinant glycoprotein 120 vaccine to prevent HIV-1 infection. J Infect Dis
. 2005;191:654-665. doi:10.1086/428404.
13. Buchbinder SP, Mehrotra DV, Duerr A, et al. Efficacy assessment of a cell-mediated immunity HIV-1 vaccine (the STEP Study): a double-blind, randomised, placebo-controlled, test-of-concept trial. Lancet
. 2008;372:1881-1893. PMCID: PMC2721012.
14. Brown-Peterside P, Chiasson MA, Ren L, et al. Involving women in HIV vaccine efficacy trials: lessons learned from a vaccine preparedness study in New York City. J Urban Health
15. Seage GR III, Holte S, Gross M, et al. Case-crossover study of partner and situational factors for unprotected sex. J Acquir Immune Defic Syndr
16. El-Bassel N, Jemmott JB, Landis JR, et al. National Institute of Mental Health Multisite Eban HIV/STD prevention intervention for African American HIV serodiscordant couples: a cluster randomized trial. Arch Intern Med
. 2010;170:1594-1601. doi:10.1001/archinternmed. 2010. 261.
17. Nelson KE, Galai N, Safaeian M, et al. Temporal trends in the incidence of human immunodeficiency virus infection and risk behavior among injection drug users in Baltimore, Maryland, 1988-1998. Am J Epidemiol
18. Latkin CA, Donnell D, Metzger D, et al. The efficacy of a network intervention to reduce HIV risk behaviors among drug users and risk partners in Chiang Mai, Thailand and Philadelphia, USA. Soc Sci Med. 2009;68:740-748. PMCID: PMC2724962.
19. Buchbinder SP, Douglas JM Jr., McKirnan DJ, et al. Feasibility of human immunodeficiency virus vaccine trials in homosexual men in the United States: risk behavior, seroincidence, and willingness to participate. J Infect Dis
23. Karim SA, Coletti A, Richardson B, et al. Safety and effectiveness of vaginal microbicides BufferGel and PRO 2000 Gel for the prevention of HIV infection in women: results of the HPTN 035 trial [abstract 48LB]. Presented at: 16th Conference on Retroviruses and Opportunistic Infections (CROI); February 8-11, 2009; Montreal, Quebec, Canada.
24. Auvert B, Taljaard D, Lagarde E, et al. Randomized, controlled intervention trial of male circumcision for reduction of HIV infection risk: the ANRS 1265 Trial. PLoS Med
. 2005;2:e298. doi:10.1371/journal.pmed.0020298.
25. Celum C, Wald A, Hughes J, et al. Effect of aciclovir on HIV-1 acquisition in herpes simplex virus 2 seropositive women and men who have sex with men: a randomised, double-blind, placebo-controlled trial. Lancet
. 2008;371:2109-2119. doi:10.1016/S0140-6736(08)60920-4.
26. Bailey RC, Moses S, Parker CB, et al. Male circumcision for HIV prevention in young men in Kisumu, Kenya: a randomised controlled trial. Lancet
. 2007;369:643-656. doi:10.1016/S0140-6736(08)60920-4.
27. Padian NS, van der Straten A, Ramjee G, et al. Diaphragm and lubricant gel for prevention of HIV acquisition in southern African women: a randomised controlled trial. Lancet
. 2007;370:251-261. doi:10.1016/S0140-6736(07)60950-7.
28. Gray RH, Kiwanuka N, Quinn TC, et al; for the Rakai Project Team. Male circumcision and HIV acquisition and transmission: cohort studies in Rakai, Uganda. AIDS
29. Celum C, Wald A, Lingappa JR, et al. Acyclovir and transmission of HIV-1 from persons infected with HIV-1 and HSV-2. N Engl J Med
. 2010;362:427-439. doi:10.1056/NEJMoa0904849.
30. Hira SK, Feldblum PJ, Kamanga J, et al. Condom and nonoxynol-9 use and the incidence of HIV infection in serodiscordant couples in Zambia. Int J STD AIDS
. 1997;8:243-250. doi:10.1258/0956462971919994.
31. Grosskurth H, Gray R, Hayes R, et al. Control of sexually transmitted diseases for HIV-1 prevention: understanding the implications of the Mwanza and Rakai trials. Lancet
. 2000;355:1981-1987. doi:10.1016/S0140-6736(00)02336-9.
32. Wawer MJ, Sewankambo NK, Serwadda D, et al; and the Rakai Project Study Group. Control of sexually transmitted diseases for AIDS prevention in Uganda: a randomised community trial. Lancet
. 1999;353:525-535. doi:10.1016/S0140-6736(98)06439-3.
33. Genberg BL, Kulich M, Kawichai S, et al. HIV risk behaviors in sub-Saharan Africa and Northern Thailand: baseline behavioral data from Project Accept. J Acquir Immune Defic Syndr
34. Hallett TB, Garnett GP, Mupamberiyi Z, et al. Measuring effectiveness in community randomized trials of HIV prevention. Int J Epidemiol
. 2008;37:77-87. doi:10.1093/ije/dym232.
35. Fleming TR, DeMets DL. Surrogate end points in clinical trials: are we being misled? [Perspectives]. Ann Intern Med
36. Cohen MS, Bollinger RC, Celentano D, et al. HPTN 052. A randomized trial to evaluate the effectiveness of antiretroviral therapy plus HIV primary care versus HIV primary care alone to prevent the sexual transmission of HIV-1 in serodiscordant couples [HIV Prevention Trials Network Web site]. Available at: http://www.hptn.org/research_studies/HPTN052StudyDocuments.asp
#Protocol. Accessed January 20, 2010.
prevention trial; trial design; HIV seroincidence; implementation
© 2010 Lippincott Williams & Wilkins, Inc.
What does "Remember me" mean?
By checking this box, you'll stay logged in until you logout. You'll get easier access to your articles, collections,
media, and all your other content, even if you close your browser or shut down your
To protect your most sensitive data and activities (like changing your password),
we'll ask you to re-enter your password when you access these services.
What if I'm on a computer that I share with others?
If you're using a public computer or you share this computer with others, we recommend
that you uncheck the "Remember me" box.
Highlight selected keywords in the article text.
Data is temporarily unavailable. Please try again soon.