Secondary Logo

Journal Logo

Challenges in Estimating Effectiveness of Condom Distribution Campaigns to Prevent HIV Transmission

Shrestha, Ram K. PhD; Farnham, Paul G. PhD; Whitham, Hilary K. PhD, MPH; Sansom, Stephanie L. PhD, MPP, MPH

JAIDS Journal of Acquired Immune Deficiency Syndromes: October 1, 2016 - Volume 73 - Issue 2 - p e35–e38
doi: 10.1097/QAI.0000000000001124
Letters to the Editor
Free

Division of HIV/AIDS Prevention, National Center for HIV/AIDS, Viral Hepatitis, STD, and TB Prevention, Centers for Disease Control and Prevention, Atlanta, GA

The authors have no conflicts of interest to disclose.

The findings and conclusions in this report are those of the authors and do not necessarily represent the views of the Centers for Disease Control and Prevention.

To the Editors:

An estimated 1.2 million people aged 13 years and older are living with HIV infection in the United States,1 and approximately 45,000 people are newly diagnosed with the virus each year.2 Over the last 30 years, condom use has been a key element of comprehensive approaches to HIV prevention.3–9 For instance, the National HIV/AIDS Strategy for the United States 2010 (updated in 2015) calls for promotion of condom use in combination with other prevention approaches.10 Condom distribution campaigns, a frequently used public health intervention, make condoms freely available in settings frequented by people believed to be at high risk of transmitting or acquiring HIV. However, data regarding the effectiveness of condom distribution campaigns remain limited because of several methodological challenges. Knowledge of the strength of evidence of condom distribution campaign effectiveness is important for priority setting and the efficient allocation of HIV prevention resources among competing interventions.11–13 This article examines limitations in the literature regarding condom distribution campaigns and the difficulties in estimating the effectiveness of campaigns through observational studies and mathematical modeling.

Back to Top | Article Outline

CONDOM EFFECTIVENESS

Several studies have examined the effectiveness of condoms in preventing HIV transmission among highly adherent persons and in controlled settings. For example, a multinational meta-analysis of condom effectiveness studies has shown that among sero-discordant (ie, only 1 partner is HIV-positive) heterosexual couples who always used condoms, transmission risk was reduced by approximately 80% compared with those who never used a condom.3 A similar analysis in the United States found that the transmission risk reduction was 70% among men who have sex with men who always used condoms.14 In addition to their high effectiveness in preventing HIV transmission, condoms are also widely available,15,16 relatively inexpensive,17 safe, easy to use, and can prevent other sexually transmitted infections, as well as unintended pregnancies.18–20 Owing to these factors, condom distribution campaigns are often recommended as part of HIV prevention interventions.7,9,10 However, condom distribution campaigns face implementation and evaluation challenges including (1) identifying and reaching people who are at risk for HIV; (2) ensuring that condoms are distributed to those who would not otherwise have access to them; and (3) verifying that recipients at risk for acquiring or transmitting HIV use condoms both correctly and consistently.

Back to Top | Article Outline

CONDOM DISTRIBUTION CAMPAIGN EFFECTIVENESS

Given these challenges, numerous studies have attempted to document the effectiveness of condom distribution interventions (as opposed to the effectiveness of condom use) and have reported various sexual behavior and biological outcomes.21,22 Charania et al21 conducted a meta-analysis of condom distribution studies that focused on the behavioral outcomes associated with increased condom availability and acceptability. They found that the interventions were effective in increasing self-reported condom use during the last sex act. This analysis was based primarily on observational studies, which included 7 U.S.-based studies conducted in sexually transmitted disease (STD) clinics, high schools, and communities at high risk for STDs. In contrast, Moreno et al22 conducted a systematic review of condom distribution interventions focusing on biological outcomes and found that there was no clear evidence of effectiveness in preventing HIV transmission although the interventions increased self-reported condom use during last sex. The analysis was based on randomized controlled trials that included studies mostly from sub-Saharan Africa. The Moreno results highlight the inherent limitations of assessing effectiveness with behavioral outcomes, such as condom use during the last sex act: improvements in self-reported risk behaviors may not correlate with reductions in HIV transmission.

Back to Top | Article Outline

MODELING FOR ESTIMATING THE EFFECTIVENESS OF CONDOM DISTRIBUTION CAMPAIGNS

In the absence of data on the effectiveness of condom distribution campaigns in preventing HIV transmission, mathematical modeling can be used to provide an estimate of effectiveness. The Bernoulli process model is the standard method for estimating HIV infections prevented from behavioral interventions. In this model, acts of vaginal or anal sex are treated as independent events, each with a small probability of HIV transmission from an infected person to an uninfected partner.23 Condom use is evaluated in the model by noting the number of sex acts in which condoms are used and applying a decreased per act transmission probability to condom-protected acts. To estimate the intervention's effect on HIV transmission, the model requires detailed sexual behavior data both before and after the campaign (ie, pretest and posttest data).24

Figure 1 shows the data that may be observable, and those that typically are unobservable, in condom distribution campaigns. Most of these data are required for a Bernoulli process model to estimate the campaign's effectiveness in preventing HIV infection. The observable data may include the number of condoms made available and the number distributed to potential users over a period.17,25,26 Data required in the Bernoulli process model, but generally unobservable within the context of a given campaign, include specific demographic and sexual behavior characteristics. Although Pinkerton et al24 suggested that Bernoulli modeling can be used to estimate the intervention effects with limited sexual behavior data from the intervention, (at minimum, including number of sex partners, number of sex acts per partner, and number of sex acts protected by condoms before and after the intervention), these data are generally not available from condom distribution campaigns. Furthermore, additional data on HIV status of the index persons and their partners, partnership type (main, casual), sex type (receptive, insertive, vaginal, anal), sex, risk groups (men who have sex with men, high-risk heterosexuals, injection drug users), race/ethnicity, and partnership overlap are essential for more accurate estimates.27 Nor is it easy to determine the extent to which these recently distributed condoms increased condom use or substituted for condoms that would have been used in the absence of a campaign.

FIGURE 1

FIGURE 1

Back to Top | Article Outline

APPROACHES TO MODELING THE EFFECTIVENESS OF CONDOM DISTRIBUTION CAMPAIGNS

Several modeling studies have assigned values to the unobservable variables in condom distribution campaigns.25,28,29 Bedimo et al evaluated the effectiveness and cost-effectiveness of a condom social marketing campaign in Louisiana (1994–1996) by applying in their model an increase in the proportion of sex acts protected by condoms based on the increase in the proportion of a separate sample of people who reported having used a condom at last sex act. The difference in the proportion who reported condom use at last sex act before and after the campaign occurred was used as the average increase in the proportion of all sex acts covered over a year's period by the estimated 275,000 persons reached by the campaign.28 The analysis used several other external data sources and assumptions for model inputs, including number of partners of campaign beneficiaries and number of sex acts per partner. Population-level HIV prevalence data for the study area were used as a proxy for the HIV serostatus of condom recipients and their partners. Holtgrave et al,25 in their evaluation of a female condom distribution campaign, assumed that 65% of the distributed condoms were used to decrease the risk of transmission with each sex act. However, it is not possible to know how well these assigned variables matched the characteristics and behaviors of those who received condoms through a distribution campaign.

Data on the number of sex acts per partner and the proportion of acts protected by condoms before and after the campaign are among the most problematic to validly estimate. Surveys report different measures of condom use with varying degrees of accuracy and relevance to modeling, including condom use at last sex act, during a certain number of sex acts, or across all sex acts over time.30–32 Although condom use at last sex act has been the most common measure and could minimize recall bias,30,33 it may not provide a valid proxy for longer term condom use.30,34,35 For example, condom use has been found to decrease substantially over time after an intervention. Peterman et al32 reported that consistent condom use decreased from 24.1% in 3 months after an STD clinic visit to 5.1% in 1 year after the visit for a sample of patients in 3 public STD clinics, highlighting the time-dependency of these cross-sectional effect measures. Some researchers have suggested a composite measure, including condom use at last sex act, consistent condom use during a specified period, and test–retest questions to ensure consistency in self-reported measures.30 Importantly, these approaches to improving measures of condom use do not fully address the specific data needs for Bernoulli process modeling.

Back to Top | Article Outline

CONCLUSIONS

Although condom distribution offers a logical and potentially inexpensive approach to prevent HIV, the effectiveness of condom distribution programs remains largely unknown. To quantify the effectiveness of condom distribution campaigns, Bernoulli process models can be used, but they require accurate data, at minimum, on the number of sex partners, number of sex acts per partner, and the proportion of those acts protected by condoms among program recipients before and after the campaign. These data are often not collected for specific condom distribution programs or even in general sexual behavior surveys. Condom use provides a number of benefits, but a rigorous evaluation of the effectiveness of condom distribution campaigns is difficult and may not be possible. Although other HIV prevention interventions may be subject to other challenges regarding rigorous assessment of their effectiveness, the strength of scientific evidence of the effectiveness of all interventions should be considered when assessing how to distribute HIV prevention resources among competing interventions.

Back to Top | Article Outline

REFERENCES

1. Centers for Disease Control and Prevention. Monitoring Selected National HIV Prevention and Care Objectives by Using HIV Surveillance Data—United States and 6 Dependent Areas—2012. HIV Surveillance Supplemental Report 2014. Vol. 19. Atlanta, GA: Centers for Disease Control and Prevention; 2015. Available at: http://www.cdc.gov/hiv/library/reports/surveillance/. Accessed September 30, 2015.
2. Centers for Disease Control and Prevention. HIV Surveillance Report, 2014. Vol. 26. Atlanta, GA: Division of HIV/AIDS Prevention; 2015. Available at: http://www.cdc.gov/hiv/library/reports/surveillance/. Accessed December 14, 2015.
3. Weller S, Davis K. Condom effectiveness in reducing heterosexual HIV transmission. Cochrane Database Syst Rev. 2002:CD003255.
4. Weller SC. A meta-analysis of condom effectiveness in reducing sexually transmitted HIV. Soc Sci Med. 1993;36:1635–1644.
5. Pinkerton SD, Abramson PR. Effectiveness of condoms in preventing HIV transmission. Soc Sci Med. 1997;44:1303–1312.
6. Crosby RA, Graham CA, Milhausen RR, et al. Condom use to prevent sexually transmitted infections: a global perspective. Sex Health. 2012;9:vii.
7. Centers for Disease Control and Prevention. Condom Distribution as a Structural Intervention. Atlanta, GA: Division of HIV/AIDS Prevention; 2014. Available at: http://www.cdc.gov/hiv/prevention/programs/condoms/index.html. Accessed November 4, 2015.
8. Dieffenbach CW, Fauci AS. Thirty years of HIV and AIDS: future challenges and opportunities. Ann Intern Med. 2011;154:766–771.
9. UNAIDS. Condoms and HIV Prevention: Position Statement by UNAIDS, UNFPA and WHO 19 March 2009. Geneva, Switzerland: UNAIDS; 2009. Available at: http://www.unaids.org/en/resources/presscentre/featurestories/2009/march/20090319preventionposition. Accessed November 4, 2015.
10. The White House Office of National AIDS Policy. National HIV/AIDS Strategy for the United States. Washington, DC: Office of National AIDS Policy; 2010.
11. Braithwaite RS, Roberts MS, Justice AC. Incorporating quality of evidence into decision analytic modeling. Ann Intern Med. 2007;146:133–141.
12. Guirguis-Blake J, Calonge N, Miller T, et al. Current processes of the U.S. Preventive Services Task Force: refining evidence-based recommendation development. Ann Intern Med. 2007;147:117–122.
13. Gold MR, Siegel JE, Russell LB, et al. Cost-effectiveness in Health and Medicine. Oxford, UK: Oxford University Press; 1996.
14. Smith DK, Herbst JH, Zhang X, et al. Condom effectiveness for HIV prevention by consistency of use among men who have sex with men in the United States. J Acquir Immune Defic Syndr. 2015;68:337–344.
15. Anderson JE, Warner L, Macaluso M. Condom use among US adults at last sexual intercourse, 1996–2008: an update from national survey data. Sex Transm Dis. 2011;38:919–921.
16. Reece M, Herbenick D, Schick V, et al. Condom use rates in a national probability sample of males and females ages 14 to 94 in the United States. J Sex Med. 2010;7(suppl 5):266–276.
17. Renaud TC, Bocour A, Irvine MK, et al. The free condom initiative: promoting condom availability and use in New York City. Public Health Rep. 2009;124:481–489.
18. Crosby R, Bounse S. Condom effectiveness: where are we now? Sex Health. 2012;9:10–17.
19. Centers for Disease Control and Prevention. Condoms and STDs: Fact Sheet for Public Health Personnel. 2013. Atlanta, GA: National Center for HIV/AIDS, Viral Hepatitis, STD, and TB Prevention; 2013. Available at: http://www.cdc.gov/condomeffectiveness/latex.html. Accessed November 4, 2015.
20. Higgins JA, Cooper AD. Dual use of condoms and contraceptives in the USA. Sex Health. 2012;9:73–80.
21. Charania MR, Crepaz N, Guenther-Gray C, et al. Efficacy of structural-level condom distribution interventions: a meta-analysis of U.S. and international studies, 1998–2007. AIDS Behav. 2011;15:1283–1297.
22. Moreno R, Nababan HY, Ota E, et al. Structural and community-level interventions for increasing condom use to prevent the transmission of HIV and other sexually transmitted infections. Cochrane Database Syst Rev. 2014;7:CD003363.
23. Pinkerton SD, Abramson PR. The Bernoulli-process model of HIV transmission. In: Holtgrave D, ed. Handbook of Economic Evaluation of HIV Prevention Programs. New York, NY: Springer; 1998.
24. Pinkerton SD, Holtgrave DR, Leviton LC, et al. Toward a standard sexual behavior data set for HIV prevention evaluation. Amer J Health Behav. 1998;22:259–266.
25. Holtgrave DR, Maulsby C, Kharfen M, et al. Cost-utility analysis of a female condom promotion program in Washington, DC. AIDS Behav. 2012;16:1115–1120.
26. Cohen DA, Farley TA, Bedimo-Etame JR, et al. Implementation of condom social marketing in Louisiana, 1993 to 1996. Am J Public Health. 1999;89:204–208.
27. Yaylali EP, Farnham PGP, Schneider KLP, et al. From theory to practice: implementation of a resource allocation model in health departments. J Public Health Manag Pract. 2015.
28. Bedimo AL, Pinkerton SD, Cohen DA, et al. Condom distribution: a cost-utility analysis. Int J STD AIDS. 2002;13:384–392.
29. Leibowitz AA, Harawa N, Sylla M, et al. Condom distribution in jail to prevent HIV infection. AIDS Behav. 2013;17:2695–2702.
30. Fonner VA, Kennedy CE, O'Reilly KR, et al. Systematic assessment of condom use measurement in evaluation of HIV prevention interventions: need for standardization of measures. AIDS Behav. 2014;18:2374–2386.
31. Noar SM, Cole C, Carlyle K. Condom use measurement in 56 studies of sexual risk behavior: review and recommendations. Arch Sex Behav. 2006;35:327–345.
32. Peterman TA, Tian LH, Warner L, et al. Condom use in the year following a sexually transmitted disease clinic visit. Int J STD AIDS. 2009;20:9–13.
33. Rietmeijer CA, Lansky A, Anderson JE, et al. Developing standards in behavioral surveillance for HIV/STD prevention. AIDS Educ Prev. 2001;13:268–278.
34. Catania JA, Dolcini MM, Laumann EO, et al. A response to “developing standards in behavioral surveillance for HIV/STD prevention.” AIDS Educ Prev. 2002;14:343–347.
35. Kauth MR, St Lawrence JS, Kelly JA. Reliability of retrospective assessments of sexual HIV risk behavior: a comparison of biweekly, three-month, and twelve-month self-reports. AIDS Educ Prev. 1991;3:207–214.
Copyright © 2016 Wolters Kluwer Health, Inc. All rights reserved.