To make testing more accessible (i.e., placement) and reduce the cost and inconvenience of testing (i.e., price), SFDPH established alternative testing sites that expanded over time to include free testing at an HIV care clinic, a drug treatment program, a newly established gay men’s health clinic, and a newly established online testing program (persons can print out a lab slip online, take it to 1 of 5 designated sites for a blood draw, and receive their results online).
Survey Recruitment and Eligibility
To evaluate the effectiveness of the campaign, a convenience sample of male respondents was surveyed from December 13, 2002, to February 23, 2003. Men were intercepted at coffee shops, bars, markets, laundromats, sex clubs, a clean and sober community center, on sidewalks, and in other venues located in campaign-targeted neighborhoods. Interviewers approached men and said they were “asking people in the area some questions about sexual health issues to improve health services in [their] community.” Respondents were informed that the interview was completely anonymous and that they would not be asked to provide any personal identifying information. Respondents were interviewed if the gender of their sex partners included males, if they were between the ages of 18 and 60, and if they resided in the San Francisco Bay area. Each interview took approximately 20 minutes to complete.
Data were collected during routine public health activities of disease control and analyzed for program evaluation. This activity was therefore designated as public health practice and nonresearch. In accordance with the Code of Federal Regulations, Title 45, Part 46, The Public Service Act, human subjects review is not required for public health nonresearch activities.
Respondents were asked basic demographic information, including age, income, education, occupation, and zip code. The interview followed with a set of questions regarding the campaign that included unaided (e.g., spontaneous mention) and aided (e.g., prompted response) awareness of the Healthy Penis campaign, sources of awareness, frequency of exposure, perceived key messages, and ratings (on a 5-point scale) on campaign usefulness and appeal. These were followed by a series of open-ended questions to assess syphilis knowledge that included modes of transmission, groups most affected by the disease, symptoms of syphilis, risk reduction, and the connection between the syphilis and HIV. Respondents were also asked about sexual practices, including the number of casual sex partners, the number of sex club and bathhouse visits, and the number of sex partners met through the Internet in the past month. Casual partners were defined as those they considered casual acquaintances or people they had just met for the first time. Finally, respondents were asked about their concern for acquiring syphilis, how many times they were tested for syphilis in the past 6 months, reasons for not testing, and their HIV status.
Frequencies, chi-squared tests, t tests, and logistic regressions were performed using SPSS 11.5 for Windows. Data analysis was based on the number of respondents for each question; missing values were excluded.
Two hundred forty-four interviews were completed and included in the analyses. The sample of men was comprised of 97% males and 3% transgenders. Ninety percent of the sample included men who have sex with men (MSM) and the remaining 10% included men who have sex with men and women (MSM/W). The majority of participants were white (64%) followed by Latinos (18%), Asians (12%), blacks (4%), and other ethnicities (1%) with a median age of 34 years ranging from 19 to 58 years. The majority reported an HIV-negative status (71%) followed by 20% reporting an HIV-positive status, 4% unsure of their status, and 5% refusing to provide their status.
A majority (80%) of the sample was aware of the Healthy Penis campaign; 33% spontaneously mentioned the Healthy Penis campaign (unaided awareness) when asked to recall advertisements or public events about sexual health issues, and an additional 47% recognized the campaign (aided awareness) when shown a campaign image. Among those aware of the campaign, 27% indicated being exposed to it during the first week after launch in June 2002 with a majority, 67%, having been exposed since September 2002. Respondents also reported being repeatedly exposed to the campaign an average of 32.3 times (median, 12) since June 2002.
Perceptions of key messages among respondents who were aware of the campaign included a variety of mentions with a plurality stating that it was about getting tested (42%). In addition, respondents mentioned that the campaign was about the syphilis increase among MSM (30%), syphilis in general (28%), practicing safer sex (23%), STDs in general (10%), using condoms (9%), syphilis being curable (5%), and the relationship between syphilis and HIV transmission (2%).
Respondents who were aware of the campaign (i.e., spontaneous mention or recognition of the campaign) were significantly more likely to report specific modes of syphilis transmission, symptoms of syphilis, appropriate risk reduction strategies, the population most affected by syphilis in San Francisco, and to identify the link between syphilis and HIV transmission (see Table 1).
Respondents with unaided campaign awareness were significantly more likely to mention contact with sores (chi square[1, 194] = 6.07, P < 0.05) and vaginal sex (chi square[1, 194] = 5.92, P < 0.05) as modes of transmission for syphilis and a painless sore (chi square[1, 194] = 5.21, P < 0.05) as a common early symptom of syphilis.
Those aware of the campaign reported significantly more casual sex partners in the past month than those unaware of the campaign (mean of 3.43 partners vs. mean of 2.06 partners, respectively; t[1, 103] = 2.55, P = 0.012). Similarly, those aware of the campaign reported significantly more visits to commercial sex venues in the past month (mean = 0.62 vs. 0.14; t[1, 234] = 3.42, P = 0.001) and more Internet sex partners in the past month (mean = 1.83 vs. 0.76; t[1, 169] = 3.55, P < 0.001) than their unaware counterparts.
Syphilis Testing in the Last 6 Months
Awareness of the campaign was significantly associated with having had a syphilis test in the past 6 months. Forty-six percent among those aware of the campaign were tested for syphilis in the past 6 months compared with 26% unaware of the campaign (chi square[1, 244] = 6.77, P = 0.009). After controlling for potential confounders in a multivariate logistic regression model (Table 2), those who had unaided campaign awareness were 3.2 times more likely to have tested for syphilis than those unaware of the campaign. HIV-positive status (odds ratio [OR], 4.0) and having had casual partners (OR, 3.0) were also significant independent correlates of having tested recently.
Among the 102 men who saw the campaign but did not test, a plurality cited low or no risk as the reason (22%), followed by reasons such as being in a monogamous relationship (14%), having no symptoms or feeling healthy (12%), having no need to (12%), not getting around to it (9%), and having been tested or treated for syphilis more than 6 months ago (7%). Only 4% said it was not convenient to test for syphilis.
The Healthy Penis 2002 campaign was associated with significant increases in syphilis awareness, knowledge, and testing. The evaluation showed that the campaign was effectively promoted because a majority (80%) of gay and bisexual men surveyed in the target neighborhoods was aware of the campaign. The results also showed that those aware of the campaign had been repeatedly exposed to it since the launch in June 2002. More importantly, one third of the sample spontaneously mentioned (unaided awareness) the campaign when asked to “recall any ads or public events that provided information about sexual health issues.” Analogously, when consumers recall a particular brand (e.g., Coke) when asked to consider a product class (e.g., soft drinks), that brand is much more likely to get on the shopping list.13 Similarly, the recall of Healthy Penis 2002 suggests the campaign had a strong presence in the San Francisco area among gay and bisexual men and that these men were likely to spontaneously consider campaign messages when thinking about sexual health issues. This is important because respondents who were exposed to the campaign mentioned that it was about getting tested for syphilis, syphilis among gay and bisexual men, something about syphilis in general, and practicing safer sex. Indeed, the testing behavior and syphilis knowledge among respondents who were aware of the campaign reflect this pattern of campaign perceptions.
Unaided campaign awareness was significantly related to syphilis testing after controlling for potential confounders in a multivariate logistic regression. Specifically, respondents who spontaneously mentioned the campaign (unaided awareness) were 3 times more likely to have been tested for syphilis in the past 6 months than respondents who were unaware of the campaign. These results suggest that the campaign played an augmenting role in syphilis testing among gay and bisexual men, and that the campaign achieved its primary goal of increasing syphilis testing.
Respondents who were aware of the campaign demonstrated more knowledge about syphilis in terms of modes of transmission, symptoms, risk-reduction strategies, groups most affected by the disease, and the relationship between the disease and HIV. These results suggest the campaign also achieved the secondary goal of increasing knowledge around syphilis among gay and bisexual men.
The Healthy Penis campaign was developed to target high-risk gay and bisexual men, and did so by being prominently displayed in sex clubs, bars, and banner ads on a popular web site for meeting sex partners. Higher-risk subgroups of this population appeared to have been reached because respondents who were aware of the campaign also reported significantly more anonymous sex partners, commercial sex venue visits, and Internet partners than their unaware counterparts. Hence, results strongly suggest that campaign materials reached and appealed to higher-risk segments of the gay and bisexual community in San Francisco.
This evaluation had some limitations. Although we attempted to recruit a diverse sample of gay and bisexual men in the San Francisco area, our convenience sample may not be representative of this population and our results may not be fully generalized. The evaluation used a cross-sectional design. Therefore, the results only report association and cause–effect relationships cannot be inferred. However, despite these limitations, all data were gathered through face-to-face interviews and the interviewer recorded responses without providing participants with a list of possible response sets. This method of collecting data eliminates the possibility that respondents made “best-guess” responses on campaign awareness and syphilis knowledge items. Additionally, as a result of the cross-sectional study design, it was possible to compare respondents who were exposed to the campaign with those who were not.
Overall, the results strongly suggest that the Healthy Penis 2002 social marketing campaign was effective in increasing syphilis awareness, increasing knowledge around syphilis, and augmenting syphilis testing in the San Francisco gay and bisexual community. The high recall and recognition of Healthy Penis indicates it has a strong brand presence in the gay and bisexual community that presents an opportunity to incorporate or shift to other health messages as public health needs change for the target audience. For instance, future campaigns with the Healthy Penis brand can focus on health behavior messages related to herpes simplex virus, hepatitis C, or human papillomavirus.
1. STD Prevention and Control Services. San Francisco Sexually Transmitted Disease Annual Summary, 2002. San Francisco: San Francisco Department of Public Health, 2003.
2. Kent CK, Wolf W, Nieri G, Wong W, Klausner J, Peterman T. Internet use and early syphilis infection among men who have sex with men: San Francisco, California, 1999–2003. MMWR Morb Mortal Wkly Rep 2003; 52:1229–1232.
3. Katz M, Schwarcz SK, Kellogg T, et al.. Impact of highly active antiretroviral treatment on HIV seroincidence among men who have sex with men: San Francisco. Am J Public Health 2002; 92:388–394.
4. Scheer S, Chu P, Klausner J, Katz M, Schwarcz SK. Effect of highly active antiretroviral therapy on diagnoses of sexually transmitted diseases in people with AIDS. Lancet 2001; 357:432–453.
5. Chen S, Gibson S, Katz M, et al.. Continuing increases in sexual risk behavior and sexually transmitted diseases among men who have sex with men: San Francisco, 1999–2001. Am J Public Health 2002; 92:1387–1388.
6. Ostrow D, Fox K, Chmiel J, et al.. Attitudes towards highly active antiretroviral therapy are associated with sexual risk taking among HIV-infected and uninfected homosexual men. AIDS 2002; 16:775–780.
7. Vanable P, Ostrow D, McKirnan D, Taywaditep K, Hope B. Impact of combination therapies on HIV risk perceptions ans sexual risk among HIV-positive and HIV-negative gay and bisexual men. Health Psychol 2000; 19:134–145.
8. Vanable P, Ostrow D, McKirnan D. Viral load and HIV treatment attitudes as correlates of sexual risk behavior among HIV-positive gay men. J Psychosom Res 2003; 54:263–269.
9. Klausner J, Wolf W, Fischer-Ponce L, Zolt I, Katz M. Tracing a syphilis epidemic through cyberspace. JAMA 2000; 284:485–487.
10. Elford J, Bolding G, Sherr L. Seeking sex on the Internet and sexual risk behaviors among gay men using London gyms. AIDS 2001; 15:1409–1415.
11. Kim A, Kent CK, McFarland W, Klausner J. Cruising on the Internet highway. J Acquir Immun Defic Syndr 2001; 28:89–93.
12. Lamtey PR, Price JE. Social marketing sexually transmitted disease and HIV prevention: A consumer-centered approach to achieving behavior change. AIDS 1998; 12(suppl 2):S1–S9.
13. Aaker DA. Building Strong Brands. New York: The Free Press, 1996.
© Copyright 2005 American Sexually Transmitted Diseases Association
14. Andreasen AR, Marketing Social Change. Changing Behavior to Promote Health, Social Development, and the Environment. San Francisco: Jossey-Bass Publishers, 1995.