Background and Objectives: Human immunodeficiency virus (HIV) counseling, testing, and referral (CTR) are provided in a wide variety of settings.
Goal: To compare, by test setting, the perceptions of the testing experience among HIV-positive persons who were not receiving medical care.
Design: A baseline questionnaire was administered at enrollment into the Antiretroviral Treatment Access Study by the use of audio computer-assisted self-interview.
Results: Of 316 respondents, 27% reported that the counselor did not spend enough time with them and 22% that the counselor did not answer all questions. The odds were higher that persons in the following settings, compared with those at HIV test sites, would report that the counselor did not spend enough time with them: office of private physician or health maintenance organization (HMO) (adjusted odds ratio [AOR], 5.24; 95% confidence interval, 1.26–21.7), jail (AOR, 5.10; 95% CI, 1.06–24.6), and emergency room (ER) or hospital overnight visit (AOR, 2.93; 95% CI, 1.15–7.44). Similarly, the odds were higher that persons in the following settings compared with those at HIV test sites would report that the counselor did not answer all questions: office of private physician or HMO (AOR, 9.62; 95% CI, 2.22–41.7), jail (AOR, 7.87; 95% CI, 1.50–41.4), and ER or hospital overnight visit (AOR, 3.32; 95% CI, 1.11–9.90).
Conclusion: Further training and quality assurance in HIV CTR may be needed in some test settings.
A study of human immunodeficiency virus (HIV)&#x2013;positive persons not in medical care found that further training and quality assurance in HIV counseling, testing, and referral services may be needed in some test settings.
From the *Sexually Transmitted Diseases Program, Los Angeles Health Department, Los Angeles, California; †Health Research Association, Los Angeles, California; ‡Department of Epidemiology, Boston University, Boston, Massachusetts; §Department of Epidemiology, Johns Hopkins University, Baltimore, Maryland; ¶Department of Epidemiology and Public Health, University of Miami, Miami, Florida; ∥Division of HIV/AIDS Prevention, National Center for HIV, STD, and TB Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia; and the #Center for AIDS Research, Emory School of Medicine, Atlanta, Georgia
The ARTAS group consists of the authors and Dr Lytt I. Gardner, Dr Scott D. Holmberg, Dr Stephanie L. Sansom, Dr Ramses Sadek, Zaneta Gaul, and Christopher S. Krawczyk from the Centers for Disease Control and Prevention; Dr Carlos del Rio, Sonya Green, Maribel Barragan, Dr Wayne Duffus, Dr Michael Leonard, Christine O’Daniels, Catherine Abrams, Felicia Berry, Valerie Hunter, Howard Pope, and Giselle C. Hicks from the Emory University School of Medicine, Division of Infectious Diseases; Dr Steffanie Strathdee, Dr Anita Loughlin, Steven Huettner, Matt Woolf, Ovedia Burt, and Janet Reaves, from the Johns Hopkins Bloomberg School of Public Health; Dr Pamela Anderson-Mahoney, Dr Peter Kerndt, Bobby Gatson, Brandon Schmidt, Norma Perez, Amy Chan, Lawrence Fernandez, Jr, Shannon Curreri, Eric Valera, Stella Gutierrez, from Health Research Association; Dr Lisa Metsch, Dr Clyde McCoy, Dr Gordon Dickinson, Dr Toye Brewer, Dr Orlando Gomez, Eduardo Valverde, Brad Wohler-Torres, Lauren Gooden, Dr Wei Zhao, Faye Yeomans, and Yolanda Davis Camacho from the University of Miami School of Medicine; and Dr Harvey A. Siegal, Richard C. Rapp, Teri L. Rust, and Dr Jichuan Wang, from the Wright State University School of Medicine. The authors thank Marie Morgan for her detailed editorial review of an earlier draft of the manuscript. The preparation of this manuscript was supported in part by the National Research Services Award T32 HS00046 from the Agency for Health Care Research Quality.
Correspondence: Ellen Thometz Rudy, Los Angeles Health Department Sexually Transmitted Disease Program, 2615 S. Grand Avenue, Los Angeles, CA 90007. E-mail: firstname.lastname@example.org.
Received for publication June 16, 2004, and accepted September 9, 2004.
HUMAN IMMUNODEFICIENCY VIRUS (HIV) prevention counseling, testing, and referral (CTR) play a critical role in HIV prevention in the United States.1 Early knowledge of HIV infection has been shown to lead to behavior change that has reduced the risk of transmission of HIV and other sexually transmitted diseases (STDs).2–4 Despite the widespread availability of HIV testing, an estimated 200,000 HIV-infected persons in the United States are unaware of their serostatus,5 and many receive a diagnosis of acquired immunodeficiency syndrome (AIDS) shortly after a positive result from their initial HIV test.6–8 Reasons for not being tested sooner include perceived low risk,9–12, denial of risk,10,11 fear of results,9,11,12 and fear of discrimination.9,13 Moreover, many persons living with HIV delay seeking medical care, treatment, or preventive services.8,14 One study noted a significant proportion of persons waited over a year after their HIV-positive test result to enter into HIV medical care.15 Delayed medical care may be partly due to the lack of awareness or denial of being infected with HIV and partly due to the inaction of the test setting to give referrals or follow-up whether the client accessed referral services.7,8,15
Historically, HIV testing has been offered at publicly funded HIV test sites and in clinical settings that serve populations at high risk of acquiring HIV infection.16 In 1996, of the approximately 24 million HIV tests performed, only 2 million were performed at HIV test sites; most were performed in medical care settings such as the offices of physicians or health maintenance organizations (HMOs).17 In 2001, the Centers for Disease Control and Prevention (CDC) revised the guidelines for HIV CTR and highlighted the importance of early knowledge of HIV status and of making HIV testing more accessible and addressed ways to improve the quality of HIV CTR in diverse settings.1 Several studies have shown the benefit of HIV screening in emergency rooms (ERs), hospitals, and urgent-care settings.18–20 In 2003, the CDC advocated HIV prevention be incorporated into routine medical care and in high-prevalence areas outside medical settings, such as jails.21
The CDC guidelines recommend that all settings periodically assess the quality of their HIV CTR services to ensure that clients’ needs and expectations are met.1 Greater patient satisfaction has been associated with adherence to prescribed medical care and treatments and with the use of health services.22,23 Little attention has been given to the evaluation of clients’ perceptions of the CTR experience in any setting.24 According to studies that have been focused on the process of HIV testing and counseling, persons who had been tested considered the following important: the emotional support provided by the counselor, the quality of the information given, and referrals to preventive and social services.25,26–28 Not receiving sufficient information or not having enough time with the counselor was associated with less satisfaction with the HIV testing process.25,29 One study found that freestanding HIV test sites performed better in terms of client-centered counseling than did STD clinics, drug-treatment centers, and family-planning clinics.30 More research is needed to better understand how the HIV CTR experience in varied settings could be improved for the diverse populations served.
We assessed the quality of HIV CTR from the perspective of the HIV-positive client in a variety of settings. We compared perceptions of the CTR experience by type of test setting among HIV-positive persons who were not receiving medical care.
Materials and Methods
We surveyed HIV-positive adults who were not receiving medical care and who were enrolled in the Antiretroviral Treatment Access Study, a multicity, randomized, intervention trial designed to facilitate linkage to, and the sustained use of, HIV medical care. Details of the intervention trial are presented elsewhere.31 Participants were recruited from STD clinics, community clinics, public health departments, university-based research clinics, drug-treatment centers, inpatient services in hospitals, HIV test sites, and through local advertisements in Atlanta, Baltimore, Los Angeles, and Miami. Recruiters did not directly approach persons about screening for the study; instead, clinic and agency personnel provided potential participants with brief information about the study and then referred interested participants to study recruiters. Eligibility was restricted to HIV-positive persons who had never received antiretroviral therapy and who had not visited an HIV medical care provider more than once. Enrollment of participants began in March 2001 and was completed in May 2002. Participants were scheduled for 6- and 12-month follow-up interviews. Clients were compensated $25 for the baseline interview, $30 for the 6-month follow-up, and $35 for the 12-month follow-up interview. Questionnaires were administered by the use of audio computer-assisted self-interview32 using the NOVA Research Company, Questionnaire Development System, version 1.1 software.33 Institutional review boards at the CDC and all localities approved the study.
The baseline questionnaire comprised demographics, HIV testing history, HIV risk information, knowledge and attitudes about HIV care and treatment (including antiretroviral therapy), barriers to care such as lack of transportation or time and competing life stresses, past and current drug use, legal issues and life events, social service needs, and social support. Our analysis was focused on the response to 5 questions that measured the perception of HIV counseling and testing quality: Did the counselor answer all your questions? Did the counselor spend enough time with you? Were you treated with respect? Were you told where to receive health care? and Were you referred to a case manager? Response choices included yes, no, and did not receive counseling. We collapsed the responses no and did not receive counseling into 1 category for analysis. We included 9 types of testing sites in our analysis: HIV test sites, STD clinics, HIV/AIDS and infectious disease clinics, drug-treatment centers, family-planning clinics, offices of physicians or HMOs, ER/hospitals, jails, and blood banks. All tests at ER/hospitals were performed in the acute-care setting.
We explored other variables that may affect the HIV CTR experience. We included age, gender, and sexual orientation in all our models, assuming that these variables are related to the HIV CTR quality outcomes. We identified potential confounders in 2 ways. First, site of study and “time since first positive HIV test result” were identified a priori as confounders and included in all models. We included site of study in our models to control for potential selection confounding due to different recruitment methods among the study sites. We included the variable “time since first positive HIV test result” to control for potential recall and response bias from participants with differing lengths of time since their HIV CTR experience. Second, we identified a list of potential confounders and used a forward-selection strategy, forcing each potential confounder in the models, and tested the confounder-outcome association without adjustment for other potential confounders. Variables with a P value of less than 0.20 were kept in the models. Limited model-simulation studies have shown that raising the P value to 0.20 for rejecting the null provides adequate power to detect important confounder effects.34,35 Potential confounders included race/ethnicity, income, education, insurance status, unprotected sex with an HIV-negative partner or a partner of unknown HIV status during the past 30 days, heroin use during the past 30 days, and crack use during the past 30 days.
All analyses were performed by using Statistical Analysis Software (SAS), version 8.2,36 and Stata, version 8.0.37 We used the Pearson χ2 test in bivariate analysis to estimate the association of the main exposure variable, HIV testing setting, and the other selected variables with the outcome variables, the 5 questions that measured the perception of HIV counseling and testing quality. Unadjusted and adjusted prevalence odds ratios (ORs) and 95% exact confidence intervals (CIs) were estimated by logistic regression.
A total of 316 persons were enrolled. Most were men (72%), and the average age was 37 years (SD = 8.9 years). By race/ethnicity, 58% were black, 27% Hispanic, 9% white, and 6% mixed or other ethnicities. Most (66%) of participants reported an income of less than $10,000 per year; 84% did not have health insurance. In response to questions about risk behaviors during the past 30 days, 27% reported crack use, 27% reported unprotected sex with a partner who was HIV negative or of unknown HIV status, and 13% reported heroin use.
Of the total, 81% had a recent (within the past year) diagnosis of HIV infection; 48% received the diagnosis after their first HIV test. The most common reasons for getting an HIV test were as follows: possibility of having been exposed or just a desire to know (46%), feeling sick (26%), and testing recommended by a physician (14%). Participants had been tested most recently at various settings: 28% in an ER or during a hospital visit, 21% at an STD clinic, 18% at an HIV test site, 7% at an AIDS or infectious disease clinic, and 4% in the office of a private physician or an HMO. The participants’ responses to the 5 HIV counseling quality questions were as follows: 55% reported that the counselor did not refer them to a case manager; 27% that the counselor did not spend enough time with them; 22% that the counselor did not answer all of their questions, 20% that they were not told where to receive care; and 7% that they were not treated with respect.
To better understand the participants’ choice of testing setting, we looked at the frequency of reasons for getting an HIV test at the various settings (Table 1). Of the 83 persons tested in ERs or hospitals, 48 reported that they had sought testing because they were sick. Of the 21 clients who reported going to an AIDS/infectious disease clinic for testing, 13 reported that they thought they had been exposed or just wanted to know, 6 reported they were sick, and 2 that testing had been recommended by a physician.
The testing settings differed significantly in the proportion of persons who reported inadequate counseling services (i.e., answered no to one of the questions about the quality of HIV counseling) (Table 2). The smallest proportions of persons who reported inadequate counseling services were tested at family planning clinics and blood banks; the largest proportions were tested in jails or the offices of private physicians or HMOs.
By other bivariate analysis, a higher proportion of whites, compared with blacks or Hispanics, reported not having all their questions answered (P = 0.03) and not being given enough time (P ≤ 0.01). A larger proportion of the persons with health insurance reported that not all of their questions were answered (P = 0.01), that they were not treated with respect (P ≤ 0.01), and that they were not told where to receive care (P = 0.04). A larger proportion of the persons who reported crack cocaine use during the past 30 days reported that they were not given enough time (P = 0.03).
Final multivariate analyses of counseling quality indicators among HIV testing settings are presented in Table 3. The outcome variable “not treated with respect” was not modeled because of sparse data. In all the final models of quality outcome, we included age, gender, sexual orientation, site of study, time since first positive HIV test result, and crack use during the past 30 days. Race/ethnicity was included in the models for whether the counselor answered all questions, spent enough time with the person, and told the person where to receive care. Having insurance was included in the model for whether the counselor answered all questions, education was included in the model for whether the counselor spent enough time with the person tested, and heroin use during the past 30 days was included in the model for whether the counselor told the person where to receive care. In the adjusted analysis, persons tested in the office of private physicians or HMOs (OR, 9.62; 95% CI, 2.22–41.7), jails (OR, 7.87; 95% CI, 1.50–41.4), and ERs/hospitals (OR, 3.32; 95% CI, 1.11–9.90), compared with those at HIV test sites, were more likely to report that the counselor did not answer all their questions, and persons tested in the offices of private physicians or HMOs (OR, 5.24; 95% CI, 1.26–21.7), jails (OR, 5.10; 95% CI, 1.06–24.6), and ERs/hospitals (OR, 2.93; 95% CI, 1.15–7.44), compared with the HIV test sites, were more likely to report that the counselor did not spend enough time with them. Analysis by race/ethnicity yielded higher odds that whites, compared with blacks, reported that the counselor did not answer all their questions (OR, 3.89; 95% CI, 1.42–10.6) and that they were not told where to receive care (OR, 3.30; 95% CI, 1.22–8.95). Persons who used crack cocaine, compared with persons who did not use crack cocaine, were more likely to report that the counselor did not spend enough time with them (OR, 2.26; 95% CI, 1.08–4.77). No significant differences among age groups or between genders in the perception of HIV testing services were found in the final multivariate models.
Expanding HIV CTR services to a wide variety of settings while ensuring the provision of high-quality HIV CTR services predominates the 2001 revised CDC HIV CTR guidelines.1 More recent guidelines further emphasize HIV testing as part of routine medical care and in high-prevalence areas outside the medical setting, including jails.21 Our survey of HIV-positive persons not in medical care revealed deficiencies in the HIV counseling services in jails, in offices of private physicians or HMOs, as well as in ERs or hospitals. Persons who tested in these settings were more likely to report that the counselor did not answer all of their questions or did not spend enough time with them. Interpersonal skills such as the counselor’s ability to convey emotional support25,28 and use active listening skills1 have been identified as important contributors to greater satisfaction and better outcomes among clients.25,38 All settings should integrate a basic HIV counseling training program that trains counseling staff to engage the client to identify his or her risk of acquiring or transmitting HIV and to set attainable goals to reduce this risk. Additional training for HIV counseling staff may focus on developing interpersonal skills and may be improved by, for example, training staff in answering the unasked question, in conveying support and establishing trust, and by enabling and encouraging staff to allow enough time to answer all questions. Given the CDC’s commitment to the provision of high-quality HIV CTR services and its recent progress to integrate routine HIV testing in medical care settings and rapid HIV testing in jails,39 our data underscore a need to incorporate counseling training and evaluation in all settings to ensure high-quality HIV counseling services. The CDC revised guidelines for HIV CTR may provide a foundation on which testing settings can build HIV counseling and quality-assurance protocols specific to their setting and population.
A large proportion of our respondents had been tested in an ER or a hospital; 48% reported that they sought testing because they were feeling sick. ERs and hospitals have an opportunity to test persons (asymptomatic or symptomatic) who do not have access to regular medical care. According to one study, persons who perceived their risk as low (e.g., those in monogamous relationships) became aware of their HIV-positive serostatus at urgent-care centers.20 Routine testing in hospitals has been suggested for areas with an HIV prevalence rate of >1%.40 Our data support the importance of expanding testing to persons who, unaware of their own risk, do not seek voluntary testing.
Findings from our study indicate deficiencies in the referral process in some settings. All participants in the study were HIV positive and not engaged in regular HIV medical care. It is significant to note that 21 participants, 6 of whom (33%) reported feeling sick as the reason they sought care, tested at AIDS/infectious disease clinics and were still not linked to regular HIV medical care. These participants exemplify the missed opportunities to link HIV-positive persons to medical care. In addition, 20% (63 out of 316) of the cumulative total of persons who tested in the various settings reported they were not told where to receive care. Some of these persons’ recall may have been limited either due to the lapse in time since they received their diagnosis or due to the difficulty absorbing the information given to them at the time they learned they were infected. It is unclear in this study whether poor counseling experience affected the study population’s linkage to care; however, poor counseling experience may directly or indirectly affect a person’s care seeking behavior by lowering a person’s self-efficacy to seek care or adversely affecting a person’s attitude about and motivation to seek care. Factors that affect HIV-positive persons’ perceptions of HIV testing services and the impact of counseling services on linkage to care deserve further research attention. Nevertheless, our data highlight the importance of counselors to assess the referral needs of their clients and to follow up persons newly diagnosed with HIV to ensure they enter into sustained medical care.
Our survey may reflect a need for all settings to increase their number of referrals to a case manager.41 Case management has been shown to influence positively the proportion of HIV-positive persons who receive medical care,31 underserved youths’ access to HIV medical care,42 and infected persons’ use of community-based support services.43 Persons who used crack cocaine, compared with persons who did not, reported that they were not given enough time. This finding is consistent with the findings of other studies that crack users are disadvantaged in regard to receiving HIV primary care.44,45 Crack users are also at increased risk for HIV transmission and may need more counseling time because of their comorbid substance abuse problem; they may especially benefit from case management focused on their needs. More whites compared with blacks reported inadequacies. Whites may have higher expectations of services than do members of racial minority groups who have a history of institutional discrimination and who have less access to health care.46 Whites in our study had similar income distributions and HIV testing frequency at offices of physicians or HMOs compared with other race/ethnicity groups. However, it may be worth exploring in future studies whether time constraints associated with testing in offices of physicians or HMOs may be a reason that counseling was considered inadequate, especially among whites, who are generally more likely to receive services at these settings.47
Our study was limited by the use of convenience, rather than population-based, sampling; our sample included persons with a new diagnosis and persons who had known for several years that they were infected. However, the sample was recruited from diverse settings, including STD clinics, community clinics, public health departments, university-based research clinics, drug-treatment centers, inpatient services in hospitals, HIV test sites, and through local advertisements. In multivariate analysis, we included the site to control for differing recruitment methods and the time since diagnosis to control for recall bias. The small sample size limited the numbers in some strata (e.g., n = 10 in jails) and the precision of the estimates. Additionally, participants may have had a limited understanding of the title case manager or the difference between referrals to case managers and referrals to medical care, introducing another potential source of bias. According to one study, virtually all clients could identify someone who had helped them acquire services, but not all clients identified that person as a case manager.48
In summary, the revised CDC HIV CTR guidelines highlight elements that could improve effective counseling and referral process and reduce the deficiencies reported in our study. Effective counselors need not have an advanced degree or extensive experience but must have basic HIV counseling training that aims to reduce the client’s risk of acquiring or transmitting HIV infection. Additional counselor training that enhances interpersonal skills and the ability to assess client’s needs and make appropriate referrals may lead to more effective counseling and greater client satisfaction with the HIV CTR process. Because of the advent of rapid HIV testing, an optimal choice in some settings might be to designate a trained staff member to do counseling, referrals, and follow-ups for persons with newly diagnosed HIV infection. Nevertheless, further research is imperative to determine the sufficient counseling practices that meet the needs and expectations of clients in all HIV testing settings and result in early access to care for persons with newly diagnosed HIV infection. The information from such research can supplement the CDC HIV CTR guidelines, ensuring optimal benefits from the guidelines and high-quality services for everyone who is tested.
1. Centers for Disease Control and Prevention. Revised guidelines for HIV counseling, testing, and referral. MMWR Recomm Rep 2001;50:1–57.
2. Wolitski RJ, MacGowan RJ, Higgins DL, et al. The effects of HIV counseling and testing on risk-related practices and help-seeking behavior. AIDS Educ Prev 1997;9:52–67.
3. Higgins DL, Galavotti C, O'Reilly KR, et al. Evidence for the effects of HIV antibody counseling and testing on risk behaviors. JAMA 1991;266:2419–2429.
4. Weinhardt LS, Carey MP, Johnson BT, et al. Effects of HIV counseling and testing on sexual risk behavior: a meta-analytic review of published research, 1985–1997. Am J Public Health 1999;89:1397–1405.
5. Sweeney P, Fleming P, Karon J. Minimum estimate of the number of living HIV infected persons confidentially tested in the United States [abstract I-16]. 37th Interscience Conference on Antimicrobial Agents and Chemotherapy: Toronto, 1997.
6. Klein D, Hurley LB, Merrill D, et al. Review of medical encounters in the 5 years before a diagnosis of HIV-1 infection: implications for early detection. J Acquir Immun Defic Syndr 2003;32:143–152.
7. Hocking JS, Rodger AJ, Rhodes DG, et al. Late presentation of HIV infection associated with prolonged survival following AIDS diagnosis: characteristics of individuals. Int J STD AIDS 2000;11:503–508.
8. Samet JH, Freedberg KA, Savetsky JB, et al. Understanding delay to medical care for HIV infection: the long-term non-presenter. AIDS 2001;15:77–85.
9. Spielberg F, Branson BM, Goldbaum GM, et al. Overcoming barriers to HIV testing: preferences for new strategies among clients of a needle exchange, a sexually transmitted disease clinic, and sex venues for men who have sex with men. J Acquir Immun Defic Syndr 2003;32:318–327.
10. Kellerman SE, Lehman JS, Lansky A, et al. HIV testing within at-risk populations in the United States and the reasons for seeking or avoiding HIV testing. J Acquir Immun Defic Syndr 2002;31:202–210.
11. Battle RS, Cummings GL, Yamada KA, et al. HIV testing among low-income African-American mothers. AIDS Educ Prev 1996;8:165–175.
12. Boyd FM, Simpson WM, Hart GJ, et al. What do pregnant women think about the HIV test? a qualitative study. AIDS Care 1999;11:21–29.
13. Centers for Disease Control and Prevention. HIV testing among populations at risk for HIV infection: nine states, November-December 1996. MMWR Morb Mortal Wkly Rep 1998;47:1086–1091.
14. Samet JH, Freedberg KA, Stein MD, et al. Trillion virion delay: time from testing positive for HIV to presentation for primary care. Arch Intern Med 1998;158:734–740.
15. Samet JH, Retondo MJ, Freedberg KA, et al. Factors associated with initiation of primary medical care for HIV-infected persons. Am J Med 1994;97:347–353.
16. Centers for Disease Control and Prevention. Technical guidance on HIV counseling: Centers for Disease Control and Prevention. MMWR Recomm Rep. 1993;42:11–17.
17. Valdiserri RO, Holtgrave DR, West GR. Promoting early HIV diagnosis and entry into care. AIDS 1999;13:2317–2330.
18. Kelen GD, Hexter DA, Hansen KN, et al. Feasibility of an emergency department-based, risk-targeted voluntary HIV screening program. Ann Emerg Med 1996;27:687–692.
19. Walensky RP, Losina E, Steger-Craven KA, et al. Identifying undiagnosed human immunodeficiency virus: the yield of routine, voluntary inpatient testing. Arch Intern Med 2002;162:887–892.
20. Walensky RP, Losina E, Malatesta L, Barton G, McGuire JF, Freedberg KA. The high yield of routine HIV screening in urgent care sites in Massachusetts [abstract 39]. 10th Conference on Retrovirus and Opportunistic Infections. 2003; Boston, MA.
21. Centers for Disease Control and Prevention. Advancing HIV prevention: new strategies for a changing epidemic-United States, 2003. MMWR Morb Mortal Wkly Rep 2003;52:329–332.
22. Kane RL, Maciejewski M, Finch M. The relationship of patient satisfaction with care and clinical outcomes. Med Care 1997;35:714–730.
23. Ware JE Jr, Davies AR. Behavioral consequences of consumer dissatisfaction with medical care. Eval Program Plan 1983;6:291–297.
24. Beardsell S, Coyle A. A review of research on the nature and quality of HIV testing services: a proposal for process-based studies. Soc Sci Med 1996;42:733–743.
25. Worthington C, Myers T. Desired elements of HIV testing services: test recipient perspectives. AIDS Patient Care STDS 2002;16:537–548.
26. Marx R, Hirozawa AM, Chu PL, et al. Linking clients from HIV antibody counseling and testing to prevention services. J Community Health 1999;24:201–214.
27. Pergami A, Catalan J, Hulme N, et al. How should a positive HIV result be given? the patients' view. AIDS Care 1994;6:21–27.
28. Kilmarx PH, Hamers FF, Peterman TA. Living with HIV: experiences and perspectives of HIV-infected sexually transmitted disease clinic patients after posttest counseling. Sex Transm Dis 1998;25:28–37.
29. McCann K, Wadsworth E. The experience of having a positive HIV antibody test. AIDS Care 1991;3:43–53.
30. Castrucci BC, Kamb ML, Hunt K. Assessing the Centers for Disease Control and Prevention's 1994 HIV counseling, testing, and referral: standards and guidelines: how closely does practice conform to existing recommendations? Sex Transm Dis 2002;29:417–421.
31. ARTAS Study Group. Initial results of the Antiretroviral Treatment Access Studies(ARTAS): efficacy of the case management trial [abstract B 1301]. 2003 National HIV Prevention Conference. 2003; Atlanta, GA.
32. Krawczyk CS, Gardner LI, Wang J, et al. Test-retest reliability of a complex human immunodeficiency virus research questionnaire administered by an audio computer-assisted self-interviewing system. Med Care 2003;41:853–858.
33. Questionnaire Development Software
. Ver. 1.01. Baltimore, MD: Nova Research Co; 1998.
34. Maldonado G, Greenland S. Simulation study of confounder-selection strategies. Am J Epidemiol 1993;138:923–936.
35. Rothman KJ, Greenland S. Modern Epidemiology
. Philadelphia, Pa: Lippincott-Raven; 1998.
. ver. 8.2. Cary, NC: SAS Institute, Inc; 2002.
37. Stata Statistical Software
. Ver. 8.0. College Station, Tex: Stata Corporation; 2003.
38. Tucker CM, Herman KC, Pedersen TR, et al. Cultural sensitivity in physician-patient relationships: perspectives of an ethnically diverse sample of low-income primary care patients. Med Care 2003;41:859–870.
40. Janssen RS, St Louis ME, Satten GA, et al. HIV infection among patients in U.S. acute care hospitals: strategies for the counseling and testing of the hospital patients: the Hospital HIV Surveillance Group. N Engl J Med 1992;327:445–452.
41. Katz MH, Cunningham WE, Fleishman JA, et al. Effect of case management on unmet needs and utilization of medical care and medications among HIV-infected persons. Ann Intern Med 2001;135:557–565.
42. Woods ER, Samples CL, Melchiono MW, et al. Initiation of services in the Boston HAPPENS Program: human immunodeficiency virus-positive, homeless, and at-risk youth can access services. AIDS Patient Care STDS 2002;16:497–510.
43. London AS, LeBlanc AJ, Aneshensel CS. The integration of informal care, case management and community-based services for persons with HIV/AIDS. AIDS Care 1998;10:481–503.
44. Melchior LA, Huba GJ, Gallagher T, et al. Unmet needs in groups of traditionally underserved individuals with HIV/AIDS: empirical models. Home Health Care Serv Q 2001;19:29–51.
45. Metsch LR, Pereyra M, Brewer TH. Use of HIV health care in HIV-seropositive crack cocaine smokers and other active drug users. J Subst Abuse 2001;13:155–167.
46. Jones CP. Levels of racism: a theoretic framework and a gardener's tale. Am J Public Health 2000;90:1212–1215.
47. Mayberry RM, Mili F, Ofili E. Racial and ethnic differences in access to medical care. Med Care Res Rev 2000;57(suppl 1):108–145.
48. Fleishman JA, Mor V, Piette J. AIDS case management: the client's perspective. Health Serv Res 1991;26:447–470.