INTRODUCTION
Since the availability of new HIV treatments in the late 1990s, HIV-related morbidity and mortality have substantially diminished in the United States and globally.1 However, inadequate adherence to HIV treatment recommendations [characterized by suboptimal adherence to scheduled HIV care visits and to a recommended antiretroviral therapy (ART) regimen] among people living with HIV (PLWH) remains a substantial public health challenge that must be addressed to continue to curb the HIV epidemic,2 particularly among vulnerable populations such as people of color. Visit adherence is a measure of engagement in HIV care that is defined as the number of kept/attended HIV care visits out of scheduled visits during a measurement period.3 Engagement in HIV medical care is important in providing and maintaining ART regimens. Suboptimal visit adherence is associated with poor adherence to ART, which has implications for viral nonsuppression and significant clinical drug resistance.4
Much of the existing literature on HIV stigma and health outcomes focuses on the association between HIV stigma and ART adherence. Several forms of HIV-related stigma (ie, perceived, anticipated, internalized, and enacted) have been conceptualized and operate as barriers to beneficial HIV-related behaviors and desired clinical outcomes.5,6 Internalized HIV-related stigma refers to acceptance and adoption of negative beliefs existing in society about being HIV-positive and applying them to oneself.5,7 Some recent literature suggests that internalized HIV-related stigma is particularly harmful to HIV treatment adherence.8–10 However, a recent systematic review found mixed results for the relationship between internalized stigma and ART adherence.11 Despite the growth of academic inquiry into HIV stigma and health, relatively little is known about the mechanisms that explain these relationships. It is also prudent to investigate the impact of HIV stigma on HIV medical care visit adherence in addition to ART adherence.
In the pathway to clinical outcomes, intrapersonal manifestations of stigma (such as internalized HIV-related stigma) are more proximal to HIV care outcomes than other interpersonal dimensions of stigma (such as perceived levels of HIV-related stigma in the community), perhaps because internalized HIV-related stigma has greater implications for affective, cognitive, and mental health outcomes of PLWH.5,6,9 Previous studies report that higher internalized HIV-related stigma is associated with lower ART adherence, and this relationship can be partially explained by affective processes.8,10 Indeed, there is a precedent in the literature that depression is a mechanism by which HIV stigma negatively impacts medication adherence.12
There is limited evidence to support negative effects of internalized HIV stigma on HIV care visit adherence. To date, a single study explored this association and found that internalized HIV stigma did not predict suboptimal HIV care visit adherence among men who have sex with men (MSM) in Boston, MA.13 Three additional studies have explored the association between internalized HIV stigma and other indicators of care connection and engagement (ie, delay in care seeking and presence of a regular source of HIV care) in diverse settings (ie, California and New York, USA; Bengaluru and Mumbai, India), with mixed results.5,14,15 Two of these existing studies suggest that high internalized stigma is related to poor engagement in HIV care,5,15 whereas the other study found evidence of an association between internalized HIV stigma and delays in medical care in bivariate analyses but not in multivariable analyses.11
Despite the importance of understanding specific mechanisms by which HIV-related stigma affects HIV visit adherence and other health outcomes,16 only one of the aforementioned studies examined potential intrapersonal mechanisms driving these associations.15 Existing literature suggests that mediators in the relationship between internalized HIV-related stigma and ART adherence are also associated with HIV care visit adherence. For instance, a recent study reported that the association between internalized HIV-related stigma and ART adherence is mediated in part by depressive symptoms among US women living with HIV.10 In the Boston-based study among MSM living with HIV, although stigma was not directly associated with medical visit adherence, clinical depression predicted suboptimal visit adherence.13
Given these findings, it is possible that intrapersonal mechanisms such as depression mediate the relationship between internalized HIV stigma and engagement in medical care. From a cognitive–behavioral perspective, negative thought patterns (such as negative self-statements inherent in internalized stigma) can lead to problematic affective states such as depressive symptoms.17,18 Furthermore, the feedback loop between negative cognitive patterns and a depressed affective state may ultimately impact behavior and the way individuals interact with their social environment.19 Considering the consistent links between internalized HIV stigma and depression in the literature,5,9,10,20,21 it is possible that depression partially accounts for the association between internalized stigma and visit adherence. However, this combination of predictors of visit adherence has not yet been tested in the literature.
This study aims to fill these gaps in the literature by examining the relationship between internalized HIV stigma and HIV care visit adherence, and the mediating role of depressive symptoms. Taking into account findings from the literature that visit adherence and adherence to ART are sequential steps in the HIV treatment cascade (which illustrates engagement in HIV care as a sequence of necessary steps from HIV infection to viral suppression),3 we also examine whether lower visit adherence mediates the effect of internalized HIV-related stigma on suboptimal adherence to ART. This analysis may yield knowledge that can be further examined using longitudinal data in the future. Subsequently, this analysis may lead to the identification of specific areas for intervention that could be incorporated in medical, psychological, and public health practice to improve engagement across the HIV care continuum.
METHODS
Participants and Procedures
Participants were 196 patients from the HIV clinic at the authors' institution, who participated in a larger study on psychosocial factors related to HIV outcomes from March 2013 to January 2015.8 Analyses included participants who were on ART, who reported substance non-use, and for whom clinical data on visit adherence were available. During pre-arranged research study appointments, participants completed study measures and demographic information via computer. Data on duration of ART utilization, HIV clinic visit appointments, and actual attendance were extracted from clinic records. The study was approved by the Institutional Review Board of the authors' institution, and all procedures were carried out with the adequate understanding and written consent of the participants.
Internalized HIV-Related Stigma
We used the negative self-image subscale of the revised HIV Stigma Scale22 to assess internalized HIV-related stigma. This 7-item measure comprised statements such as, “I feel I'm not as good as others because I have HIV/AIDS.” Agreement with each item was measured on a 4-point scale, from strongly disagree to strongly agree. A composite score for the subscale was calculated by averaging participant responses across items, yielding a range in scores from 1 to 4. The internal consistency of this subscale was adequate in the present study, Cronbach's alpha (α) = 0.85. Internalized HIV-related stigma was analyzed as a continuous measure.
Depressive Symptom Severity
The Patient Health Questionnaire-9 consists of 9 items with the stem: “Over the last 2 weeks, how often have you been bothered by any of the following problems?” An example item is: “Feeling down, depressed, or hopeless.” Participants used a rating scale ranging from 0 (not at all) to 3 (nearly everyday) to rate to how frequently they were affected by depressive symptoms. Participants also indicated their level of difficulty with engaging in daily activity, and with other people, because of depressive symptoms.23 Scores were summed across items yielding a possible range from 0 to 27, with higher scores indicating greater depressive symptom severity. In this study, reliability across items was adequate with a Cronbach's α of 0.87. Depressive symptom severity was treated as a continuous variable in analyses.
ART Adherence
ART adherence was assessed with the single question, developed by Lu et al24: “In the past 4 weeks, how was your ability to take all of your anti-HIV medications that were prescribed by your doctor?” (Medication adherence data were available for 179 participants.) Response options ranged from very poor to excellent. Because 71.5% of participants indicated excellent adherence, responses were dichotomized (excellent versus all other response options). According to previous literature, this measure is as good as or better than other self-report adherence measures.25 Although self-report measures may overestimate adherence, research has consistently demonstrated the predictive value of self-reported nonadherence (ie, nonoptimal adherence).26
HIV Visit Adherence
To calculate HIV visit adherence, data on HIV clinic appointments for the previous 24-month period were extracted from clinic records. We calculated adherence to HIV visits as the proportion of attended visits out of the number of total scheduled visits (total scheduled visits = attended visits plus no shows) that were not cancelled in advance by the clinic or by the patient.27 This measure has been used successfully in previous studies on HIV care engagement.28,29
Data Analyses
Descriptive analyses were performed to assess the distribution of participants according to age, race (black vs. white), gender, socioeconomic status level [indicated from lower (scored as 1) to upper (5)], and duration on ART. Multiple regression analysis was used to assess the association between internalized stigma and visit adherence. We tested the mediating role of depressive symptoms in the association between internalized stigma and ART adherence, and the mediating role of visit adherence in the association between internalized stigma and ART adherence by calculating bias-corrected confidence intervals (CIs) for the indirect effect using bootstrapping with Hayes' regression-based Process tool in SPSS.30 The following demographic and clinical variables were included as covariates in all analyses: age, gender, race, socioeconomic status, and duration on ART. Depressive symptom severity was also included as a covariate for all models in which it was not included as a mediator. In all statistical models, we applied a cutoff P-value of 0.05 and CI of 95%.
RESULTS
Demographic and clinical characteristics of the study sample (N = 196) are presented in Table 1. In a multiple regression analysis controlling for the covariates, higher internalized stigma was negatively associated with lower visit adherence (B = −0.04, SE = 0.02, t = −2.06, P = 0.04). Race and depressive symptoms were also significant predictors of visit adherence in this model. Specifically, black PLWH had lower visit adherence than white PLWH (B = −0.08, SE = 0.03, t = −0.22, P < 0.01), when accounting for internalized stigma and depressive symptoms. Depressive symptoms were negatively associated with visit adherence (B = −0.01, SE = 0.00, t = −2.09, P = 0.04).
TABLE 1.: Demographic and Health Information for the Study Sample (N = 196)
Mediation analysis did not yield a significant indirect effect of internalized stigma on visit adherence through depressive symptoms (B = −0.18, SE = 0.11, 95% CI: −0.44 to −0.02). Given that previous literature did not examine sex differences in the association between stigma and adherence, we examined the potential moderating role of sex in this mediated association. The index of mediated moderation was significant (B = −0.03, SE = 0.02, 95% CI: −0.07 to −0.002), suggesting that the mediation effect is stronger for men compared to women (63% vs. and 37%, respectively, in present sample). Follow-up analyses suggested that the mediation effect was significant for men (B = −0.03, SE = 0.02, 95% CI: −0.07 to −0.004), but not for women (B = 0.00, SE = 0.01, 95% CI: −0.01 to 0.01). The nonsignificant mediation among women may partly be because of lower sample size for women. However, the fact that the index of moderated mediation was significant suggests that the mediation effect is stronger for men compared to women.
The indirect effect of internalized stigma on ART adherence through visit adherence (B = −0.16, SE = 0.10, 95% CI: −0.43 to −0.01) was also significant (controlling for depressive symptoms and other covariates). All paths in this model are presented in Figure 1.
FIGURE 1.: Visit adherence mediates the effect of internalized stigma on medication adherence.
DISCUSSION
Although major advances in prevention and treatment of HIV have been made in recent decades, the epidemic persists in part because of challenges faced by PLWH in sustaining adherence to HIV treatments and treatment services. Experts in the HIV field have called for renewed efforts to address suboptimal engagement in HIV care by minimizing barriers to adherence to regular utilization of HIV medical care and to ART.31 HIV-related stigma is cited as a significant barrier to HIV treatment adherence.32 The current study examined the relationship between internalized HIV-related stigma and HIV visit adherence, mediated by depressive symptoms and separately, with downstream effects on ART adherence. Increased understanding of these relationships and mechanisms may inform the development and evaluation of strategies to reach optimal health outcomes for PLWH.
Our findings suggest that internalized HIV-related stigma is significantly associated with lower HIV care visit adherence, contrary to the nonsignificant results of a previous study exploring this relationship.13 Traeger et al measured internalized HIV stigma using a single item (“I feel ashamed that I have HIV”), which may have limited reliability and predictive validity to detect associated risks, as compared to the multi-item scale included in the current study. However, our results are consistent with previous studies using different measures of engagement in HIV care and conducted in other settings.5,15 Visit adherence is a particularly useful measure of care engagement for use in research studies, given that it assesses engagement in care with more granularity than other existing measures.33 Another important difference between these 2 studies is that the sample by Traeger et al included MSM living with HIV residing in a metropolitan area in the northeast, whereas our study population included men and women living with HIV in the Deep South. There may be geographic and cultural differences accounting for differences in findings between these 2 studies.
Another important finding was the association between race and visit adherence. Significant covariate-adjusted relationships between race and medication adherence suggesting black patients experience suboptimal ART adherence have also been observed in existing studies.34,35 The present study contributes that this relationship may be explained by disparities in visit adherence, supporting a previous study that suggested that racial differences in engagement in care contribute to downstream clinical consequences, and this effect is mediated by visit adherence.36 Future studies should explore the possibility that non–HIV-related and intersectional stigmas (ie, racism) contribute to these findings.37,38
The current study also suggests that depressive symptoms may mediate the association between internalized stigma and visit adherence among men only. In other words, men who experience greater internalized negative feelings about having HIV are more likely to also have greater depressive symptoms, which in turn may lead to lower visit adherence. The current contribution is consistent with the literature insofar as to suggest that internalized stigma operates through depressive symptoms to affect other HIV care continuum outcomes, particularly ART adherence. Our study diverges from existing literature in the suggestion that pathways from stigma to depression to engagement in HIV care could be more salient among men. This finding underscores the potential to address the effects of internalized stigma by addressing different processes in the pathway from stigma to outcomes and perhaps using gender-specific approaches. More specifically, our study supports the suggestion that multi-faceted approaches are required to improve treatment adherence and HIV-related health10; in particular, combined stigma reduction and engagement in HIV care interventions may provide novel strategies.39
The other primary result from this study was that HIV care visit adherence mediates the effect of internalized stigma on ART adherence. Specifically, we add to the scientific literature that internalized stigma leads to lower visit adherence, which leads to lower ART adherence. This finding can be understood in the context of previous studies that emphasize the importance of regular engagement in HIV care services along multiple stages of the spectrum of engagement in HIV care (from HIV-diagnosed to ART-adherent/undetectable) for the health and well-being of PLWH. Retention in HIV care, encompassed in part by visit adherence, is an intermediary but integral component of that spectrum.40 Individuals experiencing high internalized HIV-related stigma who do not present for HIV care visits may not benefit from aspects of the HIV care experience that act as facilitators to ART adherence, such as the patient–physician relationship,41,42 case management,43 patient education,44 and contact with others who share an HIV-positive status.45
Given the time points at which data were collected or extracted, it is possible that the time frames in which measures of internalized stigma, depression, and adherence were assessed may have overlapped or occurred in an alternate order than our hypothesized pathway, thus limiting their comparability. The observed mediated relationships could also potentially operate in a different sequence from what we proposed; however, the direction of the variables proposed in the current analyses is one possible sequence that is supported by theory and extant literature. Additionally, we may have underestimated the effect of internalized HIV stigma on treatment adherence by exclusion of participants who reported current substance use. Preliminary data suggest that the relationship between stigma and ART adherence is moderated by substance use severity.46 Future studies should build upon the current exploratory data analysis and assess this clinical pathway in prospective and longitudinal investigations among more representative study samples.
Another limitation of the current study may be that we did not measure relevant variables, such as patient preferences, needs, and values for visit adherence and ART adherence, which may differ from clinical targets.47,48 Other potential barriers to HIV care visit attendance were not measured, such as reliable transportation and distance from home to clinic. Future investigations should collect these data to test this model while controlling for other barriers to attending care. Finally, it is possible that the findings of this study may not generalize to areas outside the southern United States. Nevertheless, it is important to study the effects of HIV-related stigma in the southern United States because this region is now viewed as the epicenter of the domestic HIV epidemic, showing the highest HIV incidence and fatality rates in the United States.49 Internalization of stigma may be particularly pervasive in the southern United States, where the culture of social conservatism may differentiate experiences of HIV-related stigma, as compared to other regions.50
This study also has several strengths with respect to the data sources: Validated instruments were used to collect self-reported data, and the other indicators included in analyses were extracted from objective clinic record data, and thus subject to less self-report bias. The current study serves as an introductory analysis to identify relationships that can be explored further using long-term longitudinal analyses. Future studies may also consider the use of patient-centered measures of engagement in care.51 The current study also supports a growing body of literature on the specific effects of internalized stigma from studies conducted in samples from other US regions.
Overall, these results provide evidence that internalized HIV stigma is associated with lower HIV care visit adherence, through the mechanism of depressive symptoms, and separately, with downstream clinical consequences on ART adherence among PLWH in the southern United States. The present study points to the importance of addressing internalized HIV stigma to health care outcomes among PLWH and the potential to address the negative effects of internalized stigma on ART adherence by reducing depressive symptoms and promoting consistent engagement in HIV care visits.
ACKNOWLEDGMENTS
The authors would like to thank C. Blake Helms, Maria Lechtreck, Wesley Browning, Christy Thai, Victoria C. Seghatol-Eslami, and all the research assistants for their help in data collection.
REFERENCES
1. GBD 2015 HIV Collaborators, Wang H, Wolock TM, et al. Estimates of global, regional, and national incidence, prevalence, and mortality of HIV, 1980-2015: the Global Burden of Disease Study 2015. Lancet HIV. 2016;3:e361–e387.
2. Johnson MO, Neilands TB, Dilworth SE, et al. The role of self-efficacy in HIV treatment adherence: validation of the HIV Treatment Adherence Self-Efficacy Scale (HIV-ASES). J Behav Med. 2007;30:359–370.
3. Mugavero MJ, Amico KR, Horn T, et al. The state of engagement in HIV care in the United States: from cascade to continuum to control. Clin Infect Dis. 2013;57:1164–1171.
4. Horstmann E, Brown J, Islam F, et al. Retaining HIV-infected patients in care: where are we? Where do we go from here? Clin Infect Dis. 2010;50:752–761.
5. Earnshaw VA, Smith LR, Chaudoir SR, et al. HIV stigma mechanisms and well-being among PLWH: a test of the HIV stigma framework. AIDS Behav. 2013;17:1785–1795.
6. Turan B, Hatcher AM, Weiser SD, et al. Framing mechanisms linking HIV-related stigma, adherence to treatment, and health outcomes. Am J Public Health. 2017;107:863–869.
7. Berger BE, Ferrans CE, Lashley FR. Measuring stigma in people with HIV: psychometric assessment of the HIV stigma scale. Res Nurs Health. 2001;24:518–529.
8. Blake Helms C, Turan JM, Atkins G, et al. Interpersonal mechanisms contributing to the association between HIV-related internalized stigma and medication adherence. AIDS Behav. 2017;21:238–247.
9. Turan B, Budhwani H, Fazeli PL, et al. How does stigma affect people living with HIV? The mediating roles of internalized and anticipated HIV stigma in the effects of perceived community stigma on health and psychosocial outcomes. AIDS Behav. 2017;21:283–291.
10. Turan B, Smith W, Cohen MH, et al. Mechanisms for the negative effects of internalized HIV-related stigma on antiretroviral therapy adherence in women: the mediating roles of social isolation and depression. J Acquir Immune Defic Syndr. 2016;72:198–205.
11. Sweeney SM, Vanable PA. The association of HIV-related stigma to HIV medication adherence: a systematic review and synthesis of the literature. AIDS Behav. 2016;20:29–50.
12. Rao D, Feldman BJ, Fredericksen RJ, et al. A structural equation model of HIV-related stigma, depressive symptoms, and medication adherence. AIDS Behav. 2012;16:711–716.
13. Traeger L, O'Cleirigh C, Skeer MR, et al. Risk factors for missed HIV primary care visits among men who have sex with men. J Behav Med. 2012;35:548–556.
14. Sayles JN, Wong MD, Kinsler JJ, et al. The association of stigma with self-reported access to medical care and antiretroviral therapy adherence in persons living with HIV/AIDS. J Gen Intern Med. 2009;24:1101–1108.
15. Steward WT, Bharat S, Ramakrishna J, et al. Stigma is associated with delays in seeking care among HIV-infected people in India. J Int Assoc Providers AIDS Care. 2013;12:103–109.
16. Rueda S, Mitra S, Chen S, et al. Examining the associations between HIV-related stigma and health outcomes in people living with HIV/AIDS: a series of meta-analyses. BMJ open. 2016;6:e011453.
17. Beck A. Depression: Clinical, Experimental, and Theoretical Aspects. New York, NY: Hoeber; 1967.
18. Beck A, Rush AJ, Shaw BF, et al. Cogntive Therapy of Depression. New York, NY: Guilford Press; 1979.
19. Pachankis J. The psychological implications of concealing a stigma: a cognitive–affective–behavioral model. Psychol Bull. 2007;133:328–345.
20. Lee RS, Kochman A, Sikkema KJ. Internalized stigma among people living with HIV-AIDS. AIDS Behav. 2002;6:309–319.
21. Mak WW, Cheung RY, Law RW, et al. Examining attribution model of self-stigma on social support and psychological well-being among people with HIV+/AIDS. Soc Sci Med. 2007;64:1549–1559.
22. Bunn JY, Solomon SE, Miller C, et al. Measurement of stigma in people with HIV: a reexamination of the HIV Stigma Scale. AIDS Educ Prev. 2007;19:198–208.
23. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–613.
24. Lu M, Safren SA, Skolnik PR, et al. Optimal recall period and response task for self-reported HIV medication adherence. AIDS Behav. 2008;12:86–94.
25. Feldman B, Fredericksen R, Crane P, et al. Evaluation of the single-item self-rating adherence scale for use in routine clinical care of people living with HIV. AIDS Behav. 2013;17:307–318.
26. Thompson MA, Mugavero MJ, Amico KR, et al. Guidelines for improving entry into and retention in care and antiretroviral adherence for persons with HIV: evidence-based recommendations from an International Association of Physicians in AIDS Care panel. Ann Intern Med. 2012;156:817–833.
27. Mugavero MJ. Improving engagement in HIV care: what can we do? Top HIV Med. 2008;16:156–161.
28. Jones D, Cook R, Rodriguez A, et al. Personal HIV knowledge, appointment adherence and HIV outcomes. AIDS Behav. 2013;17:242–249.
29. Howe CJ, Napravnik S, Cole SR, et al. African American race and HIV virological suppression: beyond disparities in clinic attendance. Am J Epidemiol. 2014;179:1484–1492.
30. Hayes AF. Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-based Approach. New York, NY: Guilford Press; 2013.
31. Fast-Track Cities: Cities Ending the AIDS Epidemic. Joint United Nations Programme on HIV/AIDS (UNAIDS), 2016. Available at:
http://www.unaids.org/en/resources/documents/2016/cities-report.
32. Walcott M, Kempf MC, Merlin JS, et al. Structural community factors and sub-optimal engagement in HIV care among low-income women in the deep south of the USA. Cult Health Sex. 2016;18:682–694.
33. Mugavero MJ, Davila JA, Nevin CR, et al. From access to engagement: measuring retention in outpatient HIV clinical care. AIDS Patient Care STDS. 2010;24:607–613.
34. Kong MC, Nahata MC, Lacombe VA, et al. Association between race, depression, and antiretroviral therapy adherence in a low-income population with HIV infection. J Gen Intern Med. 2012;27:1159–1164.
35. Simoni JM, Huh D, Wilson IB, et al. Racial/Ethnic disparities in ART adherence in the United States: findings from the MACH14 study. J Acquir Immune Defic Syndr. 2012;60:466–472.
36. Zinski A, Westfall AO, Gardner LI, et al. The contribution of missed clinic visits to disparities in HIV viral load outcomes. Am J Public Health. 2015;105:2068–2075.
37. Logie C, James L, Tharao W, et al. Associations between HIV-related stigma, racial discrimination, gender discrimination, and depression among HIV-positive African, Caribbean, and Black women in Ontario, Canada. AIDS Patient Care STDS. 2013;27:114–122.
38. Brinkley-Rubinstein L. Understanding the effects of multiple stigmas among formerly incarcerated HIV-positive African-American men. AIDS Education Prev. 2015;27:167–179.
39. Brown G, Reeders D, Dowsett GW, et al. Investigating combination HIV prevention: isolated interventions or complex system. J Int AIDS Soc. 2015;18:20499.
40. Gardner EM, McLees MP, Steiner JF, et al. The spectrum of engagement in HIV care and its relevance to test-and-treat strategies for prevention of HIV infection. Clin Infect Dis. 2011;52:793–800.
41. Beach MC, Keruly J, Moore RD. Is the quality of the patient-provider relationship associated with better adherence and health outcomes for patients with HIV? J Gen Intern Med. 2006;21:661–665.
42. Ingersoll KS, Heckman CJ. Patient-clinician relationships and treatment system effects on HIV medication adherence. AIDS Behav. 2005;9:89–101.
43. Thompson MA, Mugavero MJ, Amico KR, et al. Guidelines for improving entry into and retention in care and antiretroviral adherence for persons with HIV: evidence-based recommendations from an International Association of Physicians in AIDS Care panel. Ann Intern Med. 2012;156:817–833, W-284, W-285, W-286, W-287, W-288, W-289, W-290, W-291, W-292, W-293, W-294.
44. Okoro O, Odedina FT. Improving medication adherence in African-American women living with HIV/AIDS: leveraging the provider role and peer involvement. AIDS Care. 2016;28:179–185.
45. Enriquez M, Farnan R, Neville S. What experienced HIV-infected lay peer educators working in Midwestern U.S. HIV medical care settings think about their role and contributions to patient care. AIDS Patient Care STDS. 2013;27:474–480.
46. Stringer KL, Turan B, Kempf M, et al. Medication Adherence Among HIV Positive Substance Users: The Impact of Substance Use Severity and HIV-related Stigma on ART Medication Adherence. Fort Lauderdale, FL: 11th International Conference on HIV Treatment and Prevention Adherence; 2016.
47. Hata M, Redlin SE, Nelson M. Factors influencing combination antiretroviral therapy choice: do doctors really know best?. J Infect. 2015;71:269–271.
48. Okonsky JG, Webel A, Rose CD, et al. Appreciating reasons for nonadherence in women. Health Care Women Int. 2015;36:1007–1025.
49. Reif SS, Whetten K, Wilson ER, et al. HIV/AIDS in the Southern USA: a disproportionate epidemic. AIDS Care. 2014;26:351–359.
50. Darlington CK, Hutson SP. Understanding HIV-related stigma among women in the Southern United States: a literature review. AIDS Behav. 2017;21:12–26.
51. Howarth AR, Burns FM, Apea V, et al. Development and application of a new measure of engagement in out-patient HIV care. HIV Med. 2017;18:267–274.