JAIDS Journal of Acquired Immune Deficiency Syndromes:
Measuring Retention in HIV Care: The Elusive Gold Standard
Mugavero, Michael J. MD, MHSc*; Westfall, Andrew O. MS*; Zinski, Anne PhD*; Davila, Jessica PhD†,‡; Drainoni, Mari-Lynn PhD§,‖,¶; Gardner, Lytt I. PhD#; Keruly, Jeanne C. MS, CRNP**; Malitz, Faye MS††; Marks, Gary PhD#; Metsch, Lisa PhD‡‡; Wilson, Tracey E. PhD§§; Giordano, Thomas P. MD, MPH†,‡,‖‖; for the Retention in Care (RIC) Study Group
*Division of Infectious Diseases, Department of Medicine, University of Alabama at Birmingham, Birmingham, Alabama
†Department of Medicine, Section of Health Services Research, Baylor College of Medicine, Houston, TX
‡Health Services Research and Development Center of Excellence at the Michael E. DeBakey VA Medical Center, Houston, TX
§Section of Infectious Diseases, Boston University Medical Center, Boston, MA
‖Department of Health Policy and Management, School of Public Health, Boston University Medical Center, Boston, MA
¶Center for Health Quality, Outcomes and Economic Research, Edith Nourse Rogers Memorial Veterans Hospital
#Division of HIV/AIDS Prevention, Centers for Disease Control and Prevention, Atlanta, GA
**Division of Infectious Diseases, Department of Medicine, Johns Hopkins University, Baltimore, MD
††Division of Science and Policy, Health Resources and Services Administration, HIV/AIDS Bureau, Rockville, MD
‡‡Division of Health Services Research and Policy, Department of Epidemiology, School of Public Health, University of Miami
§§Department of Community Health Sciences, School of Public Health, State University of New York, Downstate Medical Center, New York, NY
‖‖Department of Medicine, Section of Infectious Diseases, Baylor College of Medicine, Houston, TX.
Correspondence to: Michael J. Mugavero, MD, MHSc, 1530 3rd Avenue S, BBRB 206H, Birmingham, AL, USA 35294-2170 (e-mail: email@example.com).
Supported by the Centers for Disease Control and Prevention (CDC) and the Health Resources and Services Administration through CDC contracts 200-2007-23685, 200-2007-23690, 200-2007-23689, 200-2007-23687, 200-2007-23684, 200-2007-23692. M. J. Mugavero was also supported by National Institute of Mental Health Grant 5K23MH082641-05.
Presented in part at the 7th International Conference on HIV Treatment and Prevention Adherence, June 3–5, 2012, Miami, FL.
MJM has received consulting fees (advisory board) from Bristol-Myers Squibb, Gilead Sciences and Merck Foundation, and grant support from Bristol-Myers Squibb, Pfizer, Inc, Tibotec Therapeutics, and Definicare, LLC.
The other authors have no conflicts of interest to disclose.
Retention in Care (RIC) Study Group is included in the ACKNOWLEDGEMENTS section.
Received May 24, 2012
Accepted September 07, 2012
Background: Measuring retention in HIV primary care is complex, as care includes multiple visits scheduled at varying intervals over time. We evaluated 6 commonly used retention measures in predicting viral load (VL) suppression and the correlation among measures.
Methods: Clinic-wide patient-level data from 6 academic HIV clinics were used for 12 months preceding implementation of the Centers for Disease Control and Prevention/Health Resources and Services Administration (CDC/HRSA) retention in care intervention. Six retention measures were calculated for each patient based on scheduled primary HIV provider visits: count and dichotomous missed visits, visit adherence, 6-month gap, 4-month visit constancy, and the HRSA HIV/AIDS Bureau (HRSA HAB) retention measure. Spearman correlation coefficients and separate unadjusted logistic regression models compared retention measures with one another and with 12-month VL suppression, respectively. The discriminatory capacity of each measure was assessed with the c-statistic.
Results: Among 10,053 patients, 8235 (82%) had 12-month VL measures, with 6304 (77%) achieving suppression (VL <400 copies/mL). All 6 retention measures were significantly associated (P < 0.0001) with VL suppression (odds ratio; 95% CI, c-statistic): missed visit count (0.73; 0.71 to 0.75, 0.67), missed visit dichotomous (3.2; 2.8 to 3.6, 0.62), visit adherence (3.9; 3.5 to 4.3,0.69), gap (3.0; 2.6 to 3.3, 0.61), visit constancy (2.8; 2.5 to 3.0, 0.63), and HRSA HAB (3.8; 3.3 to 4.4, 0.59). Measures incorporating “no-show” visits were highly correlated (Spearman coefficient = 0.83–0.85), as were measures based solely on kept visits (Spearman coefficient = 0.72–0.77). Correlation coefficients were lower across these 2 groups of measures (range = 0.16–0.57).
Conclusions: Six retention measures displayed a wide range of correlation with one another, yet each measure had significant association and modest discrimination for VL suppression. These data suggest there is no clear gold standard and that selection of a retention measure may be tailored to context.
In recent years, increased attention has focused on expanding HIV adherence beyond antiretroviral medications to include engagement in medical care.1–3 After HIV diagnosis, timely linkage and subsequent retention in care is imperative to allow access to antiretroviral therapy (ART), which requires uninterrupted receipt and a high level of adherence to achieve and sustain plasma viral load (VL) suppression.4–6 A recent meta-analysis suggests that 69% [95% confidence interval (CI): 66% to 71%] of newly diagnosed individuals have timely entry into HIV medical care (included studies defined care entry using a range of 3–6 months from HIV diagnosis date), 59% (95% CI: 53% to 65%) are retained in care (included studies used varying definitions of “retained” and observation periods), and only 28% of persons living with HIV/AIDS in the United States, including the undiagnosed, have achieved VL suppression.7–9 Clearly, suboptimal linkage and retention in HIV care are formidable barriers to fully realizing the individual and public health benefits of VL suppression afforded by ART.4–6,10,11 The importance of this issue is highlighted by the emphasis placed on maximizing retention in care in the US National HIV/AIDS Strategy12 and by mounting enthusiasm for antiretroviral treatment as prevention approaches,13 which have been bolstered by recent research findings.14
Despite the recognized clinical and programmatic importance of retention in care, there is no recognized standard measure for retention in care. In contrast to measuring linkage to care, a dichotomous event, measuring retention is more complex as it includes multiple visits, scheduled at varying time intervals, and occurring across time. Indeed, there are many ways to operationalize retention in care, and studies have used a wide range of approaches.15 Most published studies have focused their analyses on a single retention measure, demonstrating factors associated with retention and its impact on HIV biomarker and clinical outcomes.16–19 However, the degree to which different measures of retention are related to outcomes, and to one another, among the same sample of HIV-infected patients is largely unexplored.20 Here, we compare 6 commonly used measures of retention in HIV care to VL suppression and to one another in a large sample inclusive of all clinic patients participating in a multisite study. Our aim was to evaluate the prognostic value of retention measures in predicting VL suppression and the correlation among measures to inform their use in future research and quality improvement initiatives.
Study Sample and Procedures
Clinic-wide patient-level data were used from 6 academically affiliated HIV medical clinics participating in a Centers for Disease Control and Prevention and Health Resources and Services Administration (CDC and HRSA) sponsored Retention in Care intervention study, which has previously been described in detail.21,22 The 6 study sites include HIV clinics affiliated with Baylor College of Medicine, Houston, TX; Boston University Medical Center, Boston, MA; Johns Hopkins University, Baltimore, MD; State University of New York, Downstate Medical Center, Brooklyn, NY; University of Alabama at Birmingham, Birmingham, AL; and University of Miami, Miami, FL. The present study used systematically captured, de-identified, sociodemographic, clinical and medical visit patient-level data from a 2-year period preceding implementation of the intervention. The analysis included patients at the 6 study sites who had (1) at least one scheduled primary HIV care appointment during the first 6 months (189 days) of a 12-month observation period (1 May 2008–30 April 2009) and (2) attended at least 1 primary HIV medical provider visit in the year preceding the observation period (1 May 2007–30 April 2008). These criteria were used to identify established clinic patients in whom retention in care could be measured. The Retention in Care research protocol received Institutional Review Board approval at all study sites.
Measures of Retention in HIV Care
Our principal focus was on retention in HIV medical care, using 6 commonly used measures that have been described in detail previously (Table 1).15 In accordance with prior studies, only scheduled clinic visits with a primary HIV medical provider with medication prescribing privileges (ie, MDs, CRNPs, and PAs) were included in calculating retention measures; we did not include walk-in, urgent care, subspecialty, or supportive services visits. Three of the retention measures incorporate data on missed clinic visits and include only no-show visits that were not canceled in advance of the scheduled appointment by the patient, provider, or clinic.15,23 Missed visits were recorded as a count and dichotomous measure (0 vs. ≥1 no-show visits), and visit adherence was calculated as a proportion of kept to scheduled appointments (range = 0%–100%), with kept visits being those attended by the patient and with the denominator excluding canceled visits. An additional 3 retention measures were calculated based solely on kept visits. A 4-month constancy measure calculated the number of 4-month intervals in which a patient had at least one kept visit (range = 0–3). A 6-month gap measure captured whether a patient had more than 189 days between sequential kept visits, and the Health Resources and Services Administration HIV/AIDS Bureau (HRSA HAB) measure calculated whether a patient had 2 kept visits separated by more than 90 days during the 12-month observation period. With the exception of the missed visit count measure, the other 5 retention measures were formulated such that a higher value indicated better retention to align the directionality and to facilitate the interpretation of study results.
Plasma VL suppression at the end of the 12-month observation period (12-month VL) was the primary outcome of interest. As VL measures were obtained through routine clinical care and not at a specific study visit, a window of ±120 days around the study end date of 30 April 2009 was used. If multiple VL measures were available in this time window, the measure closest to the study end date was used. A value <400 copies/mL was considered suppressed.
Descriptive statistics and plots were generated to evaluate distributions of all study variables and to generate summary statistics, including means, standard deviations, frequencies, and percentages. Spearman rank correlation was used to evaluate the associations among retention measures. Logistic regression was used to examine the association between each retention measure and 12-month VL suppression. The c-statistic (range = 0.5–1.0), an estimate of the area under the receiver operator characteristic (ROC) curve plotting sensitivity by 1–specificity, was used to evaluate the discriminatory capacity of each retention measure in predicting VL suppression. The c-statistic captures the prognostic value of each retention measure to correctly assign patients to the observed 12-month VL state (suppression vs. failure), with 0.5 indicating a measure is no better than chance, and 1.0 indicating perfect discriminatory capacity. In addition, the sensitivity and specificity of each retention measure in predicting 12-month VL suppression were calculated. In primary analyses, patients with missing 12-month VL measures were excluded. Sensitivity analyses were conducted considering those with missing 12-month VL measures to be detectable (>400 copies/mL, missing = failure). All statistical analyses were conducted using SAS version 9.3.
Among 10,053 study patients, the mean age was 46 ± 10 years, 65% were male, 64% were black race, 19% were of Hispanic ethnicity, and 49% reported heterosexual sex (Table 2). Patients averaged 1.5 ± 1.7 no-show visits during the 12-month observation period, with two-thirds of patients having at least one no-show visit. A wide range of visit adherence was observed, with nearly half of patients attending less than 75% of their scheduled clinic appointments. Fifty percent of patients attended visits in all three 4-month intervals (constancy measure), one-third had a 6-month gap, and roughly one-quarter were not retained according to the HRSA HAB measure. Twelve-month VL measures were available in 8235 patients (82%), among whom 6304 (77%) were suppressed at 12 months (<400 copies/mL, Table 2).
TABLE 2-a Characteri...Image Tools
When comparing retention measures to one another, a wide range of association was observed, with Spearman correlation coefficients ranging from 0.16 to 0.85 (Table 3). In general, measures that incorporate missed visits (missed visit count, missed visit dichotomous measure, and visit adherence) were more highly correlated with each other (0.83–0.85), as were measures based solely on kept visits (4-month constancy, 6-month gap, and HRSA HAB measure: 0.72–0.77). Across these 2 broad categories, the count and dichotomous missed visit measures demonstrated lower correlation (0.16–0.26) with the kept visit group of measures, relative to visit adherence, which had more moderate correlations (0.51–0.57, Table 3).
All 6 retention measures demonstrated strong and statistically significant (P < 0.001) associations with 12-month VL suppression (Table 4). As anticipated, dichotomous measures (dichotomous missed visit, 6-month gap, and HRSA HAB measure) had less discriminatory capacity for VL suppression as indicated by lower c-statistic values (0.59–62) relative to nondichotomous measures (missed visit count, visit adherence, and 4-month constancy: 0.63–0.69). This is demonstrated graphically as the area under the ROC curve, which is estimated by the c-statistic and plotted as sensitivity by 1-specificity (Fig. 1). The performance of retention measures was largely consistent across study sites (data not shown).
Notably, among the dichotomous retention measures the 6-month gap and HRSA HAB measure demonstrated sensitivity for VL suppression of 82% and 91%, respectively, with lower specificity (39% and 27%), whereas the dichotomous missed visit measure displayed specificity of 82%, with lower sensitivity (42%). Thresholds to define retention for other measures were selected to provide a balance of sensitivity and specificity (Tables 4 and 5), although other cut points may be applied with an associated trade-off of sensitivity for specificity and vice versa. Additional analyses using a missing equals failure approach for patients lacking 12-month VL measures (18%) yielded consistent findings with primary analyses, albeit with larger parameter estimates and c-statistic values for retention measures, particularly, for kept visit–based measures (Table 5).
Our study is the first to evaluate the prognostic value of 6 commonly used measures in predicting VL suppression and the correlation among HIV retention in care measures in the same patient sample. A recent study from the HIV Research Network identified strong correlations (concordance correlation coefficients range = 0.67–0.88) among retention measures calculated based on kept visits only, which was corroborated by our analyses.20 We extend this work by further examining an additional 3 measures that incorporate no-show visits and additionally comparing the prognostic value of the 6 measures for HIV VL suppression. Overall, considerable variability was observed among these measures in categorizing patients as being retained, ranging from one-third of patients with no missed visits (perfect visit adherence) to over three-quarters of patients meeting the HRSA HAB retention measure. Although these varying definitions translated to a broad range of correlations across retention measures (Spearman coefficients range = 0.16–0.85), each measure demonstrated a strong and statistically significant (P < 0.001) relationship with VL suppression. Accordingly, our data suggest that there is no clear gold standard to measure retention in care and that any of the evaluated measures may have a role depending on visit data availability, the questions being addressed, and the principal rationale and goals of measuring “retention.” Moreover, there may be merit to using multiple retention measures, particularly in research settings, and using one measure that incorporates missed visits and another based solely on kept visits.
As anticipated, improved prognostic value for VL suppression was observed for multilevel retention measures compared with dichotomous measures. By allowing more granular categorization of patient retention, the missed visit count measure, visit adherence, and 4-month constancy measures allowed for better discriminatory capacity in predicting VL suppression, as indicated by higher c-statistic values. For example, among the two-thirds of patients categorized as “not retained” by the dichotomous no-show visit measure, a broad range of counts of missed visits and of visit adherence was observed. The enhanced variability captured by these latter 2 measures translates into improved prognostic capacity for VL suppression and is perhaps best visualized by the multiple points incorporated into the ROC curves, in contrast to the single point used for dichotomous measures (Fig. 1).
However, dichotomous measures clearly have value, offering advantages including face validity and less complex programming and computational and analytic demands.15 Moreover, the dichotomous missed visit, 6-month gap and HRSA-HAB measures were all strongly associated with VL suppression, albeit with reduced discriminatory capacity. An interesting study finding was the variability in defining patients as retained across dichotomous retention measures, which translated into robust differences in the sensitivity and specificity of these measures in predicting VL suppression. The dichotomous no-show measure categorized only one-third of the sample as retained, resulting in high specificity (82%) of this measure in relation to VL suppression. In other words, 82% of persons without viral suppression had at least one no-show visit during the year. In contrast, the 6-month gap and HRSA HAB measures categorized 68% and 77% of patients as retained, respectively. This translated into high sensitivity of these measures (82% and 91%, respectively) in predicting VL suppression. In other words, 8 or 9 of 10 persons with viral suppression met these standards for retention, respectively. No measure, however, had both high sensitivity and high specificity. These fascinating relationships highlight the potential to use multiple retention measures; one including missed visits and the other based on kept visits only, as they seem to provide complementary information regarding measurement of retention yet are each significantly associated with VL suppression with large effect sizes. Future studies should evaluate the prognostic value of composite measures of retention integrating 2 or more of the measures examined here.
Our findings are germane to contemporary clinical and public health issues related to HIV treatment and prevention. In recent years, the importance of retention as a key step on the HIV treatment continuum has received heightened attention.2,4 Our findings indicate that the operational definition chosen to measure retention can have far-reaching implications in assessing this component, with subsequent downstream implications for estimates of persons on ART and achieving VL suppression. The US National HIV/AIDS Strategy set 80% retention among HRSA Ryan White CARE Act clients as a goal by 2015, with retention measured using the HRSA HAB measure.12 Among our sample, 77% of patients achieved retention according to this measure, which would have been widely variable, ranging from 33% to 68%, if other measures had been used. This observation is of particular importance when comparing retention in care across settings and studies, as the measure used, and the duration of the observation period can have a dramatic impact on interpretation of findings and the inference that may be drawn. It is imperative to ensure consistency of measures when evaluating similarities or differences in retention across settings.
Prior studies have established significant associations between the retention measures under study and HIV biomarker and clinical outcomes.2,16–19 The present study extends this work by evaluating VL suppression across retention measures among the same study sample, showing strong and statistically significant associations for each measure. The large parameter estimates observed are in accordance with prior studies and underscore the critical role of retention in care as a key step along the treatment continuum that ultimately leads to VL suppression. However, the retention measures studied demonstrated only modest discriminatory capacity (c-statistic = 0.59–0.69) for VL suppression. It is anticipated that including other steps in the treatment continuum, notably ART adherence, to retention measures as an additional independent variable in statistical models would improve overall prognostic value for VL suppression. Notably, a significant association between retention and ART adherence was observed in a previous study that compared visit constancy with pharmacy refills.16 Future research should examine the discriminatory capacity of models, including both measures of retention and ART adherence, in relation to HIV biomarker and other clinical outcomes.
Beyond individual health outcomes, considerable improvement in retention in care at the population level is essential to achieving the potential success of ART treatment as prevention initiatives.4,10,13 There is great need for substantial improvement in retention in care, along with other steps across the treatment continuum, if we are to meaningfully increase the proportion of HIV-infected Americans with suppressed VL levels from current estimates of 19%–28%.4,8,9 The impact of treatment as prevention approaches is predicated on the collective success of public health, medical and supportive service providers, and affected communities in dramatically increasing these estimates.
Our study has limitations. By focusing on established clinic patients to allow for a sample with a comparable observation period, we cannot comment on retention measures in persons newly establishing HIV medical care, which has been evaluated in other studies.6,17,24,25 Established patients may be more likely to be adherent to ART regardless of their retention status, and this may place a limit on the discriminatory ability of these measures. We are unable to systematically capture and account for patients who may have transferred their medical care during the 1-year observation period, which could impact calculation of retention measures. Similarly, deaths during the 1-year observation period were not systematically captured, which may have resulted in underreporting of retention, although it is unclear whether this would introduce systematic bias when making comparisons across retention measures. Moreover, patients, who died, likely had missing 12-month VL values and were excluded from primary analyses. Our examination of retention measures was for a relatively short period of time. Additional research should evaluate these measures over longer time intervals. Although our 6 sites serve diverse populations across the United States, our findings might not translate to other domestic and international treatment settings or to nonacademically affiliated clinics. We also note study strengths, including the clinic-wide capture of high-quality patient-level visit utilization and sociodemographic and clinical data. In addition, the evaluation of measures incorporating missed clinic visits in addition to those based solely on kept visits is novel and extends recent work comparing only this latter group of retention measures.20
In summary, 6 commonly used measures of retention in care demonstrated considerable variability in categorizing retention, translating to a wide range of correlations among these measures. In general, stronger associations were observed among measures incorporating missed visits and among those based solely on kept visits, with potentially complementary information provided when using measures from these 2 groups. Despite the observed heterogeneity across retention measures, each demonstrated strong and statistically significant relations with VL suppression, albeit with variable discriminatory capacity. Taken together, our findings suggest that as for ART adherence, there is no clear gold standard to measure retention in HIV care, and that each measure studied may have value and utility according to setting and circumstance.
The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the US Centers for Disease Control and Prevention (CDC) or Health Resources and Services Administration (HRSA). The authors thank the patients, providers, and clinical and research personnel at the 6 study sites and the CDC and HRSA administrative and data management teams. The authors also thank the Retention in Care Study Group: Boston University Medical Center: M. -L. Drainoni [Principal Investigator (PI)], C. Ferreira, L. Koppelman, R. Lewis, M. McDoom, M. Naisteter, K. Osella, G. Ruiz, P. Skolnik, M. Sullivan (PI); SUNY Downstate Medical Center: S. Gibbs-Cohen, E. Desrivieres, M. Frederick, K. Gravesande, S. Holman, H. Johnson, T. Taylor, T. Wilson (PI); University of Alabama-Birmingham: S. Batey, S. Gaskin, M. Mugavero (PI), J. Murphree, J. Raper, M. Saag (PI), S. Thogaripally, J. Willig, A. Zinski; Baylor College of Medicine: M. Arya, D. Bartholomew, T. Biggs, H. Budhwani, J. Davila, T. Giordano (PI), N. Miertschin, S. Payne, W. Slaughter; Johns Hopkins University: M. Jenckes, J. Keruly (PI), A. McCray, M. McGann, R. Moore (PI), M. Otterbein, L. Zhou; University of Miami: C. Garzon, J. Jean-Simon, K. Mercogliano, L. Metsch (PI), A. Rodriguez (PI), G. Saint-Jean, M. Shika; Federal: L. Cheever, HRSA; F. Malitz, HRSA; R. Mills, HRSA; J. Craw, CDC/ICF-Macro; L. Gardner, CDC; S. Girde, CDC/ICF-Macro; G. Marks, CDC; Mountain Plains AETC; L. Bradley-Springer; M. Corwin.
1. Aberg JA, Kaplan JE, Libman H, et al.. Primary care guidelines for the management of persons infected with human immunodeficiency virus: 2009 update by the HIV Medicine Association of the Infectious Diseases Society of America. Clin Infect Dis. 2009;49:651–681.
2. Horstmann E, Brown J, Islam F, et al.. Retaining HIV-infected patients in care: where are we? Where do we go from here? Clin Infect Dis. 2010;50:752–761.
3. Thompson MA, Mugavero MJ, Amico KR, et al.. Guidelines for improving entry into and retention in care and antiretroviral adherence for persons with HIV: evidence-based recommendations from an International Association of Physicians in AIDS Care Panel. Ann Intern Med. 2012;156:817–833.
4. Gardner EM, McLees MP, Steiner JF, et al.. The spectrum of engagement in HIV care and its relevance to test-and-treat strategies for prevention of HIV infection. Clin Infect Dis. 2011;52:793–800.
5. Giordano TP, Suarez-Almazor ME, Grimes RM. The population effectiveness of highly active antiretroviral therapy: are good drugs good enough? Curr HIV/AIDS Rep. 2005;2:177–183.
6. Mugavero MJ, Amico KR, Westfall AO, et al.. Early retention in HIV care and viral load suppression: implications for a test and treat approach to HIV prevention. J Acquir Immune Defic Syndr. 2012;59:86–93.
7. Marks G, Gardner LI, Craw J, et al.. Entry and retention in medical care among HIV-diagnosed persons: a meta-analysis. AIDS. 2010;24:2665–2678.
8. Marks G, Gardner LI, Craw J, et al.. The spectrum of engagement in HIV care: do more than 19% of HIV-infected persons in the US have undetectable viral load? Clin Infect Dis. 2011;53:1168–1169; author's reply 1169–1170.
9. Centers for Disease Control and Prevention (CDC). Vital signs: HIV prevention through care and treatment—United States. MMWR Morb Mortal Wkly Rep. 2011;60:1618.
10. Das M, Chu PL, Santos GM, et al.. Decreases in community viral load are accompanied by reductions in new HIV infections in San Francisco. PLoS One. 2010;5:e11068.
11. Mugavero MJ, Napravnik S, Cole SR, et al.. Viremia copy-years predicts mortality among treatment-naive HIV-infected patients initiating antiretroviral therapy. Clin Infect Dis. 2011;53:927–935.
13. Dieffenbach CW, Fauci AS. Universal voluntary testing and treatment for prevention of HIV transmission. JAMA. 2009;301:2380–2382.
14. Cohen MS, Chen YQ, McCauley M, et al.. Prevention of HIV-1 infection with early antiretroviral therapy. N Engl J Med. 2011;365:493–505.
15. Mugavero MJ, Davila JA, Nevin CR, et al.. From access to engagement: measuring retention in outpatient HIV clinical care. AIDS Patient Care STDS. 2010;24:607–613.
16. Giordano TP, Gifford AL, Clinton White A, et al.. Retention in care: a challenge to survival with HIV infection. Clin Infect Dis. 2007;44:1493–1499.
17. Mugavero MJ, Lin HY, Willig JH, et al.. Missed visits and mortality among patients establishing initial outpatient HIV treatment. Clin Infect Dis. 2009;48:248–256.
18. Park WB, Choe PG, Kim SH, et al.. One-year adherence to clinic visits after highly active antiretroviral therapy: a predictor of clinical progress in HIV patients. J Intern Med. 2007;261:268–275.
19. Cabral HJ, Tobias C, Rajabiun S, et al.. Outreach program contacts: do they increase the likelihood of engagement and retention in HIV primary care for hard-to-reach patients? AIDS Patient Care STDS. 2007;21(suppl 1):S59–S67.
20. Yehia BR, Fleishman JA, Metlay JP, et al.. Comparing different measures of retention in outpatient HIV care. AIDS. 2012;26:1131–1139.
21. Gardner LI, Marks G, Craw J, et al.. Brief clinic-wide intervention promotes retention in care among HIV patients (Oral, Abstract ID #2018). Presented at: 2011 National HIV Prevention Conference; August 2011; Atlanta, GA.
22. Gardner L, Marks G, Craw J, et al.. A low-effort clinic-wide intervention improves attendance for HIV primary care. Clin Infect Dis 2012;55:1124–1134.
23. Melnikow J, Kiefe C. Patient compliance and medical research: issues in methodology. J Gen Intern Med. 1994;9:96–105.
24. Giordano TP, Visnegarwala F, White AC Jr, et al.. Patients referred to an urban HIV clinic frequently fail to establish care: factors predicting failure. AIDS Care. 2005;17:773–783.
25. Metsch LR, Pereyra M, Messinger S, et al.. HIV transmission risk behaviors among HIV-infected persons who are successfully linked to care. Clin Infect Dis. 2008;47:577–584.
This article has been cited 4 time(s).
Plos OneMedication Possession Ratio Predicts Antiretroviral Regimens Persistence in PeruPlos One
AIDS Patient Care and StdsMissed Office Visits and Risk of Mortality Among HIV-Infected Subjects in a Large Healthcare System in the United StatesAIDS Patient Care and Stds
Clinical Infectious DiseasesTrends and Disparities in Antiretroviral Therapy Initiation and Virologic Suppression Among Newly Treatment-Eligible HIV-Infected Individuals in North America, 2001-2009Clinical Infectious Diseases
Clinical Infectious DiseasesThe State of Engagement in HIV Care in the United States: From Cascade to Continuum to ControlClinical Infectious Diseases
retention in care; adherence; engagement in care; viral load
© 2012 Lippincott Williams & Wilkins, Inc.
Highlight selected keywords in the article text.