To increase the likelihood of viral suppression (VS), international guidelines recommend directly administered antiretroviral therapy for prisoners with HIV transitioning to the community, and in community settings, HIV patients with opioid use disorder (OUD) should be offered methadone or buprenorphine with or without directly administered antiretroviral therapy.1 Such guidelines have not been updated in recent years.
Both HIV and OUD are highly prevalent among persons within the criminal justice system.2–5 Release to the community for people living with HIV (PLH) is associated with loss of HIV VS, despite high levels attained during the incarceration.3,4,6,7 Moreover, for released prisoners with OUD, relapse exceeds 85%, mostly within the first 2 weeks and is associated with overdose and death.8–10 Inadequately treated OUD interrupts HIV treatment adherence with resultant loss of VS.11,12
Three evidence-based medication treatments for OUD are available, including 2 opioid agonists (methadone and buprenorphine) and 1 opioid antagonist [injectable extended-release naltrexone (XR-NTX); Vivitrol Alkermes, Inc., Waltham, MA]. Unlike opioid agonists, XR-NTX is not a controlled substance, does not require regulatory licensing for prescription, also treats alcohol use disorders, and is without diversion concerns.13–19 In criminal justice–involved persons with OUD, XR-NTX has been associated with decreased opioid use after release.20 Recent randomized controlled trials confirm its equivalence in treatment of OUD with buprenorphine in community settings.21,22 Despite data suggesting that buprenorphine maintains or improves VS in released prisoners with HIV,11,12 the use of XR-NTX has not been tested on HIV VS.
We therefore sought to examine in a multisite study whether treatment with XR-NTX would improve or maintain VS levels after release in prisoners and jail detainees with HIV and OUD using a double blind, placebo-controlled trial.
The study protocol and detailed methods have previously been published,13 along with preliminary safety data,17 and early postrelease retention data.16 This multisite, double-blind, placebo-controlled trial was conducted between September 1, 2010, and March 31, 2016, and compared XR-NTX with placebo among incarcerated PLH with OUD transitioning to the community over a 6-month period.
All study procedures were reviewed and approved by the institutional review boards (IRBs) at all 4 study sites, the Office of Human Research Protections at the Department of Health and Human Services, and research committees at Hampden County Correctional Centers, and the Connecticut Department of Correction. A Certificate of Confidentiality was obtained for additional participant protections. The study is registered at www.clinicaltrials.gov (NCT01246401).
Recruitment occurred between September 2010 and August 2015. Initial referrals were made by nursing and transitional care staff within prison or jail with confirmatory screening and informed consent by study personnel.
Study Eligibility Criteria
(1) HIV-seropositive; (2) returning to 3 sites in Connecticut (New Haven, Hartford, and Waterbury) or Springfield, MA; (3) DSM-IV criteria for opioid dependence; (4) able to provide informed consent; (5) speaks English or Spanish; (6) age ≥18 years; (7) not receiving methadone or buprenorphine or involved in an antiretroviral treatment (ART) adherence trial in the previous 30 days; and (8) within 30 days of release from prison or jail.
(1) Threatening behavior toward research staff or other participants; (2) other pending charges; (3) receiving opioid pain medications or expressing a need for them; (4) known hypersensitivity to naltrexone or its diluent components; and (5) study medication contraindications that included: (a) aspartate aminotransferase or alanine aminotransferase elevations (>5× upper limit of normal); (b) evidence of Child Pugh Class C cirrhosis; or (c) breastfeeding, pregnant, or unwilling to use contraception for female participants.
Informed Consent Process and Enrollment
Study personnel completed informed consent procedures with eligible and interested individuals; consent was repeated immediately after release to prevent real or perceived coercion.
Participants were then randomly allocated 2:1 to receive 380 mg of XR-NTX or placebo (provided in-kind by Alkermes, Inc.), administered intramuscularly every 4 weeks for 6 months. A covariate adaptive stratified block randomization was performed23–25 using the study site and whether ART was prescribed or not.
After enrollment, participants underwent baseline assessments, monthly follow-up interviews, and laboratory assessments for 6 months13 using a computer-assisted survey instrument.26,27 Structured interviews included demographic information, housing and health care status, mental health comorbidities (Mini-International Neuropsychiatric Interview),28,29 depressive symptoms (Brief Symptom Inventory-18),30 quality of life (12-item Short Form Health Survey),31 Alcohol Use Disorder Identification Test,32 and daily opioid use reports using a structured Timeline Followback (TLFB).33,34 Biological measures included: monthly urine drug toxicology screens, urine pregnancy tests for female participants, and quarterly phlebotomy to assess HIV-1 RNA levels. Tolerability and adverse events were monitored monthly using the Systemic Assessment For Treatment Emergent Effects Intervention,35 and also included liver function tests and injection site reaction assessments.
Study injections were administered within 1 week before or on the day of release and then monthly for 5 additional months (N = 6 potential injections). During injection procedures, all participants received a brief 15-minute medical management counseling intervention.36 Optional individual drug counseling sessions and 12-step group counseling meetings were available to all participants. Participants were compensated for contributing their time to the research activities and not for receiving study medication.
Sample Size and Power Calculations
We calculated an original sample size of 150 (XR-NTX = 100 and placebo = 50) needed to detect a statistically significant difference in the primary outcome at 6 months between the 2 groups. This incorporated a 2-sided alpha = 0.05, beta = 0.20, and a compound symmetry true correlation structure of 0.5 (the most conservative, based on our results from earlier studies where our prison-release data suggested that 59% of HIV+ inmates leave prison with VS6,37). Calculations also included oversampling (2:1 randomization) those receiving XR-NTX due to potential adverse events.
Of the 222 PLH referred to the study, 151 consented and 93 were included in the final analytical sample, 66 were randomized to receive XR-NTX, and 27 to receive placebo. The CONSORT diagram is depicted in Figure 1.
Baseline characteristics were compared between the 2 study treatment groups using paired t-tests, Fisher exact, analysis of variance, and χ2 to assess for differences using SPSS and R.
Overall, 14.1% of participants had missing HIV-1 RNA data at 6 months postrelease. Using Little MCAR (“Missing Completely at Random”) test38 using the BaylorEdPsych package in R,39 we explored the structure of the missing data to determine whether the data were MCAR and not related to the dependent or independent variables. The highly nonsignificant results (P = 0.560) suggested that the missing data were not statistically related to the main outcome (VS), viral load (VL) at baseline, nor any of the variables used in the analysis, most importantly, treatment assignment or number of XR-NTX injections. High P-values for Little MCAR test suggest that further missingness inquiries using sensitivity analysis are not merited because the data were clearly neither Missing at Random nor Not Missing at Random.40,41 Consequently, we were able to maintain the most conservative standard intention-to-treat (ITT) assumption that missingness from participant attrition equals viral nonsuppression (missing = failure). This is the standard analytic method for regulatory submission of HIV-1 RNA data to the U.S. Food and Drug Administration,42 which provides the most sensitive and conservative detection limits available and used previously in prospective trials of PLH where HIV-1 RNA is the outcome. We did, however, make adjustments such that if a participant had both VS confirmed at 3 months and 9 months (before or after the 6-month censor period of data analysis), then that data was considered in the 6-month missing outcome evaluation and not simply denoted as “failure.” Of note, there was no statistically significant difference in available VL data between treatment groups at 6 months (88.9% placebo, 84.9% XR-NTX, P = 0.597).
Primary Outcome: ITT Analysis of Viral Suppression From Baseline to 6 Months
The original predetermined primary outcomes were VS defined as HIV-1 RNA <400 copies/mL and <50 copies/mL after 6 months of intervention. The choice of VS at <400 copies/mL at the study start was because our previous studies of released HIV prisoners had a lower limit of VS at <400 copies/mL.6,13,37 After finalizing study protocols, standard clinical practice used more stringent VS cut-offs (<50 copies/mL) as the lower limit of detection. We therefore report findings the predetermined outcome of using maximal VS (<50 copies/mL) as sole the primary outcome;43 however, VS <400 copies/mL is also reported. Using an ITT strategy, the primary outcomes involved a comparison of the changes in maximal VS levels (<50 copies/mL) from baseline to 6 months after release. Our hypothesis was that effective treatment of OUD would maintain VS for those already on ART, and for those not on it at the time of enrollment (either by preference while incarcerated due to confidentiality concerns), they might be more likely to initiate it.11,44 Consequently, the change in VS from baseline to 6 months best reflected how participants would do over time either with or without effective treatment of OUD. After dichotomizing VS as suppressed (<50 copies/mL) or not, changes in VS were assessed using Welch t test using R statistical software,45 with P < 0.05 as being statistically significant.
In addition, the principal outcome of VS required a further more nuanced analysis because 4 possible VS suppression trajectories were possible from baseline to 6 months: (1) maintained VS; (2) improved to VS; (3) lost VS from baseline to 6 months; and (4) remained detectable at baseline and 6 months. Using Pearson χ2 test, we compared the distribution of the placebo with the XR-NTX arms across these 4 possible outcomes. To further capture changes in VS from baseline to 6 months, we applied McNemar χ2 test using the exact2x246–48 package in R to the discordant outcomes where VS status had changed.
The mean change in VL (copies/mL) was also analyzed between treatment arms comparing the baseline with 6-month time points. The negative values for changes in the XR-NTX group precluded the usual log transformation; thus, we used the original data and reported the mean changes.
Multiple Logistic Regression Analysis of Predictors of Viral Suppression at 6 Months
After confirming that a statistically significant difference was found for changes in VS, we explored predictive variables guided by the literature,7,16 including treatment group assignment and the number of injections received to further explain independent predictors for maximal VS (<50 copies/mL). A backward stepwise model selection “step” algorithm in R then sequentially eliminated variables until we achieved models with the best goodness-of-fit using the Akaike information criterion, as they yielded the most parsimonious results.
Other Secondary Outcomes Statistical Analysis Methods
Opioid Abstinence and Time to Relapse to Opioid Use
Daily opioid use was assessed for the 30 days before incarceration and monthly throughout the study follow-up period using the TLFB.49 Variables generated from this tool included the number of consecutive days abstinent or time to first opioid use at the end of the 6-month intervention period. We performed a Kaplan–Meier test for time to first opioid use, or more specifically as an adjustment for the censoring of the end of the observation period at 6 months, using the study's TLFB self-reported data and monthly urine toxicology screens. We considered the observations “reported days of consecutive abstinence in 6 months.” Those who dropped out of the study were most conservatively assumed to have resumed opioid use. The participants with missing data therefore reported no days of abstinence. Because previous studies have confirmed the effect of XR-NTX on opioid relapse and abstinence, this study was not powered to detect this outcome, but instead was intended for use as a planned “as treated” to complement the ITT analysis. We grouped participants into those (1) who had received 3 or more injections of XR-NTX (N = 22 participants) and (2) those who received 2 or fewer XR-NTX injections or were in the placebo group (N = 71) in the other group. Statistical significance was tested using the log rank test and Welch t test for days of continuous reported abstinence.
Chi-squared analyses were used to explore the differences in side effects between the treatment groups.
There were no differences in baseline characteristics between treatment arms (Table 1). Participants were on average in their mid-40s, mostly men (81.7%), racial/ethnic minorities (85.7%), homeless or unstably housed (63.4%), prescribed ART (89.1%), coinfected with chronic hepatitis C virus (83.5%), had previous preincarceration experience with methadone and/or buprenorphine (75.3%), and were incarcerated for a mean duration of 8.8 months. Central to the analysis, baseline VS levels at <400, <200, and <50 copies/mL were 64.5%, 58.1%, and 43.0%, respectively, and not statistically significantly different. There were also no differences in mean baseline CD4 count (465 vs. 581 cells/mL; P = 0.088).
HIV Treatment Retention
There were no statistically significant differences between the 2 groups at 6 months in the proportion of those: with HIV VL data (XR-NTX = 84.9%, placebo = 88.9%; P = 0.597); who completed 6-month study interviews (XR-NTX = 49.5%, placebo = 50.5%; P = 0.822, Fig. 2); or who were retained for study injections (66.7% received 2 or fewer study injections and 35.5% received 3–6 study injections; Table 1).
Primary Outcome: Viral Suppression at 6 Months
Compared with the placebo group that decreased VS levels over time (55.6% at baseline to 40.7% at 6 months, P = 0.294), the XR-NTX group had a statistically significant improvement in the proportion who maintained or achieved VS at <50 copies/mL from baseline (37.9%) to 6 months (60.6%) (P = 0.002) (Fig. 3). A direct comparison of VS levels at 6 months between the 2 treatment groups, however, approached statistical significance (XR-NTX = 60.6%, placebo = 40.7%; P = 0.08). For higher VS levels (<400 copies/mL), there were no time differences in VS levels for the XR-NTX (63.6% at baseline to 68.2% at 6 months; P = 0.47) or placebo (66.7% at baseline to 59.3% at 6 months; P = 0.574). Similarly, for this level of VS, the XR-NTX and placebo groups did not differ significantly at 6 months (68.2% vs. 59.3%; P = 0.43, respectively).
When comparing the distribution of the 4 possible outcomes (Fig. 4): (1) the XR-NTX group was significantly more likely to improve to VS (<50 copies/mL) levels at 6 months compared with placebo (30.3% vs. 18.5%): (2) maintain VS at 6 months (30.3% vs. 27.3%); and (3) less likely to lose VS (7.6% vs. 33.3%) at 6 months (Pearson χ2P = 0.017; McNemar χ2, P = 0.043). Additionally, when evaluating further the participants who had a (Fig. 4) detectable VL at the time of release to 6 months, the XR-NTX group also statistically significantly reduced the mean VL by −6515.7 copies/mL, whereas the placebo group increased the mean VL by +9081.4 copies/mL (P = 0.031).
Multivariate Analysis of Independent Predictors of Achieving Viral Suppression
When controlling for potential confounders (Table 2), assignment to the XR-NTX group remained significantly associated with the primary outcome. No other variables, including cocaine use disorder, homeless and unstably housed status, and number of injections received, were significant.
Time to First Opioid Use
The ITT analysis revealed no statistically significant difference in time to first opioid use (continuous days of opioid abstinence) between treatment arms (XR-NTX mean = 78.0 days, placebo mean = 63.7 days; P = 0.110) (Fig. 5A). In the as-treated analysis (Fig. 5B), those who received 3 or more XR-NTX injections had a statistically significantly longer time of continuous days of opioid abstinence (mean = 136.4 vs. 53.2 days; P = 0.002) compared with those who received any number of placebo injections or 2 or fewer XR-NTX injections.
No serious grade 3 or 4 hepatic events or any serious injection site or other adverse events occurred in either treatment group. The most common reported side effect (13%) was immediate injection site reaction (redness, soreness) and fatigue (8%), with no statistically significant differences between the groups (Table 3). The study did not evaluate nonfatal opioid overdoses. One participant in the XR-NTX group experienced a fatal opioid overdose 128 days after his last injection, but was determined not to be a study-related treatment serious adverse event by the Yale School of Medicine IRB, correctional system IRBs, Baystate Medical Center IRB, Alkermes Inc. review board, or by NIDA.
To the best of our knowledge, this is the first randomized, placebo-controlled, double-blind trial that examined whether an evidence-based pharmacotherapy to treat OUD, XR-NTX, resulted in improved viral suppression levels in prisoners and jail detainees with HIV who were released from prison or jail. The key findings from this trial were that maximal viral suppression (<50 copies/mL) was maintained or improved from the time of release to the end of the 6-month treatment intervention in those who received XR-NTX, whereas those who received placebo had decreasing VS levels over time. Furthermore, receiving XR-NTX was statistically associated with a lower proportion of persons losing VS as compared to placebo. After controlling for other factors associated with poor HIV treatment outcomes after release, assignment to XR-NTX alone predicted VS at 6 months after release. These findings have important implications for individual management of PLH with OUD being released from a criminal justice system setting and from a public health perspective.
Recent longitudinal data suggest that in the absence of treatment of OUD, linkage to HIV care after release is poor and associated with poor VS levels that decrease over time.50 Strategies that optimize VS over time are more likely to promote individual health, but also public health through treatment as prevention efforts.
These findings are especially relevant, given the volatile opioid epidemic and associated transmission of HIV and HCV. For prisoners and jail detainees with OUD, including those with HIV, relapse to opioid use exceeds 85%, often within the first 2 weeks,10 and results in interruptions in HIV care,11 overdose, and death.7 In prisoners without HIV, XR-NTX markedly reduces opioid relapse and use.20 This study extends these findings and documents for the first time that XR-NTX stabilizes PLH sufficiently to stabilize them so that they can continue and adhere to ART and maintain or achieve VS.
The mechanism by which XR-NTX maintained or improved VS is not fully understood. In another study of prisoners with HIV and alcohol use disorders, XR-NTX significantly reduced alcohol consumption and exerted its effect on VS.51 The current trial was not powered to demonstrate a difference in opioid relapse outcomes, which were measured using more complex metrics in previous studies of XR-NTX.14,20 In the current trial, however, the only opioid use outcome measured was time to opioid relapse, which was not statistically different between those receiving XR-NTX or placebo in the ITT analysis. A more robust opioid use outcome variable, which might have included a combination of time to relapse, days of opioid use, or continuous days of opioid use might have provided insights into how XR-NTX might have exerted its influence.
In addition, despite a low number of participants, retention on XR-NTX was associated with a longer time to relapse (continued abstinence). Participants who received 3 or more XR-NTX injections had a significantly longer time of continuous abstinence compared to those who received any number of placebo injections or those who received 2 or fewer injections of XR-NTX. This finding supports longitudinal studies of released prisoners with HIV and OUD who had better HIV treatment outcomes if they were able to remain on buprenorphine longer,11 a medication-assisted treatment for OUD that is a partial opioid agonist/antagonist. Strategies that improve retention on OUD treatment are therefore crucial to optimize VS levels and are especially challenging when using antagonist-based treatments such as XR-NTX.16 Cohort studies of released prisoners with HIV, irrespective of having an OUD, suggest that VS levels markedly decrease within the first 3 months after release.3,4,6,50 This period is therefore especially crucial to ensure adequate treatment for both HIV and OUD. Given the chronic and relapsing nature of both HIV and OUD, each of which need a lifetime of treatment, future studies should not only treat and observe patients longer, but should be conducted using other medication-assisted therapies for OUD, such as methadone and buprenorphine.
In addition to efficacy outcomes, treatment with XR-NTX is safe, especially given that 80% of the sample had chronic HCV infection. The fatal overdose that occurred that was not related to the study, however, remains concerning and has been raised as a concern in other studies of XR-NTX.52 Death occurred in one participant in the XR-NTX group 128 days after the last injection. This finding is consistent with all other studies of treatment of OUD where discontinuation of treatment, irrespective of the medication, is associated with increased overdose-related death.53–56 Previous studies have shown that XR-NTX protects against opioid overdose.20
Despite the important findings and implications of these research findings, some limitations remain. The lower-than-anticipated sample size concerns have been discussed elsewhere,13,16 but related to introduction of methadone in Connecticut and alternatives to incarceration strategies resulting in fewer numbers of PLH in prison in Connecticut and Massachusetts. Attrition from the study was high, but similar to other studies of released prisoners with OUD.6,57 Despite attrition from the study, VL measurements were high resulting in relatively few missing data that were MCAR, allowing for imputation of conservative missing = failure assumptions. This assumption, however, is typically what is considered in “real-world” treatment settings of PLH where the association between poor retention, particularly “no-show” behavior, and poorer biological outcomes is evidenced by virological failure and mortality.58,59 Despite the missing data and lower-than-expected sample size, the findings remain robust. A larger sample size and better measures of opioid use might have provided better insights into additional factors that might have contributed to VS in this sample.
Findings from this study inform guidelines for treating transitioning prisoners with HIV and OUD with XR-NTX to improve HIV treatment outcomes. Future strategies, however, must optimize treatment retention to reduce opioid use and maintain or increase VS. When XR-NTX is initiated just before release and maintained thereafter, it results in both improved individual and public health benefits. Not only was XR-NTX found to be efficacious, it was also safe in PLH and high levels of HCV.
1. Thompson MA, Mugavero MJ, Amico KR, et al. Guidelines for improving entry into and retention in care and antiretroviral adherence for persons with HIV: evidence-based recommendations from an International Association of Physicians in AIDS Care panel. Ann Intern Med. 2012;156:817–833, W-284, W-285, W-286, W-287, W-288, W-289, W-290, W-291, W-292, W-293, W-294.
2. Spaulding AC, Seals RM, Page MJ, et al. HIV/AIDS among inmates of and releasees from US correctional facilities, 2006: declining share of epidemic but persistent public health opportunity. PLoS One. 2009;4:e7558.
3. Meyer JP, Cepeda J, Wu J, et al. Optimization of human immunodeficiency virus treatment during incarceration: viral suppression at the prison gate. JAMA Intern Med. 2014;174:721–729.
4. Meyer JP, Cepeda J, Springer SA, et al. HIV in people reincarcerated in Connecticut prisons and jails: an observational cohort study. Lancet HIV. 2014;1:e77–e84.
5. Peters RH, Greenbaum PE, Edens JF, et al. Prevalence of DSM-IV substance abuse and dependence disorders among prison inmates. Am J Drug Alcohol Abuse. 1998;24:573–587.
6. Springer SA, Pesanti E, Hodges J, et al. Effectiveness of antiretroviral therapy among HIV-infected prisoners: reincarceration and the lack of sustained benefit after release to the community. Clin Infect Dis. 2004;38:1754–1760.
7. Springer SA, Spaulding AC, Meyer JP, et al. Public health implications for adequate transitional care for HIV-infected prisoners: five essential components. Clin Infect Dis. 2011;53:469–479.
8. Binswanger IA, Stern MF, Deyo RA, et al. Release from prison–a high risk of death for former inmates. N Engl J Med. 2007;356:157–165.
9. Lim S, Seligson AL, Parvez FM, et al. Risks of drug-related death, suicide, and homicide during the immediate post-release period among people released from New York city jails, 2001–2005. Am J Epidemiol. 2012;175:519–526.
10. Merrall EL, Kariminia A, Binswanger IA, et al. Meta-analysis of drug-related deaths soon after release from prison. Addiction. 2010;105:1545–1554.
11. Springer SA, Qiu J, Saber-Tehrani AS, et al. Retention on buprenorphine is associated with high levels of maximal viral suppression among HIV-infected opioid dependent released prisoners. PLoS One. 2012;7:e38335.
12. Springer SA, Chen S, Altice FL. Improved HIV and substance abuse treatment outcomes for released HIV-infected prisoners: the impact of buprenorphine treatment. J Urban Health. 2010;87:592–602.
13. Di Paola A, Lincoln T, Skiest DJ, et al. Design and methods of a double blind randomized placebo-controlled trial of extended-release naltrexone for HIV-infected, opioid dependent prisoners and jail detainees who are transitioning to the community. Contemp Clin Trials. 2014;39:256–268.
14. Krupitsky E, Nunes EV, Ling W, et al. Injectable extended-release naltrexone for opioid dependence: a double-blind, placebo-controlled, multicentre randomised trial. Lancet. 2011;377:1506–1513.
15. Springer SA, Altice FL, Herme M, et al. Design and methods of a double blind randomized placebo-controlled trial of extended-release naltrexone for alcohol dependent and hazardous drinking prisoners with HIV who are transitioning to the community. Contemp Clin Trials. 2014;37:209–218.
16. Springer SA, Brown SE, Di Paola A, et al. Correlates of retention on extended-release naltrexone among persons living with HIV infection transitioning to the community from the criminal justice system. Drug Alcohol Depend. 2015;157:158–165.
17. Vagenas P, Di Paola A, Herme M, et al. An evaluation of hepatic enzyme elevations among HIV-infected released prisoners enrolled in two randomized placebo-controlled trials of extended release naltrexone. J Subst Abuse Treat. 2014;47:35–40.
18. O'Malley SS, Garbutt JC, Gastfriend DR, et al. Efficacy of extended-release naltrexone in alcohol-dependent patients who are abstinent before treatment. J Clin Psychopharmacol. 2007;27:507–512.
19. Garbutt JC, Kranzler HR, O'Malley SS, et al. Efficacy and tolerability of long-acting injectable naltrexone for alcohol dependence: a randomized controlled trial
. JAMA. 2005;293:1617–1625.
20. Lee JD, Friedmann PD, Kinlock TW, et al. Extended-release naltrexone to prevent opioid relapse in criminal justice offenders. N Engl J Med. 2016;374:1232–1242.
21. Tanum L, Klemmetsby K, Latif Z, et al. The effectiveness of injectable extended-release naltrexone vs daily buprenorphine -naloxone for opioid dependene: a randomized clinical noninferiority trial. JAMA Psychiatry. 2017;74:1197.
22. Lee J, Nunes E, Novo P, et al. Comparative effectiveness of extended-release naltrexone versus buprenorphine-naloxone for opioid relapse prevention (X: BOT): a multicentre, open-label, randomised controlled trial. Lancet. 2018;391:309–318.
23. International Harm Reduction Development Program (IHRD) of the Open Society Institute (OSI). Barriers to Access: Medication-Assisted Treatment and Injection-Driven HIV Epidemics. New York, NY: Open Society Institute; 2008.
24. Scott NW, McPherson GC, Ramsay CR, et al. The method of minimization for allocation to clinical trials. a review. Control Clin Trials. 2002;23:662–674.
25. Kang M, Ragan BG, Park JH. Issues in outcomes research: an overview of randomization techniques for clinical trials. J Athl Train. 2008;43:215–221.
26. Tideman RL, Chen MY, Pitts MK, et al. A randomised controlled trial comparing computer-assisted with face-to-face sexual history taking in a clinical setting. Sex Transm Infect. 2007;83:52–56.
27. Caldwell DH, Jan G. Computerized assessment facilitates disclosure of sensitive HIV risk behaviors among African Americans entering substance abuse treatment. Am J Drug Alcohol Abuse. 2012;38:365–369.
28. Sheehan D, Lecrubier Y, Harnett-Sheehan K, et al. Reliability and validity of the MINI International Neuropsychiatric interview (M.I.N.I.): according to the SCID-P. Eur Psychiatry. 1997;12:232–241.
29. Sheehan DV, Lecrubier Y, Sheehan KH, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59:22–33.
30. Wang J, Kelly BC, Booth BM, et al. Examining factorial structure and measurement invariance of the brief symptom inventory (BSI)-18 among drug users. Addict Behav. 2010;35:23–29.
31. Delate T, Coons SJ. The discriminative ability of the 12-item short form health survey (SF-12) in a sample of persons infected with HIV. Clin Ther. 2000;22:1112–1120.
32. Saunders JB, Aasland OG, Babor TF, et al. Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption–II. Addiction. 1993;88:791–804.
33. Sobell L, Sobell M. Timeline followback: a technique for assessing self-reported ethanol consumption. In: Allen J, Litten RZ, eds. Measuring Alcohol Consumption: Psychosocial and Biological Methods. Totowa, NJ: Humana Press; 1992:41–72.
34. Fiellin DA, McGinnis KA, Maisto SA, et al. Measuring alcohol consumption using timeline followback in non-treatment-seeking medical clinic patients with and without HIV infection: 7-, 14-, or 30-day recall. J Stud Alcohol Drugs. 2013;74:500–504.
35. Levine J, Schooler NR. SAFTEE: a technique for the systematic assessment of side effects in clinical trials. Psychopharmacol Bull. 1986;22:343–381.
36. Pettinati H, Weiss R, Miller WR, et al. Medical Management Treatment Providing Pharmacotherapy as Part of the Treatment for Alcohol Dependence. Bethesda, MD: NIAAA, DHHS; 2004.
37. Saber-Tehrani AS, Springer SA, Qiu J, et al. Rationale, study design and sample characteristics of a randomized controlled trial
of directly administered antiretroviral therapy for HIV-infected prisoners transitioning to the community—a potential conduit to improved HIV treatment outcomes. Contemp Clin Trials. 2012;33:436–444.
38. Little RJA. A test of missing completely at random for multivariate data with missing values. J Am Stat Assoc. 1988;83:1198–1202.
39. Beaujean AA. R Package for Baylor University Educational Psychology Quantitative Courses. R Package Version 0.5 [Computer Program]. Waco, TX: Baylor University; 2012.
40. Smuk M, Carpenter JR, Morris TP. Erratum to: what impact do assumptions about missing data have on conclusions? A practical sensitivity analysis for a cancer survival registry. BMC Med Res Methodol. 2017;17:51.
41. Smuk M, Carpenter JR, Morris TP. What impact do assumptions about missing data have on conclusions? A practical sensitivity analysis for a cancer survival registry. BMC Med Res Methodol. 2017;17:21.
42. The AVANTI Steering Committee. Analysis of HIV-1 clinical trials: statistical magic? The AVANTI Steering Committee. Lancet. 1999;353:2061–2064.
43. Panel on Antiretroviral Guidelines for Adults and Adolescents. Guidelines for the Use of Antiretroviral Agents in HIV-1-Infected Adults and Adolescents. Washington, DC: Services DoHaH; 2015.
44. Altice FL, Bruce RD, Lucas GM, et al. HIV treatment outcomes among HIV-infected, opioid-dependent patients receiving buprenorphine/naloxone treatment within HIV clinical care settings: results from a multisite study. J Acquir Immune Defic Syndr. 2011;56(suppl 1):S22–S32.
45. Ruxton GD. The unequal variance t-test is an underused alternative to Student's t-test and the Mann–Whitney U test. Behav Ecol. 2006;17:688–690.
46. Mcnemar Q. Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika. 1947;12:153–157.
47. Fay M. Two-sided exact tests and matching confidence intervals for discrete data. R J. 2010;2:53–58.
48. Fay M, Sally A. exact2x2: xact tests and confidence intervals for 2x2 tables. R package version 1.5.2. 2017;2:53–58.
49. Copersino ML, Meade CS, Bigelow GE, et al. Measurement of self-reported HIV risk behaviors in injection drug users: comparison of standard versus timeline follow-back administration procedures. J Subst Abuse Treat. 2010;38:60–65.
50. Loeliger KB, Altice FL, Desai M, et al. Predictors of linkage to HIV care and viral suppression levels following release from jails and prisons: a retrospective cohort study Lancet HIV. 2018;5:e96–e106.
51. Springer SA, Di Paola A, Azar MM, et al. Extended-release naltrexone reduces alcohol consumption among released prisoners with HIV disease as they transition to the community. Drug Alcohol Depend. 2017;174:158–170.
52. Wolfe D, Carrieri MP, Dasgupta N, et al. Concerns about injectable naltrexone for opioid dependence. Lancet. 2011;377:1468–1470.
53. Krupitsky E, Nunes EV, Ling W, et al. Injectable extended-release naltrexone for opioid dependence. Lancet. 2011;378:665; author reply 666.
54. Increase in fatal poisonings involving opioid analgesics in the United States 1999-2006: National centre for health Statistics (NCHS) data brief. 2011. Available at: http://www.cdc.gov/nchs/data/databriefs/db22.htm
. Accessed August 20, 2011.
55. Cornish R, Macleod J, Strang J, et al. Risk of death during and after opiate substitution treatment in primary care: prospective observational study in UK general practice research database. BMJ. 2010;341:c5475.
56. Woody GE, Metzger DS. Injectable extended-release naltrexone for opioid dependence. Lancet. 2011;378:664–665; author reply 666.
57. Zelenev A, Marcus R, Kpoelev A, et al. Patterns of homelessness and implications for HIV health after release from jail. AIDS Behav. 2013;17(suppl 2):S181–S194.
58. Zinski A, Westfall AO, Gardner LI, et al. The contribution of missed clinic visits to disparities in HIV viral load outcomes. Am J Public Health. 2015;105:2068–2075.
59. Horberg MA, Hurley LB, Silverberg MJ, et al. Missed office visits and risk of mortality among HIV-infected subjects in a large healthcare system in the United States. AIDS Patient Care STDS. 2013;27:442–449.