Secondary Logo

Journal Logo

EPIDEMIOLOGY AND SOCIAL

Interactive digital interventions for prevention of sexually transmitted HIV

Bailey, Julia V.a; Wayal, Sonalia,b,c; Aicken, Catherine R.H.c,d; Webster, Rosiea; Mercer, Catherine H.c; Nazareth, Irwine; Rait, Gretae; Peacock, Richardf; Murray, Elizabetha

Author Information
doi: 10.1097/QAD.0000000000002780

Abstract

Introduction

The global annual HIV incidence has been relatively constant since 2005 but with marked differences between countries [1], strong deprivation gradients [2], and disproportionate impact in groups such as MSM, sex workers, prisoners, transgender people and injecting drug users [3]. HIV incurs substantial personal, social and economic costs [1].

Interventions to prevent sexually transmitted HIV have historically focused on behaviour change to increase safer sex [4–7] but attention has turned to treatment as prevention [viral suppression with antiretroviral therapy (ART)] [8]. Global U = U campaigns (Undetectable equals Untransmissible) [9] have fast-track targets to end the AIDS epidemic by 2030 [10].

There has been good progress towards meeting 95--95--95 targets: in 2019, an estimated 81% of HIV-positive people worldwide knew their status, 82% of those were accessing treatment, and 88% were virally suppressed [3]. Alongside scaling up access to ART, the success of this campaign depends upon sociocultural and behavioural change including increased awareness; tackling myths, stigma and shame; increased uptake of HIV testing; and adherence to ART [5,10]. HIV prevention through safer sex remains essential (e.g. condom use, negotiated safety) [11].

Access to the Internet and mobile phones is increasing globally, although large inequalities remain [12,13]. Digital interventions offer private, convenient access, which is particularly useful for stigmatized sexual health issues [14]. Multimedia formats such as audio and video can help to reach people with poor literacy, and digital interventions can increase engagement by offering individualized feedback [15].

There is a wealth of sexual health information online but information alone is not usually enough to prompt behaviour change [16]. Interactive digital interventions (IDIs) are theory-based behaviour change interventions that provide information and tailored, personalized feedback to support decisions, for behaviour change, or for emotional support [4]. Tailoring increases the relevance of material, to enhance engagement, learning, and behaviour change [15,17,18]. This systematic review establishes the effectiveness of tailored IDIs for prevention of sexually transmitted HIV.

Methods

Objectives

  • (1) To determine the effectiveness of IDIs for prevention of sexually transmitted HIV in comparison to minimal interventions (e.g. waiting list, leaflet)
  • (2) To determine whether IDIs for HIV prevention are as effective as face-to-face interventions
  • (3) To determine cost-effectiveness

Search strategy

We followed Cochrane Collaboration methods to update our 2010 Cochrane review of interactive computer-based interventions for sexual health promotion [4], and then selected studies focusing solely on HIV prevention (Supplemental Digital Content 1 – PRISMA Diagram, http://links.lww.com/QAD/B935). In 2013, we searched the same databases as for the Cochrane review [19], and updated the review again in 2017, searching fewer databases from 2014 to June 2017 in light of the vast number of citations (Supplemental Digital Content 2 – Search Terms, http://links.lww.com/QAD/B936). We searched databases of published literature including the Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, CINAHL, PsycINFO, grey literature, conference abstracts and trials registers. We also searched reference lists of included studies and databases of sexual health interventions.

The search strategy constituted three concepts: RCT design filter [20] or health economic evaluation AND Computer-based/digital interventions AND Sexual health, including HIV prevention (see Search Terms -- Supplemental Digital Content 2, http://links.lww.com/QAD/B936).

Inclusion and exclusion criteria

Eligible studies were RCTs or health economic evaluations of IDIs for prevention of sexually transmitted HIV. IDIs were defined as ‘programmes that provide information and one or more of decision support, behaviour-change support, or emotional support for health issues, requiring contributions from users to produce tailored, personally relevant feedback, delivered by any digital media’ [4]. IDIs may be for self-guided use, or with remote or face-to-face human support to enhance engagement.

We sought interventions intended to prevent acquisition or transmission of HIV through sexual risk-reduction, for example, using condoms for penetrative sex; reduction in partner numbers; sero-sorting; or uptake of pre-exposure prophylaxis (PrEP). We included any populations in any setting, and any HIV status.

We excluded non-interactive interventions; electronic healthcare communication; composite interventions, which combine an IDI with an active human component; interventions to optimize healthcare delivery; and interventions addressing clinical management of HIV (e.g. adherence to ART) as people receiving care are likely to also receive face-to-face health promotion, and we wished to assess the effect of self-directed IDIs [4,21].

Group 1 compared IDIs with minimal interventions (e.g. being on a waiting list; receiving a leaflet; measurement only), to assess whether IDIs are effective. Group 2 compared IDIs with face-to-face interventions, to assess whether IDIs are equally effective.

Screening and data extraction

Two review authors (J.B. and S.W., R.W. or C.A.) independently screened titles, abstracts and full texts of candidate studies using Reference Manager or Covidence software. We independently extracted data, resolving disagreements through discussion or by seeking a third opinion (E.M.). We contacted authors of included studies wherever necessary, to clarify details of study design and for missing data, making multiple attempts to contact authors. J.B., S.W., and C.A. transferred data into Review Manager software, double-checking the accuracy.

Study characteristics and outcomes

We categorized outcomes as follows:

  • (1) Cognitive outcomes: HIV-related knowledge; self-efficacy (a person's belief in their capacity to carry out a specific action); behavioural intention.
  • (2) Behavioural outcomes: for example, condom use; partner numbers; HIV testing; negotiation/communication with a partner.
  • (3) Biological outcomes: for example, HIV or STI acquisition; viral load.
  • (4) Health economic outcomes: for example, costs of developing and implementing IDIs; costs and savings for health services and/or users/consumers.

Where multiple outcomes were reported in one study, we selected one outcome only from each outcome category, prioritising (in order): authors’ primary outcomes, outcomes reflecting the intervention's main aim, sexual health outcomes in preference to other domains, condom-related outcomes, laboratory measured outcomes and data from the longest measured follow-up period [4]. We recorded any adverse effects attributable to an intervention.

Assessment of risk of bias, sensitivity analyses and subgroup analyses

We assessed study quality using the Cochrane risk of bias tool. Studies at high risk of bias because of inadequate sequence generation or concealment of allocation were excluded. Studies with less than 80% retention were deemed ‘high risk of bias’, but retained. We assessed the effect of study quality by repeating the analyses including only studies at low risk of bias because of randomisation procedures and loss to follow-up, comparing the results with the main meta-analyses. Other quality factors were considered in interpretation of the findings (e.g. selective reporting, blinding, and other sources of bias) (Supplemental Digital Content 3 -- Included Studies, http://links.lww.com/QAD/B937; Supplemental Digital Content 4 -- Figure: Risk of Bias, http://links.lww.com/QAD/B938).

We explored heterogeneity by conducting post hoc subgroup analyses by Setting (educational, healthcare, online); Population Targeted (MSM, other at-risk adults, general populations), and HIV status (HIV-positive; or HIV-negative, unknown or any status).

Data syntheses

We sought numerators and denominators for dichotomous (yes/no) variables, and means, standard deviations and participant numbers for continuous variables. When no standard deviation was available, we calculated this using the F statistic. Where necessary to combine data, we expressed odds ratios (ORs) as standardized mean differences (SMDs) or vice versa [22].

We pooled results of RCTs using a random-effects model, which allows combination of outcomes measured using different scales (e.g. study-specific knowledge tests). We comment on the size of SMDs using Cohen's rules of thumb, judging less than 0.40 to be ‘small’; 0.4--0.70, ‘moderate’; and greater than 0.70 a ‘large’ effect [23]. We assessed statistical heterogeneity by using the I2 statistic to estimate variance between studies and chi-square test for heterogeneity, interpreting the I2 statistic as follows: less than 25% might not be important; 25 to less than 50%: moderate heterogeneity; 50 to less than 75%: substantial; 75 to 100%: considerable.

Results

A total of 29 606 citations were screened (Supplemental Digital Content 1 – PRISMA Diagram, http://links.lww.com/QAD/B935). The full texts of 411 publications were screened, yielding 38 potentially eligible RCTs of IDIs for HIV prevention (reported in 37 articles). We found no health economic evidence.

We subsequently excluded seven studies: two RCTs which compared different designs of IDI [24,25], three that were at high risk of bias in their method of randomization [26–28], one for which control arm data were unavailable [29], and one which reported a large loss to follow-up with insufficient data for analysis [30].

We therefore included 31 RCTs (reported in 30 articles), with 29 RCTs addressing IDI effectiveness (Group 1) and five RCTs comparing IDIs with face-to-face interventions (Group 2). In total 11 293 people were randomized, 10 423 in Group 1 and 870 in Group 2.

Description of studies

Most studies were conducted in the USA (27/31), and one each in the Netherlands [31], Uganda [32], Zambia [33] and Sweden [34] (Supplemental Digital Content 3 – Included Studies, http://links.lww.com/QAD/B937). Twelve studies targeted young people [32,35–45], 10 targeted MSM [31,34,35,38,46–51], and five targeted HIV-positive people [49,52–55]. One study targeted adults at risk of HIV (including MSM and intravenous drug users) [56], and another targeted African American women [57]. Participants were recruited online [34–36,38,46–48,51,58]; through educational settings [32,40,41,43]; healthcare settings [36,37,42,44,50,52–56,59–61]; and other institutions including social care [39], a drug court [62] and the military [60].

Aims and design of interventions

Most interventions focused on behavioural change for prevention of HIV and other STI, or HIV alone (Supplemental Digital Content 3 – Included Studies, http://links.lww.com/QAD/B937). One intervention promoted voluntary male circumcision [33], and one addressed drug use, alcohol and safe sex in combination [63].

Programmes offered tailored material in a variety of ways, tailoring by age [44], gender and ethnicity [36]; ethnicity and sexual experience [42]; gender and sexual experience [32]; sexual orientation [54]; sexual risk and/or drug use and alcohol use [25,47,52,54]; and by offering tailored feedback according to users’ knowledge, motivation and behavioural skills [31,43]; stage of change [37,51], or knowledge [39,43,48,53,56,60,64]. Other interventions offered interactive texts and virtual peers sharing experiences [51]; feedback following virtual decisions or scenarios [38,48,50]; rehearsal of communication skills and decisions [53,59]; appraising ’dysfunctional thoughts’ [56]; visualization of a social support network [53]; and personal goals with feedback on achievement [43,53,54].

Risk of bias in included studies

Seventeen out of the 31 studies were judged low risk of bias in terms of random sequence generation and concealment of allocation (Supplemental Digital Content 4 – Figure: Risk of Bias, http://links.lww.com/QAD/B938). Retention at follow-up was at least 80% without differential loss to follow-up in 16 of 31 studies. Outcomes had been selectively reported in one study, with data unavailable from authors [60].

Group 1: Are interactive digital interventions effective?

Twenty-nine studies examined the effectiveness of IDIs compared with minimal interventions. A total of 5277 people were randomized to receive an IDI, and 5146 received minimal interventions (e.g. waiting list, leaflet, or measurement only) (Supplemental Digital Content 5 – Table: Summary of Findings, Group One, http://links.lww.com/QAD/B939).

Do interactive digital interventions improve HIV-related knowledge?

We combined data from 12 out of 14 studies which reported HIV-related knowledge. One additional study reported no difference in knowledge [60], and one reported significant improvements [44], but data suitable for analysis were unavailable. Meta-analysis showed an SMD of 0.56 for knowledge [95% confidence interval (CI) 0.33--0.80], which is a moderate effect (Fig. 1). We were not able to adjust for clustering effects in one study [39]: adjustment would probably have widened the confidence intervals. There was considerable heterogeneity (I2 = 82%, P < 0.0001).

Fig. 1
Fig. 1:
Forest plot: interactive digital interventions versus minimal interventions: knowledge.

Do interactive digital interventions improve HIV prevention self-efficacy?

We combined data from 14 out of 16 studies which reported self-efficacy. Two additional studies found no difference between intervention and control for self-efficacy, with data unavailable from authors [44,50]. Meta-analysis showed an SMD of 0.13 (95% CI 0.00--0.27) (Fig. 2). We were not able to adjust for clustering effects in one study [39]. There was substantial heterogeneity (I2 = 68%, P = 0.0001).

Fig. 2
Fig. 2:
Forest plot: interactive digital interventions versus minimal interventions: self-efficacy.

Do interactive digital interventions impact on HIV prevention intention?

We combined data from nine out of 12 studies which measured behavioural intention. Meta-analysis showed a small effect on HIV-related intentions for IDIs compared with minimal interventions (SMD 0.16, 95% CI 0.06--0.26); heterogeneity I2 = 0% (Fig. 3). Two additional studies found no difference between intervention and control for intention, but data for analysis were unavailable [44,50]. Another study reported significant improvement in readiness to change condom use [60], but data were unavailable.

Fig. 3
Fig. 3:
Forest plot: interactive digital interventions versus minimal interventions: intention.

Do interactive digital interventions improve HIV prevention behaviours?

Twenty-one out of 23 studies contributed to a meta-analysis of behavioural outcomes. Suitable data were unavailable for three studies [44,50,60]. Meta-analysis showed a combined odds ratio of 1.28 (95% CI 1.04--1.57) for HIV prevention behaviours (Fig. 4). There was considerable heterogeneity (I2 = 66%, P < 0.0001).

Fig. 4
Fig. 4:
Forest plot: interactive digital interventions versus minimal interventions: behaviour.

Do interactive digital interventions affect biological outcomes?

Four RCTs out of seven contributed to a meta-analysis of biological outcomes, measuring HIV viral load [55], and other STIs (e.g. chlamydia, gonorrhoea, syphilis) [36,49]. One study [56] reported no new diagnoses of HIV so could not be included in the meta-analysis, and data were unavailable for another study (self-reported HIV status) [31]. One study specifically aimed to increase testing, so we excluded this from the meta-analysis as STI/HIV detection could increase as consequence of increased testing [35]. Meta-analysis of three studies showed no impact on STI diagnoses (OR 1.48, 95% CI 0.96--2.28), with one study reporting an increase in detectable HIV viral load (OR 1.61, 95% CI 1.01--2.55) (Fig. 5). There was no overall heterogeneity (I2 = 0%).

Fig. 5
Fig. 5:
Forest plot: interactive digital interventions versus minimal interventions: biological outcomes.

Does study quality affect results?

Excluding studies at unclear risk of bias because of their methods of randomization did not substantially alter effect sizes. Excluding studies at high risk of bias because of less than 80% retention tended to increase overall effect sizes, implying that those who drop out may also be those who would benefit from interventions (analyses available from authors). The outcome measurements for biological outcomes (STI diagnoses and HIV viral load) were prone to bias: the event rate for self-reported STI (Bull et al. 2009, online RCT results) was very small, with wide confidence intervals [36]; Milam et al. 2016 was a small trial (49 participants) [49]; and viral load data were not available for 48% of McKinstry et al's sample [55]; so the finding that an IDI appeared to increase HIV viral load should be treated with caution.

Effects by setting, population targeted and HIV status

There were no subgroup differences for IDIs offered in different settings (educational settings; healthcare; or online) for knowledge, self-efficacy, intention, or HIV prevention behaviours, and setting did not account for heterogeneity (Supplemental Digital Content 7 – Forest plots, Figures 9--12, http://links.lww.com/QAD/B941).

There were no subgroup differences by population targeted (MSM; other adults at risk of HIV; and general populations) for knowledge, self-efficacy or intention, and targeting did not account for heterogeneity for these outcomes. IDIs showed more impact on behavioural outcomes for adults at risk of HIV than for MSM or general populations (Supplemental Digital Content 7 – Forest plots, Figures 13--16, http://links.lww.com/QAD/B941). This analysis reduced some of the heterogeneity.

There were no significant differences in effects by HIV status for knowledge, self-efficacy, intention or behaviour, and HIV status did not account for heterogeneity (Supplemental Digital Content 7 – Forest plots, Figures 17--20, http://links.lww.com/QAD/B941).

There were too few studies to explore subgroups for biological outcomes.

Summary: Are interactive digital interventions effective?

We found that IDIs had moderate effects on HIV-related knowledge and HIV prevention behaviours, with no clear effect on self-efficacy, and a small effect on intention. The meta-analysis of biological outcomes (STI diagnoses/HIV viral load) is unreliable because of potential bias in outcome measurement. There were no significant differences by setting, population targeted, or HIV status, except for a greater impact on behavioural outcomes for IDIs delivered to risk groups other than MSM. This group included African American women at risk through sexual behaviour and/or injecting drug use [57], adults in a drug court [62] and HIV-positive adults [52–55].

Group 2: Are interactive digital interventions as effective as face-to-face interventions?

Five RCTs compared IDIs with nondigital, face-to-face HIV prevention (Supplemental Digital Content 6 – Group Two Outcomes, http://links.lww.com/QAD/B940). Four hundred and thirty-four people were randomized to receive an IDI, and 436 to face-to-face interventions (e.g. HIV education, counselling or a lecture). These trials are equivalence trials, which test whether one intervention is as effective as another (i.e. whether there is evidence of no difference).

Knowledge

We combined data from three out of four small studies which measured knowledge [40,45,56]. Meta-analysis showed no evidence of difference between IDIs and face-to-face comparators (SMD 0.12, 95% CI −0.39 to 0.63), although the total sample size was small (Supplemental Digital Content 7 – Figure 6, http://links.lww.com/QAD/B941). One further study reported no difference in knowledge between an IDI and a face-to-face intervention [60], but data were unavailable.

Self-efficacy

We combined data from three studies which measured self-efficacy [37,40,45]. Meta-analysis showed no evidence of difference between IDIs and face-to-face comparators (SMD 0.15, 95% CI −0.05 to 0.36), although the total sample size was small (Supplemental Digital Content 7 – Figure 7, http://links.lww.com/QAD/B941).

Intention

We combined data from three of the four studies which measured HIV-related behavioural intention [37,40,45]. Meta-analysis showed no evidence of difference between IDIs and face-to-face comparators (SMD 0.12, 95% CI −0.31 to 0.56), although the total sample size was small (Supplemental Digital Content 7 – Figure 8, http://links.lww.com/QAD/B941). One additional study reported readiness to change (condom use), with greater improvement at 2 weeks for the face-to-face intervention [60], but 2-month outcome data were unavailable.

HIV prevention behaviours

Two studies measured behavioural outcomes. Data were not available for Jenkins et al.[60]. (condom use with risky partners), so meta-analysis was not possible. Marsch et al.[45] found no evidence of difference between an IDI and a face-to-face intervention for unprotected sex but this was a small study (74 participants).

Biological outcomes

Only one study reported a biological outcome (HIV seroconversion) [56] but could not evaluate impact on HIV acquisition as there were no new diagnoses.

Summary: Are interactive digital interventions as effective as face-to-face interventions?

We found no evidence of difference between IDIs and face-to-face interventions for knowledge, self-efficacy, intention, or HIV-related behaviours. Outcomes for both IDIs and face-to-face interventions generally improved from baseline, pointing towards these being equally effective rather than equally ineffective, although the body of evidence is small and stronger evidence is needed. We could not evaluate biological outcomes.

Discussion

This systematic review provides compelling evidence that IDIs have positive effects on knowledge and HIV prevention behaviours. The meta-analysis of biological outcome measures (STI diagnoses/HIV viral load) is unreliable because of potential bias in outcome measurement. We found no evidence of difference in effectiveness between IDIs and face-to-face interventions, and no evidence on cost-effectiveness.

Quality of the review

This review synthesizes 31 RCTs conducted over nearly 30 years. Whilst technology has changed over time, the review evaluates the impact of tailored IDI for specific target populations, regardless of technology or mode of delivery. Study quality was mixed, with large, mostly unexplained heterogeneity. There was often insufficient detail to judge risk of bias: we made considerable effort to contact authors but many assessments remain unclear. However, our sensitivity analyses were reassuring as effect sizes were unchanged or increased when we removed lower quality studies.

Interventions reached populations at risk of HIV, including young people, MSM, intravenous drug users, soldiers, and socioeconomically deprived communities, but most trials were conducted in high-income countries (mostly the USA). There was considerable heterogeneity, but this was not accounted for by study quality, setting, HIV status, or by population targeted (except for behavioural outcomes). IDIs are complex interventions with many components, and they vary across many dimensions (e.g. informational content, theoretical basis, multimedia features, mode of delivery, etc.) [19].

Implications of findings

There is strong evidence from RCTs conducted in a variety of settings that IDIs are effective for improving HIV-related knowledge, and this supports the roll-out of IDIs for HIV education. We found a significant overall impact on HIV-related behaviour but individual study results were mixed: further research is needed to find out what works for whom in what circumstances [5], the cost-effectiveness of IDIs [19,65], and to establish whether IDIs are as effective as face-to-face interventions.

IDIs were effective for people living with HIV, which is an important finding as attention turns to treatment as prevention [11]. Our findings support targeting MSM as well as adults in other HIV risk groups.

Biological outcomes are regarded as gold standard to evaluate STI/HIV prevention interventions but there are considerable measurement challenges, including low STI or HIV event rates (particularly over short follow-up periods) [56], and the costs and practical challenges of biological sampling [4]. Better quality outcome measurement is needed to explore the impact of IDIs on biological outcomes, differentiating increased detection from increased STI/HIV acquisition (e.g. testing all participants instead of relying on self-report or medical records).

Digital interventions for HIV to date favour education and behaviour change over linkage to care and medication adherence [11]. Behaviour change interventions for safer sex and earlier HIV detection remain extremely important globally, and biomedical interventions (such as male circumcision, PrEP, PEP and treatment as prevention) need to address psychosocial and behavioural dimensions to be effective [10,21,38]. Mobile phone (SMS) interventions are acceptable and feasible and can impact on clinic attendance, ART adherence and time from testing to treatment but do not impact on risk behaviour [65]. The next generation of IDIs need to address the behavioural dimensions of uptake of care and treatment as prevention [11]. We also need to know the effectiveness and cost-effectiveness of composite interventions for HIV prevention (IDIs offered together with face-to-face education or clinical care).

Digital interventions are highly scalable [19], and dissemination of self-administered IDIs can be fast and relatively cheap [66], Some at-risk populations may seek sexual partners online (e.g. MSM, young people, sex workers), and apps and websites for dating, porn and buying sex offer an opportunity for online sexual health promotion [13,14]. Sexual health services such as online self-testing also present an important opportunity for sexual health promotion [67,68].

Conclusion

There is good evidence that IDIs have positive effects on knowledge and sexually transmitted HIV prevention behaviours. IDIs are very appropriate for HIV prevention globally, for a range of populations, in different settings including schools and further education, in clinics and/or online.

Acknowledgements

We wish to thank Dr Bronwen Merner, Dr Dianne Lowe, Dr Rebecca Ryan, Louisa Walsh from the Cochrane Consumers and Communication Group, for their comments on review methods and quality.

Funding: NIHR Public Health Research Programme 11/3009: Sexual health promotion delivered by digital media: Scoping Exercise (2013–14, for SW and JB). No other funding source.

Role of the funding source: The NIHR had no role in the review protocol design, data collection, analysis, interpretation or writing, or in the decision to submit the paper for publication.

Contributions of authors: Drafting the protocol: J.B., S.W., E.M., G.R., R.P., I.N.

Developing a search strategy: J.B., R.P., S.W.

Searching for trials: S.W., R.W., C.A., J.B.

Selecting trials for inclusion: J.B., S.W., with C.A. as arbiter.

Extracting data from trials: J.B., S.W., C.A.

Entering data into Review Manager software: J.B., S.W., R.W., C.A.

Performing the analysis: J.B., S.W., C.A., with statistical advice from C.M.

Interpreting the results: all co-authors.

Writing the review: J.B., S.W., C.A.

Editing and approving the final paper: all co-authors.

Conflicts of interest

There are no conflicts of interest.

References

1. GBD 2015 HIV Collaborators. Estimates of global, regional, and national incidence, prevalence, and mortality of HIV, 1980-2015: the Global Burden of Disease Study 2015. Lancet HIV 2016; 3:e361–e387.
2. European Centre for Disease Prevention and Control. Continuum of HIV care. Monitoring implementation of the Dublin Declaration on Partnership to Fight HIV/AIDS in Europe and Central Asia: 2018 progress report, 2019. Available at https://www.ecdc.europa.eu/en/publications-data/continuum-hiv-care-monitoring-implementation-dublin-declaration-2018-progress [Accessed 3 December 2020]
3. UNAIDS. Global HIV & AIDS statistics — 2020 fact sheet. 2020. Available at: https://www.unaids.org/en/resources/fact-sheet [Accessed 3 December 2020]
4. Bailey JV, Murray E, Rait G, Mercer CH, Morris RW, Peacock R, et al. Interactive computer-based interventions for sexual health promotion (review). Cochrane Database of Syst Rev 2010; (9):CD006483DOI: 10.1002/14651858.CD006483.pub2.
5. Krishnaratne S, Hensen B, Cordes J, Enstone J, Hargreaves JR. Interventions to strengthen the HIV prevention cascade: a systematic review of reviews. Lancet HIV 2016; 3:e307–e317.
6. Noar SM, Black HG, Pierce LB. Efficacy of computer technology-based HIV prevention interventions: a meta-analysis. AIDS 2009; 23:107–115.
7. Noar SM, Pierce LB, Black HG. Can computer mediated interventions change theoretical mediators of safer sex? A meta-analysis. Hum Commun Res 2010; 36:261–297.
8. Cohen MS, Chen YQ, McCauley M, Gamble T, Hosseinipour MC, Kumarasamy N, et al. HPTN 052 Study Team. Antiretroviral therapy for the prevention of HIV-1 transmission. New Engl J Med 2016; 375:830–839.
9. Eisinger RW, Dieffenbach CW, Fauci AS. HIV viral load and transmissibility of HIV infection: undetectable equals untransmittable. JAMA 2019; 321:451–452.
10. UNAIDS. Fast-track: ending the AIDS epidemic by 2030. 2014.
11. Maloney KM, Bratcher A, Wilkerson R, Sullivan PS. Electronic and other new media technology interventions for HIV care and prevention: a systematic review. J Int AIDS Soc 2020; 23:e25439.
12. International Telecommunication Union. Country ICT data to 2019 (2020). Available at: https://www.itu.int/en/ITU-D/Statistics/Pages/stat/default.aspx. [Accessed 3 December 2020]
13. Campbell BR, Ingersoll KS, Flickinger TE, Dillingham R. Bridging the digital health divide: toward equitable global access to mobile health interventions for people living with HIV. Expert Rev Anti Infect Ther 2019; 17:141–144.
14. Bailey JV, Mann S, Wayal S, Abraham C, Murray E. Digital media interventions for sexual health promotion-opportunities and challenges. BMJ 2015; 350:h1099.
15. Lustria MA, Cortese J, Noar SM, Glueckauf RL. Computer-tailored health interventions delivered over the web: review and analysis of key components. Patient Educ Couns 2009; 74:156–173.
16. Stephenson JM, Imrie J, Bonell C. Effective sexual health interventions. Issues in experimental evaluation. Oxford, New York: Oxford University Press; 2003.
17. Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull 2007; 133:673–693.
18. Noar SM, Grant Harrington N, Van Stee SK, Shemanski Aldrich R. Tailored health communication to change lifestyle behaviors. Am J Lifestyle Med 2011; 5:112–122.
19. Bailey JV, Mann S, Wayal S, Hunter R, Free C, Abraham C, Murray E. Sexual health promotion for young people delivered via digital media: a scoping review. Southampton (UK): NIHR Journals Library 2015; PMID: 26583166.
20. Robinson KA, Dickersin K. Development of a highly sensitive search strategy for the retrieval of reports of controlled trials using PubMed. Int J Epidemiol 2002; 31:150–153.
21. Chaiyachati KH, Ogbuoji O, Price M, Suthar AB, Negussie EK, Bärnighausen T. Interventions to improve adherence to antiretroviral therapy: a rapid systematic review. AIDS 2014; 28:S187–S204.
22. Chinn S. A simple method for converting an odds ratio to effect size for use in meta-analysis. Stat Med 2000; 19:3127–3131.
23. Cohen J. Statistical power analysis in the behavioral sciences. 2nd edHillsdale (NJ): Lawrence Erlbaum Associates; 1988.
24. Mikolajczak J, van Breukelen GJP, Kok G, Hospers HJ. Evaluating the effects of an online HIV-prevention intervention to promote HIV-testing among men who have sex with men (MSM). Appl Psychol 2008; 57:681–697.
25. Mustanski B, Garofalo R, Monahan C, Gratzer B, Andrews R. Feasibility, acceptability, and preliminary efficacy of an online HIV prevention program for diverse young men who have sex with men: the keep it up! Intervention. AIDS Behav 2013; 17:2999–3012.
26. Klein CH, Card JJ. Preliminary efficacy of a computer-delivered HIV prevention intervention for African American teenage females. AIDS Educ Prev 2011; 23:564–576.
27. Cortese J, Lustria LA. Can tailoring increase elaboration of health messages delivered via an adaptive educational site on adolescent sexual health and decision making?. J Am Soc for Inf Sci Technol 2012; 63:1567–1580.
28. Roberto AJ, Zimmerman RS, Carlyle KE, Abner EL. A computer-based approach to preventing pregnancy, STD, and HIV in rural adolescents. J Health Commun 2007; 12:53–76.
29. Chib AI, Lwin MO, Lee Z, Ng VW, Wong PHP. Learning AIDS in Singapore: examining the effectiveness of HIV/AIDS efficacy messages for adolescents using ICTs. Knowledge Manage E-Learning 2010; 2:169–187.
30. Bull SS, Lloyd L, Rietmeijer C, McFarlane M. Recruitment and retention of an online sample for an HIV prevention intervention targeting men who have sex with men: the Smart Sex Quest Project. AIDS Care 2004; 16:931–943.
31. Davidovich U, de Wit J, Stroebe W. Using the Internet to reduce risk of HIV-infection in steady relationships: A randomized controlled trial of a tailored intervention for gay men. In Liaisons dangereuses: HIV risk behavior prevention in steady gay relationships. Amsterdam: Roel & Uigeefprojecten. 2006:95–122.
32. Ybarra ML, Bull SS, Prescott TL, Korchmaros JD, Bangsberg DR, Kiwanuka JP, et al. Adolescent abstinence and unprotected sex in CyberSenga, an Internet-Based HIV Prevention Program: randomized clinical trial of efficacy. PLOS One 2013; 8:e70083.
33. Leiby K, Connor A, Tsague L, et al. The impact of SMS-based interventions on VMMC uptake in Lusaka province, Zambia: a randomized controlled trial. J Acquir Immune Defic Syndr 2016; 72: (Suppl 4): S264–S272.
34. Schonnesson LN, Bowen AM, Williams ML. Project SMART: preliminary results from a test of the efficacy of a Swedish internet-based HIV risk-reduction intervention for men who have sex with men. Arch Sex Behav 2016; 45:1501–1511.
35. Bauermeister JA, Pingel ES, Jadwin-Cakmak L, Harper GW, Horvath K, Weiss G, Dittus P. Acceptability and preliminary efficacy of a tailored online HIV/STI testing intervention for young men who have sex with men: the Get Connected! program. AIDS Behav 2015; 19:1860–1874.
36. Bull SS, Pratte K, Whitesell N, Rietmeijer C, McFarlane M. Effects of an internet-based intervention for HIV prevention: the Youthnet trials. AIDS Behav 2009; 13:474–487.
37. Calderon Y, Cowan E, Leu CS, Brusalis C, Rhee JY, Nickerson J, et al. A human immunodeficiency virus posttest video to increase condom use among adolescent emergency department patients. J Adolesc Health 2013; 53:79–84.
38. Christensen JL, Miller LC, Appleby PR, Corsbie-Massay C, Godoy CG, Marsella SC, Read SJ. Reducing shame in a game that predicts HIV risk reduction for young adult MSM: a randomized trial delivered nationally over the Web. J Int AIDS Soc 2013; 16: (Suppl 2): 18716.
39. Di Noia J, Schinke SP, Pena JB, Schwinn TM. Evaluation of a brief computer-mediated intervention to reduce HIV risk among early adolescent females. J Adolesc Health 2004; 35:62–64.
40. Evans AE, Edmundson-Drane EW, Harris KK. Computer-assisted instruction: an effective instructional method for HIV prevention education?. J Adolesc Health 2000; 26:244–251.
41. Fiellin LE, Hieftje KD, Pendergrass TM, Kyriakides TC, Duncan LR, Dziura JD, Sawyer BG. Video game intervention for sexual risk reduction in minority adolescents: randomized controlled trial. J Med Internet Res 2017; 19:e314.
42. Ito KE, Kalyanaraman S, Ford CA, Brown JD, Miller WC. Let's talk about sex’: pilot study of an interactive CD-ROM to prevent HIV/STIS in female adolescents. AIDS Educ Prevent 2008; 1:78–89.
43. Kiene SM, Barta WD. A brief individualized computer-delivered sexual risk reduction intervention increases HIV/AIDS preventive behavior. J Adolesc Health 2006; 39:404–410.
44. Marsch LA, Grabinski MJ, Bickel WK, Desrosiers A, Guarino H, Muehlbach B, et al. Computer-assisted HIV prevention for youth with substance use disorders. Subst Use Misuse 2011; (46):46–56.
45. Marsch LA, Guarino H, Grabinski MJ, Dillingham ET, Xie H, Crosier BS. Comparative effectiveness of web-based vs. educator-delivered HIV prevention for adolescent substance users: a randomized, controlled trial. J Subst Abuse Treat 2015; 59:30–37.
46. Bowen A, Horvath K, Williams M. A randomized control trial of Internet-delivered HIV prevention targeting rural MSM. Health Educ Res 2007; 22:120–127.
47. Carpenter KM, Stoner SA, Mikko AN, Dhanak LP, Parsons JT. Efficacy of a web-based intervention to reduce sexual risk in men who have sex with men. AIDS Behav 2010; 14:549–557.
48. Hightow-Weidman LB, Pike E, Fowler B, Matthews DM, Kibe J, McCoy R, Adimora AA. Feasibility and acceptability of delivering an internet intervention to young Black men who have sex with men. AIDS Care 2012; 24:910–920.
49. Milam J, Morris S, Jain S, Sun X, Dubé MP, Daar ES, et al. Randomized controlled trial of an internet application to reduce HIV transmission behavior among HIV infected men who have sex with men. AIDS Behav 2016; 20:1173–1181.
50. Read S, Miller L, Appleby P, Nwosu ME, Reynaldo S, Lauren A, Putcha A. Socially optimized learning in a virtual environment: reducing risky sexual behavior among men who have sex with men. Hum Comm Res 2006; 32:1–34.
51. Rosser BR, Oakes JM, Konstan J, Hooper S, Horvath KJ, Danilenko G, et al. Reducing HIV risk behavior of men who have sex with men through persuasive computing: results of the Men's INTernet Study-II. AIDS 2010; 24:2099–2107.
52. Gilbert P, Ciccarone D, Gansky Sa, Bangsberg DR, Clanon K, McPhee SJ, et al. Interactive ‘Video Doctor’ counseling reduces drug and sexual risk behaviors among HIV-positive patients in diverse outpatient settings. PLoS One 2008; 3:e1988.
53. Klein CH, Lomonaco CG, Pavlescak R, Card JJ. WiLLOW: reaching HIV-positive African-American women through a computer-delivered intervention. AIDS Behav 2013; 17:3013–3023.
54. Kurth AE, Spielberg F, Cleland CM, Lambdin B, Bangsberg DR, Frick PA, et al. Computerized counseling reduces HIV-1 viral load and sexual transmission risk: findings from a randomized controlled trial. J Acquir Immune Defic Syndr 2014; 65:611–620.
55. McKinstry LA, Zerbe A, Hanscom B, Farrior J, Kurth AE, Stanton J, et al. A randomized-controlled trial of computer-based prevention counseling for HIV-positive persons. J AIDS Clin Res 2017; 8:714.
56. Perry S, Fishman B, Jacobsberg L, Young J, Frances A. Effectiveness of psychoeducational interventions in reducing emotional distress after human immunodeficiency virus antibody testing. Arch Gen Psychiatry 1991; 48:143–147.
57. Billings DW, Leaf Sl Spencer J, Crenshaw T, Brockington S, Dalal RS. A randomized trial to evaluate the efficacy of a web-based HIV behavioral intervention for high-risk African American women. AIDS Behav 2015; 19:1263–1274.
58. Davidovich U, Uhr-Dall H. Reducing sexual risk behaviour among youth: the development and effect evaluation of an interactive online intervention for individuals and their sexual network. Sex Transm Infect 2011; 87: (Suppl 1): A58.
59. Downs JS, Murray PJ, Bruine de BW, Penrose J, Palmgren C, Fischhoff B. Interactive video behavioral intervention to reduce adolescent females’ STD risk: a randomized controlled trial. Soc Sci Med 2004; 59:1561–1572.
60. Jenkins PR, Jenkins RA, Nannis ED, McKee KT Jr, Temoshok LR. Reducing risk of sexually transmitted disease (STD) and human immunodeficiency virus infection in a military STD clinic: evaluation of a randomized preventive intervention trial. Clin Infect Dis 2000; 30:730–735.
61. Merchant RC, Clark MA, Langan TJ, Mayer KH, Seage GR III, DeGruttola VG. Can computer-based feedback improve emergency department patient uptake of rapid HIV screening?. Ann Emerg Med 2011; 58: (1 Suppl 1): S114.e1–S119.e2.
62. Festinger DS, Dugosh Kl, Kurth Ae, Metzger DS. Examining the efficacy of a computer facilitated HIV prevention tool in drug court. Drug Alcohol Depend 2016; 162:44–50.
63. Gilbert LK, Temby JR, Rogers SE. Evaluating a teen STD prevention web site. J Adolesc Health 2005; 37:236–242.
64. Mikolajczak J, van Breukelen GJP, Kok G, Hospers HJ. Evaluating the effects of an online HIV-prevention intervention to promote HIV-testing among men who have sex with men. Netherlands J Psychol 2012; 67:21–35.
65. Daher J, Vijh R, Linthwaite B, Dave S, Kim J, Dheda K. Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996-2017). BMJ Open 2017; 7:e017604.
66. Asiimwe C, Gelvin D, Lee E, Ben Amor Y, Quinto E, Katureebe C. Use of an innovative, affordable, and open-source short message service-based tool to monitor malaria in remote areas of Uganda. Am J Trop Med Hyg 2011; 85:26–33.
67. Estcourt CS, Gibbs J, Sutcliffe LJ, Gkatzidou V, Tickle L, Hone K, Aicken C, et al. The eSexual Health Clinic system for management,prevention, and control of sexually transmitted infections: exploratory studies in people testing for Chlamydia trachomatis. Lancet Public Health 2017; 2:182–190.
68. Baraitser P, Holdsworth G, Joia DS, Free C. Technology for patient-centred innovation - a mixed method evaluation in sexual health. Int J Qual Healthcare 2017; 29: (Suppl_1): 54.
Keywords:

behavior change; digital health; eHealth; HIV; meta-analysis; sexually transmitted infection; systematic review

Supplemental Digital Content

Copyright © 2020 The Author(s). Published by Wolters Kluwer Health, Inc.