Share this article on:

The Meanings in the messages: how SMS reminders and real-time adherence monitoring improve antiretroviral therapy adherence in rural Uganda

Ware, Norma C.; Pisarski, Emily E.; Tam, Melanie; Wyatt, Monique A.; Atukunda, Esther; Musiimenta, Angella; Bangsberg, David R.; Haberer, Jessica E.

doi: 10.1097/QAD.0000000000001035
Epidemiology and Social

Objective: To understand how a pilot intervention combining SMS reminders with real-time adherence monitoring improved adherence to HIV antiretroviral therapy (ART) for adults initiating treatment in rural Uganda.

Design: Qualitative study, conducted with a pilot randomized controlled trial.

Methods: Sixty-two pilot intervention study participants took part in qualitative interviews on: preferences for content; frequency and timing of SMS adherence reminders; understandings and experiences of SMS reminders; and understandings and experiences of real-time adherence monitoring. Analysis of interview data was inductive and derived categories describing how participants experienced the intervention, and what it meant to them.

Results: SMS reminders prompted taking individual doses of antiretroviral therapy, and helped to develop a ‘habit’ of adherence. Real-time adherence monitoring was experienced as ‘being seen’; participants interpreted ‘being seen’ as an opportunity to demonstrate seriousness of commitment to treatment and ‘taking responsibility’ for adherence. Both SMS reminders and real-time monitoring were interpreted as signs of ‘caring’ by the healthcare system. Feeling ‘cared about’ offset depressed mood and invigorated adherence.

Conclusion: Although serving as reminders, SMS messages and real-time adherence monitoring also had larger emotional and moral meanings for participants that they felt improved their adherence. Understanding the larger ‘meanings in the messages,’ as well as their more literal content and function, will be central in delineating how SMS reminders and other adherence interventions using cellular technology work or do not work in varying contexts.

aDepartment of Global Health and Social Medicine, Harvard Medical School

bDivision of Global Health Equity, Department of Medicine, Brigham & Women's Hospital, Boston, Massachusetts, USA

cMbarara University of Science and Technology, Mbarara, Uganda

dCenter for Global Health, Massachusetts General Hospital

eDepartment of Medicine, Harvard Medical School, Boston, Massachusetts, USA.

Correspondence to Norma C. Ware, Department of Global Health and Social Medicine, Harvard Medical School, 641 Huntington Ave, Boston, MA 02115, USA. Tel: +1 617 432 2554; e-mail: norma_ware@hms.harvard.edu

Received 4 November, 2015

Revised 22 December, 2015

Accepted 4 January, 2016

This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License, where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially. http://creativecommons.org/licenses/by-nc-nd/4.0

Back to Top | Article Outline

Introduction

Cellular technology is widely used globally and offers promising opportunities for improving HIV antiretroviral therapy (ART) adherence and clinical outcomes. Mobile phones allow healthcare providers to communicate with patients remotely, thus reducing the need for costly and time-consuming travel to clinical sites. SMS text messaging is a concise and inexpensive form of patient communication using mobile phones.

Wireless electronic adherence monitoring devices store medications and transmit records of device openings via a cellular network. These devices provide detailed, real-time information on dosing with ART, making it possible to intervene promptly to attempt to close adherence gaps before viral rebound and subsequent drug resistance can develop [1].

A number of randomized trials have examined the impact of cellular communications on ART adherence in low- and middle-income countries. Intervention designs and adherence measurement approaches have varied substantially. Weekly and twice-weekly text message reminders have been shown to increase adherence in Kenya and Nigeria [2–4]; however, no benefit was seen with daily text messages [3] in Kenya or in other studies carried out in India, Cameroon, and Brazil [5–7]. Two trials have combined text message reminders with real-time electronic monitoring of adherence. Benefit in overall adherence was seen in one study, conducted in China [8], but not in the other, from South Africa [9]. However, a decrease in the number of sustained treatment interruptions was observed in the South African study. Acceptability and feasibility of both text messaging and real-time adherence monitoring have generally been high [6,10–13], although concerns about the monitoring devices’ potential for infringing upon patient privacy have been raised in some settings [6,8,12].

To improve these interventions for more consistently positive results, it is important to understand how they work [14]. The importance of understanding the mechanisms through which complex health interventions produce change is increasingly being recognized [15–18], as is the value of qualitative research in contributing to this process [19–22]. Understanding mechanisms includes explicating the pathways through which intervention components lead to outcomes (‘what works’), and characterizing particular populations or groups that stand to benefit especially from an intervention (‘for whom/under what circumstances’). Understanding the mechanisms through which interventions based on SMS reminders and real-time monitoring impact adherence will inform both the design of future research and the integration of cellular technologies into clinical practice in settings of resource scarcity.

This article reports findings from an adherence intervention development study. The study used a pilot randomized controlled trial (RCT) design to investigate the effects of multiple types of SMS reminders combined with real-time adherence monitoring on ART adherence. All study participants were given a real-time adherence monitor and were randomized (1 : 1 : 1) to receive ‘scheduled’ SMS reminders (daily, weekly), reminders ‘triggered’ by a missed dose, or no SMS (a control group). A qualitative component examined participant experiences of intervention components.

Quantitative RCT results are reported in a companion report [23]. Here, we draw upon the qualitative data to address the question, ‘how did the pilot intervention work?’

Back to Top | Article Outline

Methods

Setting

The study took place between September 2013 and June 2015 at the Mbarara Regional Referral Hospital (MRRH), Mbarara, in rural southwestern Uganda. Study participants were not less than 18 years old, initiating ART, and living below 20 km of MRRH; all had access to a personal cell phone with reliable reception.

Back to Top | Article Outline

Qualitative research methodology

Procedures used to collect and analyze qualitative data are described below. Information on intervention design may be found in the companion report [23].

Back to Top | Article Outline

Qualitative data collection

Sixty-three individuals were identified as eligible for the RCT. One was subsequently determined to be HIV-negative and not included in the qualitative research. Qualitative data collection consisted of individual open-ended interviews. Interviews elicited information on: preferences for content; frequency and timing of SMS adherence reminders; understandings and experiences of SMS reminders; and understandings and experiences of real-time adherence monitoring.

Qualitative interviews took place at study follow-up Month 3 and after the first subsequent 48-h treatment interruption. Participants with no subsequent interruptions were interviewed at the end of the 9-month study follow-up period. One-hundred and one qualitative interviews were completed with 62 participants. Forty-one of the 101 interviews were completed at Month 3, 30 following treatment interruptions, and 30 at study exit.

Interviews were conducted in private settings in the local language (Runyankole) by Ugandan research assistants trained in qualitative data collection techniques and were audio-recorded. Immediately following each interview, research assistants summarized interview content in English as a ‘debrief.’ A complete English transcription was then produced from the audio recording by the research assistant who had conducted the interview. Transcripts were continuously reviewed by author E.P. for quality, including clarity, detail, English grammar and style, and formatting.

Back to Top | Article Outline

Qualitative data analysis

Analysis of interview data was inductive and used a content analytic approach [24–26]. The goal was to derive categories describing how participants experienced and interpreted the intervention, as an approach to understanding ‘how the intervention worked.’ The analysis unfolded in steps. First, authors N.W., E.P., M.T., M.W. and J.H. reviewed and discussed 10 transcripts to identify relevant content. Identified content was used to assemble a codebook. This process was iterative and involved developing labels to represent content, writing operational definitions, and selecting illustrative quotes. Following completion of the codebook, interviews were coded by authors E.P. and M.T. using ATLAS, ti software.

Coded data were used to develop categories corresponding to key aspects of participant experiences. Authors N.W., E.P., M.T. and M.W contributed to the category development process. Category development began with repeated reviews of coded data to populate one a-priori category (SMS reminder preferences), and to identify emergent themes. Subsequent steps included specifying labels, organizing and writing descriptions of category content, and supplying evidence from the data in the form of illustrative quotes from interviewees. These steps produced initial versions of the categories, which were then reviewed and revised to improve clarity and add detail. The categories are presented as Results, below.

Back to Top | Article Outline

Institutional approvals

This study was approved by the Partners Human Research Committee, Partners Healthcare, Boston, MA; the Mbarara University of Science and Technology Institutional Review Committee, Mbarara, Uganda; and the Uganda National Council for Science and Technology, Kampala, Uganda.

Back to Top | Article Outline

Results

Participant characteristics are shown in Table 1. The majority of study participants were female and in their early 30 s. Median CD4+ cell count was 309 cells/μl (interquartile range 231–397). Nearly all were literate. Almost half scored as depressed on a locally validated, self-report measure [27].

Table 1

Table 1

Categories resulting from analysis of qualitative data are presented in two sections, below, entitled ‘preferences for SMS reminders,’ and ‘meanings and experiences of intervention components’.

Back to Top | Article Outline

Participant preferences for SMS reminders

Content of SMS reminders was determined individually by study participants, who were asked to select a word or phrase that would help them remember to take their medication. A default message – ‘This is your reminder’ – was offered. For scheduled reminders, participants also chose the time of day messages would be sent.

Almost half (44%) of participants chose the default message. Twenty percent chose messages that explicitly included reminder words or phrases (e.g. ‘Have you taken your pills?’). The remaining choices were neutral with respect to reminder content (e.g. ‘How has your day been?’). Twenty percent of selected messages were in English; the remainder were in the local language (Runyankole).

Participants in one RCT study arm received scheduled daily, scheduled weekly, and triggered reminders over the 9-month follow-up period. Of the three, scheduled daily messages were preferred. Because they were sent every day, usually around dosing time, participants felt these messages reduced chances of missing doses.

‘[Daily messages] were the best. They would remind me every day and I could not forget. But for the weekly ones that come only one day in the week, you need to keep reminding yourself because there is nothing to remind you. You have to keep watching the time. The daily ones are more helpful.’

--Female, Age 29, Month 3 interview

‘Triggered’ messages, in contrast, raised concerns about taking pills late. For example, triggered messages were sometimes received at inconvenient times. Participants with evening dosing times might be asleep when a triggered message arrived. This meant they would only see the reminder the next day, when they felt it was too late to take the dose.

[Messages] ‘that come much later [than dosing time] are not helpful. We sleep early and you cannot easily see those messages. Someone can call you at night and you do not hear the call, let alone the message.’

--Male, Age 25, Treatment interruption interview

‘I think receiving the message 1 or 2 h after the time I am supposed to take my medicine is not very good. I [try] never to miss taking my medicine but when I forget, there is a delay in receiving the message reminder.’

--Male, Age 36, Month 3 interview

The timing of scheduled messages was also important to participants. When choosing message times, some preferred to receive scheduled messages shortly before the intended dosing time to allow them time to prepare to take the medication (e.g. finish up their work and go home, obtain water and/or food to take with the medication). Others preferred to receive the messages at the exact time of dosing so they could take the pills immediately upon message receipt.

Back to Top | Article Outline

Meanings and experiences of intervention components

Three themes emerged from the qualitative data analysis that address meanings and experiences of intervention components for participants, and the intervention's mechanism of effect. The themes are presented below as categories entitled, ‘reminding and a “habit” of adherence,’ ‘“being seen adhering”: an opportunity to demonstrate commitment to treatment,’ and ‘feeling cared about by the clinic.’

Back to Top | Article Outline

Reminding and a habit of adherence

Participants found adherence to daily doses of ART challenging at the start of treatment. Variation in daily schedules made it difficult to remember to take pills at the same time every day. When participants received a reminder, they made efforts to take their medication immediately. Thus, the reminders served to prompt individual doses.

Daily messages helped to develop ‘a habit’ of good adherence. Regular, frequent reminders early in treatment helped participants grow accustomed to taking pills at the same time every day. Eventually, they came to depend less on the reminders, remembering without prompting to take their pills when daily reminders ceased.

‘…for something you have not been doing, starting it can be a problem and you can easily forget. But as I had those messages, they trained me to take the medicine well. They would come every day and so I learned that behavior of keeping time. I used to make sure I had battery on my phone so that I didn’t miss the message. And even when they stopped coming every day, I got used and continued to take them at the same time.’

--Female, Age 40, Month 3 interview

The monitoring device also served a reminder function. It was often kept in a location where it was seen every day. Seeing the device helped participants remember their medication dose. Specific features of the device also contributed. For example, a light blinks each time the device is opened and a signal is sent. Participants became used to seeing the light blink every day. On any given day, the realization that they ‘hadn’t seen the light,’ became a reminder that they hadn’t yet taken their ART.

‘I know that every night at 10 : 00 pm, I am supposed to be opening that device. It blinks every time I open it. So I am now used to it blinking every day because I take my medicines every day. When I do not see the blinking in my memory, this becomes a reminder that I have not taken my medicines.’

--Male, Age 36, Month 3 interview

Being reminded through the receipt of SMS messages and use of the monitoring device motivated adherence.

Back to Top | Article Outline

Being seen adhering: an opportunity to demonstrate commitment to treatment

Participants understood that missed doses could be detected when the monitoring device was not opened at dosing time. They envisioned someone at the clinic sitting at a computer, receiving the signal in person. In other words, participants felt they were ‘being seen adhering,’ and that whenever they missed a medication dose, others ‘would know.’ One participant commented:

‘You people are always there on your computers to see if I have swallowed [the medicine] or not.’

--Male, Age 50, Month 3 interview

‘Being seen’ meant to participants that the clinic was taking a significant interest in their well being. Having the attention of the clinic in this way was construed as an opportunity – a chance to demonstrate competence by using the device correctly, and to communicate the seriousness of one's commitment to treatment.

[With the monitoring device] ‘you people see that I open my bottle to take medicine and that I try to charge it. Then I am sure you know that I was able to get whatever you taught me to do and I am doing it without fail. It makes me happy that I am doing what I am supposed to be doing.’

--Male, Age 44, Month 3 interview

Participants spoke of this as ‘taking responsibility’.

‘I take the responsibility on myself to make sure the people who gave me the device see me opening the device….’

--Male, Age 36, Month 3 interview

‘Being seen’ exerted pressure on participants. The sense of being accountable for their use of ART, already present, was intensified by real-time monitoring. Participants experienced being monitored as removing all possibility of missing doses; they felt they had no choice but to take the medication every day. Increased accountability and the desire to demonstrate ‘taking responsibility’ worked to promote adherence, as the following citation demonstrates:

‘I do not mind because I think it is good for me; I can take my medicine well knowing that I am being watched. When someone is waiting to see if you are taking your medicine, it means that they care and you should also have the responsibility to take your medicine well.’

--Male, Age 29, End of follow-up period

Back to Top | Article Outline

Feeling ‘cared about’ by the clinic

Many study participants elected to test for HIV because they felt ill. A decline in health, compounded by an HIV diagnosis, left them feeling demoralized and hopeless – expecting imminent death. Fearing discrimination, participants also often chose to hide their status from others, adding isolation to demoralization and hopelessness. Thus an HIV diagnosis led to feelings of depression.

SMS reminders and real-time adherence monitoring worked to counter these feelings, as they were interpreted as signs of caring on the part of the health system. To participants, reminders and monitoring meant that healthcare providers were investing time and effort in improving the adherence of each individual patient. This signified to participants, ‘they care about me.’

‘…I was still at my business working and I received an SMS. I read it and became happy and told myself, “These people remember me. They care about me.’

--Female, Age 36, Month 3 interview

Feeling cared about offset depressed mood. Participants described being encouraged and ‘strengthened’ as a result of feeling they were ‘cared about.’ From this came increased confidence and determination to cope constructively with HIV infection. Good adherence was seen as central to constructive coping. In the perceived caring of providers, participants found enthusiasm and energy for adherence.

‘Every time I receive this message I feel encouraged to continue taking my medicine. Knowing that there are people who care about my health.’

--Female, Age 27, Month 3 interview

‘The SMS reminders strengthen one personally. They help me to remember the time to swallow and also to be hopeful.’

--Male, Age 46, Month 3 interview

Back to Top | Article Outline

Discussion

This qualitative analysis addressed the question: How does a pilot intervention combining SMS reminders with real-time adherence monitoring work for adults initiating ART in rural Uganda? Results reveal SMSs not only prompt individual doses, but also help to develop a ‘habit’ of adherence (scheduled daily reminders). The intervention also had larger moral and emotional meanings for participants, which themselves had relevance for adherence. ‘Being seen adhering’ represented an opportunity to demonstrate seriousness of commitment to treatment and ‘taking responsibility’ for adherence. Feeling ‘cared about’ countered feelings of depression and invigorated the adherence process (See Fig. 1).

Fig. 1

Fig. 1

Part of delineating an intervention's mechanism of effect is to determine whether individual components make distinct contributions to the intended outcome, and if so, what those contributions are [15]. The qualitative data collected for this study indicate participant experiences of SMS reminders and real-time adherence monitoring were more similar than different. Both served as reminders to take medication daily. Both contributed to feeling ‘cared about.’ Thus both represented forms of support for study participants. ‘Being seen’ was associated more with monitoring than with reminders. Overall, however, distinct contributions from SMS reminders and real-time adherence monitoring were not evident in the qualitative data.

The qualitative data point to two patient populations especially likely to benefit from SMS reminder interventions. One is individuals beginning ART. In this study, participants receiving daily reminders found them helpful in developing a habit of adherence. A second population is individuals who respond to an HIV diagnosis with persisting feelings of sadness, discouragement, and/or isolation. Our qualitative data show clearly that regular text messages were construed as indications of ‘caring’ by the health system, and that patients felt encouraged and energized as a result. In countering feelings of depression following HIV diagnosis, SMS reminders may mitigate the impact of depression on adherence. Other studies referencing patient experiences of receiving SMS reminders for ART adherence support also characterize the messages as communicating that ‘someone cares’ [7,28].

In principle, linking SMS reminders to treatment interruptions identified in real-time allows immediate intervention to restore adherence, before viral rebound and drug resistance can develop. This can only take place, however, if reminders sent ‘promptly’ are also promptly received, and acted upon. Our qualitative data make it clear this is not always the case. Reminders sent in response to doses missed on an evening dosing schedule, for example, may come after an individual has retired for the night. These reminders will likely be seen only the next morning, if at all. Additional information on the pitfalls of translating real-time adherence intervention principles into practice will be important for maximizing effectiveness of these interventions moving forward.

Electronic adherence monitoring raises ethical questions, among them whether the ‘omnipresent gaze’ of providers (and/or researchers) imposes unduly on patient autonomy [29]. Clearly, participants in this study felt the ‘omnipresent gaze,’ and they did experience this as pressure to adhere. However, both the gaze and the resulting pressure were interpreted positively, as indications of caring and support.

It has been argued that ‘the potential of mobile health is much greater than just reminders’ [30]. These qualitative data make it clear that reminders themselves can be more than ‘just reminders.’ When selecting message content, most participants selected phrases aimed explicitly at ‘reminding.’ When they actually received the messages, however, they felt not just reminded, but ‘cared about.’

The feeling that ‘someone cares’ has also been reported for WelTel Kenya 1, an early RCT investigating the impact of SMS reminders on adherence [2,28]. Unlike this study, WelTel Kenya1 required recipients to respond to SMS messages, establishing two-way communication with clinicians. Reports of problems or failure to respond triggered a follow-up call. The result was ‘frequent communication’ between clinicians and patients, which was experienced as a form of support [28]. In this study, participants felt ‘cared about’ even though the intervention did not require or allow for responses to SMSs, suggesting two-way mobile phone communication with healthcare providers outside clinic visits may not be necessary for patients to feel connected to care.

The following limitations of this study should be noted. As a pilot study, the research is limited in scope, with a small sample drawn from a single treatment site. Although the qualitative data support a number of observations that shed light on the meaning of text-based, mobile phone adherence interventions, our analysis stops short of completely characterizing their mechanism of effect. Still, data from participants in multiple study arms allow core functions of the intervention to be identified.

The possibility that qualitative interview content may have been subject to social desirability bias must also be acknowledged. Finally, the pilot study's relatively short (9-month) follow-up period precludes inferences about the impact of the text message interventions over life-long antiretroviral treatment.

Understanding how adults initiating ART in resource-scarce settings experience SMS reminders and real-time adherence monitoring is essential to understanding the ways in which these interventions impact adherence behavior. Qualitative data suggest they do not function simply as reminders, but have larger moral and emotional meanings that themselves affect adherence. Understanding the larger ‘meanings in the messages,’ as well as their more literal content and function, will be central in delineating how SMS reminders and other adherence interventions making use of cellular technologies work. These lessons are critical for designing future studies, and for understanding how this technology can be applied to clinical care.

Back to Top | Article Outline

Acknowledgements

We thank the participants in this study, who contributed their time and effort to make the work possible. Contributions by Moran Owembabazi, Moonlight Sheila, Judith Namanya, and Justus Ashaba are also gratefully acknowledged by the authors.

Contributions of the authors: authors J.H., N.W. and M.W. designed the qualitative study. A.M., E.A. and E.P. supervised collection of the qualitative data. N.W., E.P. and M.T. analyzed the qualitative data and drafted the manuscript. J.H., D.B. and M.W. reviewed the draft and suggested revisions. N.W., E.P. and M.T. revised the manuscript. All authors reviewed and approved the final version.

Funding and financial conflicts: financial support for the research was provided by a grant from the US National Institute of Mental Health to J.E.H. (R34MH100940).

Back to Top | Article Outline

Conflicts of interest

There are no conflicts of interest.

Back to Top | Article Outline

References

1. Bangsberg DR. Preventing HIV antiretroviral resistance through better monitoring of treatment adherence. J Infect Dis 2008; 197 (Suppl 3):S272–S278.
2. Lester R, Ritvo P, Mills EJ, Kariri A, Karanja S, Chung MH, et al. Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTelKenya1): a randomised trial. Lancet 2010; 376:1838–1845.
3. Pop-Eleches C, Thirumurthy H, Habyarimana JP, Zivin JG, Goldstein MP, de Walque D, et al. Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS 2011; 25:825–834.
4. Maduka O, Tobin-West CI. Adherence counseling and reminder text messages improve uptake of antiretroviral therapy in a tertiary hospital in Nigeria. Niger J Clin Pract 2013; 16:302–308.
5. Shet A, De Costa A, Kumarasamy N, Rodrigues R, Rewari BB, Ashorn P, et al. Effect of mobile telephone reminders on treatment outcome in HIV: evidence from a randomised controlled trial in India. BMJ 2014; 349:g5978.
6. Mbuagbaw L, Thabane L, Ongolo-Zogo P, Lester RT, Mills EJ, Smieja M, et al. The Cameroon Mobile Phone SMS (CAMPS) trial: a randomized trial of text messaging versus usual care for adherence to antiretroviral therapy. PLoS One 2012; 7:e46909.
7. da Costa TM, Barbosa BJ, Gomes e Costa DA, Sigulem D, de Fatima Marin H, Filho AC, et al. Results of a randomized controlled trial to assess the effects of a mobile SMS-based intervention on treatment adherence in HIV/AIDS-infected Brazilian women and impressions and satisfaction with respect to incoming messages. Int J Med Inform 2012; 81:257–269.
8. Sabin LL, Bachman DeSilva M, Gill CJ, Zhong L, Vian T, Xie W, et al. Improving adherence to antiretroviral therapy with triggered real-time text message reminders: the China adherence through technology study. J Acquir Immune Defic Syndr 2015; 69:551–559.
9. Orrell C, Cohen K, Mauff K, Bangsberg DR, Maartens G, Wood R. A randomised controlled trial of real-time electronic adherence monitoring with text message dosing reminders in people starting first-line antiretroviral therapy. J Acquir Immune Defic Syndr 2015; 70:495–502.
10. Haberer JE, Kahane J, Kigozi I, Emenyonu N, Hunt P, Martin J, et al. Real-time adherence monitoring for HIV antiretrovial therapy. AIDS Behav 2010; 14:1340–1346.
11. Haberer JE, Kiwanuka J, Nansera D, Muzoora C, Hunt PW, So J, et al. Realtime adherence monitoring of antiretroviral therapy among HIV-infected adults and children in rural Uganda. AIDS 2013; 27:2166–2168.
12. Reid MJ, Dhar SI, Cary M, Liang P, Thompson J, Gabaitiri L, et al. Opinions and attitudes of participants in a randomized controlled trial examining the efficacy of SMS reminders to enhance antiretroviral adherence: a cross-sectional survey. J Acquir Immune Defic Syndr 2014; 65:e86–e88.
13. Kinyua F, Kiptoo M, Kikuvi G, Mutai J, Meyers AF, Muiruri P, et al. Perceptions of HIV infected patients on the use of cell phone as a tool to support their antiretroviral adherence; a cross-sectional study in a large referral hospital in Kenya. BMC Public Health 2013; 13:987.
14. Pawson R, Tilley N. Realistic evaluation. London: Sage; 1997.
15. Bonell C, Fletcher A, Morton M, Lorenc T, Moore L. Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med 2012; 75:2299–2306.
16. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ 2015; 350:h1258.
17. Alexander JA, Hearld LR. Methods and metrics challenges of delivery-system research. Implement Sci 2012; 7:15.
18. Kane SS, Gerretsen B, Scherpbier R, Dal Poz M, Dieleman M. A realist synthesis of randomised control trials involving use of community health workers for delivering child health interventions in low and middle income countries. BMC Health Serv Res 2010; 10:286.
19. Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ 2009; 339:b3946.
20. Glenton C, Lewin S, Scheel IB. Still too little qualitative research to shed light on results from reviews of effectiveness trials: A case study of a Cochrane review on the use of lay health workers. Implement Sci 2011; 6:53.
21. Berwick DM. The stories beneath. Med Care 2007; 45:1123–1125.
22. English M, Nzinga J, Mbindyo P, Ayieko P, Irimu G, Mbaabu L. Explaining the effects of a multifaceted intervention to improve inpatient care in rural Kenyan hospitals -- interpretation based on retrospective examination of data from participant observation, quantitative, and qualitative studies. Implement Sci 2011; 6:124.
23. Haberer JE, Musiimenta A, Atukunda EC, Musinguzi N, Wyatt MA, Ware NC, et al. Short message service (SMS) reminders and real-time adherence monitoring improve antiretroviral therapy adherence in rural Uganda. AIDS 2016; 30:1295–1299.
24. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005; 15:1277–1288.
25. Elo S, Kynga H. The qualitative content analysis process. J Adv Nurs 2008; 62:107–115.
26. Patton MQ. Qualitative research and evaluation methods. 3rd edThousand Oaks, CA: Sage Publications; 2002.
27. Bolton P, Wilk C, Ndogoni L. Assessment of depression prevalence in rural Uganda using symptom and function criteria. Soc Psychiatry Pschiatr Epidemiol 2004; 39:442–527.
28. van der Kop ML, Karanja S, Thabane L, Marra C, Chung MH, Gelmon L, et al. In-depth analysis of patient-clinician cell phone communication during the WelTel Kenya1 antiretroviral adherence trial. PLoS One 2012; 7:e46033.
29. Campbell JI, Eyal N, Musiimenta A, Haberer JE. Ethical Questions in Medical Electronic Adherence Monitoring. J Gen Intern Med 2015; pp. 1–8. Epub.
30. Lester RT. Ask, don’t tell-mobile phones to improve HIV care. N Engl J Med 2013; 369:1867–1868.
Keywords:

antiretroviral therapy; mechanisms of effect; real-time adherence monitoring; SMS

Copyright © 2016 Wolters Kluwer Health, Inc.