CIN: Computers, Informatics, Nursing:
Chronic Health Conditions and Internet Behavioral Interventions: A Review of Factors to Enhance User Engagement
SCHUBART, JANE R. PhD, MS, MBA; STUCKEY, HEATHER L. DEd, MA; GANESHAMOORTHY, AMBIKA BS; SCIAMANNA, CHRISTOPHER N. MD, MPH
Author Affiliation: Departments of Surgery (Dr Schubart), Public Health Sciences (Dr Schubart, Dr Sciamanna), and Internal Medicine, Division of General Internal Medicine (Dr Schubart, Dr Stuckey, Dr Sciamanna), The Pennsylvania State University, College of Medicine, Hershey (Ms Ganeshamoorthy).
None of the authors have any conflict of interest pertaining to this article.
Corresponding author: Jane R. Schubart, PhD, MS, MBA, Department of Surgery, Penn State College of Medicine, 500 University Dr, H163, Hershey, PA 17033 (firstname.lastname@example.org).
The objective of this study was to review the evidence about what factors influence user engagement in Internet-based behavioral interventions for chronic illness. We conducted a systematic review of the recent published literature. Searches of MEDLINE (using Ovid and PubMed), The Cochrane Library, and PsycINFO, from January 2000 to December 2008, were completed. Additional articles were identified from searching the bibliographies of retrieved articles. We identified studies of interactive health communication interventions delivered via the Internet that, apart from delivering health information, had another component such as interactive tools to manage illness, decision support for treatment, or social support. We restricted the age range to adulthood. The search identified 186 abstracts; 46 articles were reviewed. We used a qualitative approach called "positive deviance" to study those interventions that have succeeded in engaging users where most have failed. Some ways to improve user engagement in Internet interventions suggested by our review include addressing health concerns that are important and relevant to an individual patient or consumer and an individualized approach, such as personally tailored advice and feedback. Interventions that are part of larger health management programs that include clinicians appear to be especially promising.
The Internet provides unprecedented opportunities for patients and consumers to be proactive in their own healthcare. In 2008, 74% of all American adults went online, and 61% looked online for health information.1 Of these, 60% reported that their most recent search had an impact on their own health or the way they care for someone else, 38% reported that the information changed the way they cope with a chronic condition or manage pain, and 49% said the information changed the way they think about diet, exercise, or stress management. The Internet provides timely access to relevant information and the ability to communicate with both providers and peers. It is especially promising for people living with chronic health conditions and coping with challenges that often include social isolation, burdensome care routines, and anxiety about the future. However, with the rapidity of technological advances, keeping pace with the proliferation of new interventions is difficult, and published reviews are quickly outdated.
One such review, published in 2002, observed that Internet-based intervention studies generally lacked methodological quality and thus did not provide evidence of the effects of the interventions on health outcomes.2 A review by Nguyen et al3 reported that Internet-based educational interventions moderately improved health outcomes for diverse clinical populations and that user satisfaction has generally been positive. Wantland et al4 conducted a meta-analysis (20 studies from 1996 to 2003) of self-care interventions for chronic illness and found broad variability in study designs and outcomes measured. Only five studies reported usage statistics, and these varied widely. In this meta-analysis, Web-based interventions did show improved outcomes compared with non-Web. In a more recent review, Carlbring and Andersson5 found that the Internet was a promising way to deliver psychological treatment, particularly cognitive behavior therapy.
Because the published literature reviews to date did not answer our questions about which factors influence user engagement, we reviewed the current literature on interactive Internet-based interventions for chronic illness self-management to investigate user engagement.
Our goal was to provide an overview of the characteristics of Internet behavioral interventions for chronic conditions that influence user engagement. We were interested in understanding what features or components (eg, instructional videos, personal stories, e-mail support, tailored feedback, etc) are most effective in encouraging users to log in and to continue to use the intervention for the amount of time needed to produce the desired health behavior change.
Many terms have been used to describe activities conducted over the Internet for physical and mental health purposes (eg, eHealth, e-interventions, computer-mediated intervention, Web-based therapy, cybertherapy, etc).6 The field of Internet-supported interventions is expanding rapidly, and typical of a pioneering field, there are not yet accepted standards or consistent terminology used.7-10 This section provides the definitions that we have adopted for our study.
Adherence refers to using an Internet program as prescribed. Not using a program as prescribed typically reflects a decreased treatment dose and thus suboptimal treatment.11
Attrition refers to dropping out of the study before completion or stopping use of the Internet program. To understand the determinants of attrition, the characteristics of any subpopulations should be assessed to determine who continues to use the program. To answer the question of what works and what does not, attrition measures are important. For example, in cases of high dropout rates, efficacy measures alone will underestimate the impact of an application on a population who continues to use it.12
Interventions (Internet or Web) refer to Internet-based prevention and treatment programs. These are typically based on effective and empirically validated face-to-face behavioral interventions. Internet interventions go beyond education and information-only Web sites. They address behavioral skills, offer opportunities for practice and mastery, and provide feedback and reinforcement, leading to behavior change, symptom improvement, and improved health-related quality of life. Internet interventions are generally personalized and tailored to the user; highly structured; semiguided to fully guided; interactive; and enhanced by graphics, animations, audio, and video.11
An effective intervention is defined as one that produces the desired outcome or effect.
Engagement: User engagement refers to how the participant interacts with the Web program. This interaction may be a simple action (eg, a mouse click) to move to another screen, or more complex tasks such as completing a quiz or entering diary information. Engagement also includes how long or how often the participant uses the Web program. There is growing evidence that program usage is often less than the developers envisioned.12 Engagement is difficult to measure, and although it is often possible to analyze server data measures such as number of log-ins, time spent, or number of pages viewed, this information is often difficult to interpret. For example, a Web intervention may require users to work through the material in a specified order (no skipping), yet some users thoroughly read the information, whereas others skim, thus creating different levels of engagement.
Positive deviance refers to a qualitative approach to problem solving that examines the practices of individuals who have succeeded where others have failed. Positive deviance is based on the observation that in every community there are certain individuals or groups whose uncommon behaviors and strategies enable them to find better solutions to problems than their peers, while having access to the same resources and facing similar or worse challenges. This approach has emerged over the past 20 years to solve particularly complicated problems by studying the strategies used by companies, communities, and individuals who have succeeded where their peers have been unsuccessful. This method has been widely applied to other industries and is only recently being applied to healthcare.13-16
Marsh and colleagues13 have described three distinct steps in positive deviance: (1) identify "positive deviants," defined as individuals, units, or organizations that have had an unusual degree of success; (2) study these positive deviants using qualitative methods (interviews and observation) to identify the practices they use; and (3) compare practices between those who are more and those who are less successful to understand which practices are the most likely to be effective. For example, Bradley and colleagues17,18 have used positive deviance to improve the care of patients with a myocardial infarction. Qualitative interviews and observations with a range of individuals from 11 hospitals identified 28 specific practices that successful hospitals used to reduce the time to treat patients with a myocardial infarction. The use of these practices was then compared between 365 hospitals of varying performance, and only 10 of the 28 practices were associated with success.17 The results, published in the New England Journal of Medicine in 2006, have been used to identify a smaller number of practices that are now the focus of interventions to improve myocardial infarction care.17
Web site or Web program includes the content (the actual treatment information), how that content is displayed (appearance, organization), and how that content is delivered (simple text, graphics, illustrations, video, audio, animations, etc).
Searches of MEDLINE (using Ovid and PubMed MeSH), PsycINFO, and the Cochrane Library from 2000 to 2008 were completed to identify relevant studies. We used the keywords "Internet" and "chronic disease" in the search strategy, as these were the terms identified in PubMed MeSH, the US National Library of Medicine's controlled vocabulary used for indexing articles for MEDLINE/PubMed.19 Additional articles were identified manually from searching the bibliographies of retrieved articles. We excluded articles published in languages other than English. We attempted to identify studies of interactive health interventions delivered via the Internet that, apart from delivering information, had another component such as interactive tools to manage illness and provide decision support for treatment or social support. Age range of participants in studies was restricted to adulthood. No restrictions were placed on the study methodologies identified. The literature search revealed 186 citations. Three reviewers independently reviewed abstracts and selected relevant publications. Articles were retained in the study if selected by one or more of the reviewers. Data were extracted on the study design, sampling/recruitment method, assessment of outcome, details of the intervention and control, participants, outcome measures reported, follow-up, attrition, and results. Articles that did not include this basic information were not retained for analysis.
A statistical summary of the results was not conducted, as a meta-analysis was not our intent. Rather, we identified themes, basing our approach on "positive deviance" methods. We used positive deviance to identify the features of Internet interventions that have resulted in higher user engagement and features that have resulted in lower engagement, and we chose "attrition" as the measure of user engagement. Although attrition does not capture all elements of user engagement, it is a logical metric and one that is most consistently and uniformly reported. Studies were ranked according to level of attrition during the intervention period.
A review of these abstracts led to retrieval of 32 full-text articles for assessment. Additional articles were identified from the bibliographies, and 46 studies were subsequently identified for inclusion and are listed in Table 1.
The articles selected for analysis covered a range of conditions including panic disorder,20 depression,21-24 eating disorders,25,26 stress associated with tinnitus,27 asthma,28 smoking cessation,29,30 insomnia,31 stress,24,32-34 weight loss,35-41 nutrition,42,43 chronic pain,44-47 headache,48-50 heavy drinking,51 diabetes,52,53 drug dependency,54 physical activity and health promotion,55-58 cardiovascular disease,53,59-61 cancer,62,63 HIV risk reduction,64 interventions for parents of ill children,65,66 and rural chronically ill women.67,68 In the following section, we describe five studies reporting the lowest attrition and five studies reporting the highest attrition.
Studies With Low Attrition
Attrition ranged from zero to 85% (median = 24%) in the 39 studies reporting attrition. The studies described below reported low attrition rates, ranging from 0% to 8%. In one study reviewed, Schulz et al47 conducted a pilot study of an Internet intervention for chronic low-back pain for the Italian-speaking population of Switzerland. Three medical professionals moderated the Web site and provided tailored information to the participants. Also, the intervention included social networking features for participants to share their experiences through a forum and chat room. The contents of the Web site were dynamic in nature. New articles, exercises, and multimedia files were written by the health professionals and added weekly. Compared with the control group that had no exposure to the Internet intervention, Internet participants reported a decrease in pain and use of pain medication, increase in activity, and fewer medical consultations. The availability of professional feedback and social support and the dynamic nature of the Web site appear to be the key features that engaged users, contributing to a zero attrition rate.
The study of Cousineau et al32 was a psychological intervention (cognitive behavioral skill building) for women experiencing infertility. Participants completed an initial assessment, which was the mechanism to provide tailored feedback. All of the women were all actively seeking medical care. Participation may have been enhanced by the short duration of the study and $100 cash incentive.
Southard et al61 evaluated an Internet cardiac rehabilitation program that links patients with a case manager. Participants set personal goals, had access to a registered dietitian and an online discussion group, and received small rewards (key chains and magnets) for logging in weekly, entering their physical data, completing educational modules, and communicating with the case manager. Fewer cardiac events occurred in the Internet intervention group. Weight changes were significant, whereas other differences such as blood pressure and lipid levels did not reach statistical significance.
In a weight loss maintenance intervention, Harvey-Berino et al37,41 reported low attrition. The Internet arm included e-mail contact with a therapist; self-reported dietary, exercise, and weight information; and moderated video and e-mail discussion sessions. Although the Internet intervention was not as effective as minimal or frequent in-person therapist support, low attrition was attained. The authors point out that the Internet group members were initially engaged in a 24-week face-to-face weight loss intervention and were accustomed to seeing each other.
Buhrman et al46 evaluated a cognitive behavioral therapy intervention for chronic back pain. In addition to providing close monitoring and tailored feedback via the Internet, the intervention used telephone contact to increase support, motivation, and compliance. This study reported attrition of 8%.
Studies With High Attrition
Strom et al50 recruited participants for an Internet relaxation training intervention for recurrent headache using advertisements in print media. Participants kept a headache diary and reported their practice of the relaxation techniques. The content was delivered weekly, but was not tailored individual treatment and did not include a face-to-face treatment component with the Internet intervention. Fifty-six percent of the 102 participants who met inclusion criteria dropped out of the study, leaving only 20 of 45 in the treatment group for the 6-week study duration.
Andersson et al27 evaluated an Internet intervention using cognitive behavioral self-help treatment for distress associated with tinnitus. There were 27 nonresponders (51%) in the treatment group. Only seven participants reported clinically significant improvement; however, the majority found the treatment to be beneficial. The authors were not able to disarticulate the effects of the intervention and concluded that the Internet is best used as a complement to clinic care.
Van Straten et al24 evaluated an intervention for depression and work-related stress. The program was dynamic in nature; every week, the contents and exercises changed, and feedback on completed exercises was provided. The study reported that 39% of the 97 people who completed the first assignment completed the entire 4-week course. Statistical and clinical effects were reported that were more pronounced for completers and those with more severe baseline problems.
Bickel et al54 examined an intervention that was grounded in an evidence-based behavioral therapy for opioid dependence. The study retained 58%, 53%, and 62% of participants in the standard, therapist-delivered, and computer-assisted treatment study arms, respectively. The results suggest that when computerized treatment is integrated into other treatment components, the results may be comparable to exclusively therapist-delivered treatment alone that is more expensive.
Devineni and Blanchard49 studied an Internet intervention for chronic headache and reported 38% dropout rate; however, compared with symptom monitoring alone, the intervention group reported significantly greater decrease in headache activity.
Because these studies differed substantially in possible reasons for attrition (ie, studies with demanding expectations early in the study), it is difficult to determine exact causes for attrition. In the discussion section, we address factors that engage the participant, as well as discuss the complexity of determining which factors impact user engagement, improve adherence, and reduce attrition (Table 2).
There is a growing body of research to support that effective Internet interventions produce changes in participants' behaviors that reduce symptoms and improve health. However, little is actually known about the mechanisms or components of the interventions that have the greatest impact,11 and few formal evaluations consider user engagement or adherence to the Internet interventions when assessing the overall impact on health outcomes. We used the positive deviance approach, described previously, to select the five studies with the lowest attrition studies (those who "succeeded") and the five studies with highest attrition (those who "failed"). We examined these "deviants" in detail to understand how the Internet interventions differed. Thus, our qualitative review of the manuscripts focused on 10 studies, representing the two extremes of lowest and highest attrition.
This research identified two characteristics contributing to Internet interventions that engage users: (1) the intervention targets participants with pressing health concerns, and (2) the intervention adapts to individual needs. For example, interventions that target a pressing health concern for a specific population, such as secondary prevention of cardiac failure61 or distress in women undergoing fertility treatment, appear to be more effective.32
Methods that adapt the intervention to an individual's specific needs are more likely to engage users. Successful programs for weight loss have been demonstrated39,41,69 and often include record keeping, personalized feedback, and accountability. Tailored online communication varies the content or presentation to an individual based on a limited set of variables that are believed to influence the individual's receptiveness to a message. Computer tailoring has become increasingly popular in the last decade and generally has been found to be more effective than nontailored equivalent applications.70,71 Steele et al58 demonstrated that interventions tailored to individual needs are more successful. For example, they found that their Internet intervention was best suited for obese participants with potentially greater outcome effect than traditional face-to-face interventions.
Interventions that include functionality for social networking and support, either between the patient and clinician or peer-to-peer, can meet the individual's specific needs. Interventions that include a clinician coach appeared especially promising. In a study of diabetic patients by Barrera et al,52 participants in the arms with coach and peer support had significantly increased perceived availability of social support. Allen et al44 concluded that a nurse coach is a possible way to engage and empower patients to manage chronic illness. There are also beneficial safeguards to adding a clinician coach or moderator to oversee the clinical aspects of the discussions. The Internet now supports a range of open sharing and collaboration, such as blogs, wikis, virtual health libraries, bulletin boards, and discussion groups, and applications incorporating newer gaming technology are growing.72
Attrition and Engagement: Improving Adherence
As a result of these studies, social support, new and engaging material, a theoretical framework of cognitive skill building, interaction with a case manager, tailored feedback, and phone support were features that contributed to decreased attrition.
In reviewing the literature to understand user engagement and attrition, it is important to distinguish between usage of an intervention in a natural setting (study effectiveness) versus usage in clinical trial studies (study efficacy). For example, Clarke et al23 had very low enrollment in their study of depression among HMO members but point out that the low rates are not an indication of the acceptability of this intervention offered outside a research study. The features of randomized trials (a chance of being assigned to the control group, repeated reminders to complete assessments, burdensome questionnaires) may create barriers that lower enrollment rates. On the other hand, the ability to offer incentives may increase adherence in the study setting, as may telephone reminders.23
The ease of enrolling in Internet studies is likely to impact adherence. For example, the literature suggests that multiple contact models and well-timed educational materials are more effective,30 yet these did not keep users engaged in an Internet smoking intervention. Commenting on their inability to hold the interest of the majority of the study's enrollees, the researchers speculated that because it is easy to enroll on the Internet, smokers who use this method may be less motivated than those who enroll in face-to-face sessions.
The results of randomized controlled trials (RCTs) testing Internet-delivered self-help programs generally provide evidence to support development for a range of chronic health conditions.5 There are a number of important advantages. Time constraints are removed for both patient and provider. The use of aliases may reduce social barriers to seeking face-to-face therapy and expand program reach. Interactive Internet interventions may offer computerized tracking for some measures of compliance with therapy and be a cost-effective way to helping people master new skills versus just providing basic information.
An essential component of a behavior change intervention is program dose. For Internet interventions, log-in rates and average session times serve as proxy measures. We found that the reporting of usage was not uniform across studies. Some studies reported the percentage of participants who logged in at least once; others reported average number of times per week or over the study duration, number of Web site hits, pages viewed, or average time spent. In assessing adherence to the intervention, it was often not clear what the dosage or usage should be.
In one of the few studies to discuss intervention dosage, Cousineau et al32,73 reported that 36% of participants in their intervention for infertile women spent an appropriate estimated dose of 90 minutes or more. In another study, Steele et al58 determined that participants who were exposed to at least 75% of the material had greater improvement than those who completed less; thus, they used their study results to set the appropriate "dosage" of their intervention to be 75%. Not surprisingly, log-in rates tended to decline over time (even for studies reporting lower attrition), with the largest drops experienced early in the intervention. McKay et al57 reported that overall attrition was 13%, yet usage dropped from a mean of 2.7 log-ins during the first 2 weeks to 0.5 log-ins during the last 2 weeks. This intervention included incorporated goal setting, tailored feedback, a personal coach, and peer support groups in an 8-week intervention to increase physical activity among diabetes patients.
Some possible strategies to engage users and prevent high attrition include adapting the intervention treatment to the specific individual's problems (eg, tailoring or nurse coach), combining face-to-face interactions with the Internet intervention, including dynamic content to prevent the user from "getting bored," and determining if specific variables predict attrition or low compliance.50 Because these strategies may add to the cost of the intervention, for some online interventions that can bring about desired health behavior change, it may be cost-effective to accept high rates of attrition to reach a larger population as the incremental cost per user is so low.53
Some limitations of our review were that it was difficult to find all relevant articles in this area, although the scope of chronic illness and health conditions was intentionally broad. As a result, we may have overlooked relevant studies. However, using the MeSH database reduced the possibility of searching incorrect keywords. Because this was a review of peer-reviewed, published journal articles in English, we may have eliminated interventions that otherwise would have served our research question. Also, many of the studies did not describe the features of the Web-based intervention in detail. Thus, it was not possible to determine with certainty what features may have enhanced or hindered user engagement and impacted attrition. We reviewed studies that included RCTs as well as studies conducted in natural settings; this difference may have impacted user attrition in either a positive direction or a negative direction. Also, in studies with high dropout rates, how dropouts are treated statistically is important in determining the intervention's effectiveness. For example, if losses to follow-up are excluded, the results of the likely effects might be overstated.
Another study limitation relates to the fact that Internet interventions are increasingly complex, and it is a challenge to tease out the specific features that contribute or detract from the intervention's ability to keep users engaged. For example, Houston and Ford29 found that the addition of a motivational introductory page improved the health outcomes studies, but because other changes were made, the results were far from conclusive. In one of the few studies to test specific "pieces" of the intervention, Andersson et al48 compared a self-help program for headache that included e-mail support and weekly telephone support to the same program without telephone support and found no differences. In addition to the technical specifications of the intervention, there are other factors to consider that influence the use of the Internet or Web-based program/intervention. These include characteristics of the user and the user's environment (eg, demographic variables, disease pathology and severity, cognitive factors, attitudes and beliefs, motivations, influences of family/friends, etc), in addition to the program content (eg, source and style of the message, whether grounded in a sound conceptual model or theoretical framework), the overall attractiveness or quality of the Web site, and the interaction between peers or with the therapist group leader (eg, e-mail, phone, face-to-face support). It is also important to assess both the short-term improvements and sustained gains. As van den Berg74 points out, more research is needed to determine the minimal duration of interventions to produce long-term changes.
In conclusion, the complexity of multifaceted Internet interventions makes it difficult to determine with certainty what individual features of these interventions are most effective; however, based on the results of this review, we identified several key elements of successful Internet interventions. In addition to targeting a pressing health concern that is relevant to the user, some ways to improve engagement in an Internet intervention suggested by our review include an individualized initial approach (eg, face-to-face contact to introduce the site) and personally tailored advice and feedback. Interventions that are part of a larger health management program that includes clinicians appear to be especially promising.61 Yet, for the full potential of Internet-based interventions for chronic illness to be realized, there are remaining questions to answer. In addition to testing the overall impact of Internet interventions, we need to understand the mechanism by which such interventions influence health behavior and health outcomes. We need to investigate factors that predict attrition and explore strategies for increasing exposure/dosage as well as understanding which target populations are best suited for a specific Internet intervention. A substantial effort has been made to use the Internet to deliver online prevention and treatment programs over the past decade. We need to understand what works and why; thus, more mixed methods studies that examine isolated variables of the interventions would assist in moving this area of research forward. Internet-supported interventions in delivering behavioral health interventions are likely to increase. We need to continue to build a structurally sound basis from which this field can continue to expand.
The authors thank Danielle Loos and Jennifer Poger for their help abstracting articles for this review.
2. Bessell TL, McDonald S, Silagy CA, Anderson JN, Hiller JE, Sansom LN. Do Internet interventions for consumers cause more harm than good? A systematic review. Health Expect. 2002;5(1):28-37.
3. Nguyen HQ, Carrieri-Kohlman V, Rankin SH, Slaughter R, Stulbarg MS. Internet-based patient education and support interventions: a review of evaluation studies and directions for future research. Comput Biol Med. 2004;34(2):95-112.
4. Wantland DJ, Portillo CJ, Holzemer WL, Slaughter R, McGhee EM. The effectiveness of Web-based vs. non-Web-based interventions: a meta-analysis of behavioral change outcomes. J Med Internet Res. 2004;6(4):e40.
5. Carlbring P, Andersson G. Internet and psychological treatment: how well can they be combined? Comput Hum Behav. 2006;22(3):545-553.
6. Barak A, Klein B, Proudfoot JG. Defining Internet-supported therapeutic interventions. Ann Behav Med. 2009;38(1):4-17.
7. Eysenbach G. What is e-health? J Med Internet Res. 2001;3(2):E20.
8. Ritterband LM, Thorndike F. Internet interventions or patient education Web sites? J Med Internet Res. 2006;8(3):e18; author reply e19.
9. Ritterband LM, Andersson G, Christensen HM, Carlbring P, Cuijpers P. Directions for the International Society for Research on Internet Interventions (ISRII). J Med Internet Res. 2006;8(3):e23.
10. Ritterband LM, Tate DF. The science of Internet interventions. Introduction. Ann Behav Med. 2009;38(1):1-3.
11. Ritterband LM, Thorndike FP, Cox DJ, Kovatchev BP, Gonder-Frederick LA. A behavior change model for Internet interventions. Ann Behav Med. 2009;38(1):18-27.
12. Eysenbach G. The law of attrition. J Med Internet Res. 2005;7(1):e11.
13. Marsh DR, Schroeder DG, Dearden KA, Sternin J, Sternin M. The power of positive deviance. BMJ. 2004;329(7475):1177-1179.
14. Awofeso N, Irwin T, Forrest G. Using positive deviance techniques to improve smoking cessation outcomes in New South Wales prison settings. Health Promot J Austr. 2008;19(1):72-73.
15. Friedman SR, Mateu-Gelabert P, Sandoval M, Hagan H, Des Jarlais DC. Positive deviance control-case life history: a method to develop grounded hypotheses about successful long-term avoidance of infection. BMC Public Health. 2008;8:94.
16. Ahrari M, Houser RF, Yassin S, et al. A positive deviance-based antenatal nutrition project improves birth-weight in Upper Egypt. J Health Popul Nutr. 2006;24(4):498-507.
17. Bradley EH, Herrin J, Wang Y, et al. Strategies for reducing the door-to-balloon time in acute myocardial infarction. N Engl J Med. 2006;355(22):2308-2320.
18. Bradley EH, Curry LA, Ramanadhan S, Rowe L, Nembhard IM, Krumholz HM. Research in action: using positive deviance to improve quality of health care. Implement Sci. 2009;4:25.
20. Carlbring P, Westling BE, Ljungstrand P, Ekselius L, Andersson G. Treatment of panic disorder via the Internet: a randomized trial of a self-help program. Behav Ther. 2001;32:751-764.
21. Kerr J, Patrick K, Norman G, et al. Randomized control trial of a behavioral intervention for overweight women: impact on depressive symptoms. Depress Anxiety. 2008;25(7):555-558.
22. Christensen H, Griffiths KM, Korten A. Web-based cognitive behavior therapy: analysis of site usage and changes in depression and anxiety scores. J Med Internet Res. 2002;4(1):e3.
23. Clarke G, Reid E, Eubanks D, et al. Overcoming depression on the Internet (ODIN): a randomized controlled trial of an Internet depression skills intervention program. J Med Internet Res. 2002;4(3):E14.
24. Van Straten A, Cuijpers P, Smits N. Effectiveness of a Web-based self-help intervention for symptoms of depression, anxiety, and stress: randomized controlled trial. J Med Internet Res. 2008;10(1):e7.
25. Celio AA, Winzelberg AJ, Wilfley DE, et al. Reducing risk factors for eating disorders: comparison of an Internet- and a classroom-delivered psychoeducational program. J Consult Clin Psychol. 2000;68(4):650-657.
26. Winzelberg AJ, Eppstein D, Eldredge KL, et al. Effectiveness of an Internet-based program for reducing risk factors for eating disorders. J Consult Clin Psychol. 2000;68(2):346-350.
27. Andersson G, Stromgren T, Strom L, Lyttkens L. Randomized controlled trial of Internet-based cognitive behavior therapy for distress associated with tinnitus. Psychosom Med. 2002;64(5):810-816.
28. Atherton M. Outcome measures of efficacy associated with a Web-enabled asthma self-management programme: findings from a quasi-experimenet. Dis Manage Health Outcomes. 2000;8(4):233-242.
29. Houston TK, Ford DE. A tailored Internet-delivered intervention for smoking cessation designed to encourage social support and treatment seeking: usability testing and user tracing. Inform Health Soc Care. 2008;33(1):5-19.
30. Lenert L, Munoz RF, Stoddard J, et al. Design and pilot evaluation of an Internet smoking cessation program. J Am Med Inform Assoc. 2003;10(1):16-20.
31. Strom L, Pettersson R, Andersson G. Internet-based treatment for insomnia: a controlled evaluation. J Consult Clin Psychol. 2004;72(1):113-120.
32. Cousineau TM, Green TC, Corsini E, et al. Online psychoeducational support for infertile women: a randomized controlled trial. Hum Reprod. 2008;23(3):554-566.
33. Lange A, Rietdijk D, Hudcovicova M, van de Ven JP, Schrieken B, Emmelkamp PM. Interapy: a controlled randomized trial of the standardized treatment of posttraumatic stress through the Internet. J Consult Clin Psychol. 2003;71(5):901-909.
34. Ruwaard J, Lange A, Bouwman M, Broeksteeg J, Schrieken B. E-mailed standardized cognitive behavioural treatment of work-related stress: a randomized controlled trial. Cogn Behav Ther. 2007;36(3):179-192.
35. Booth AO, Nowson CA, Matters H. Evaluation of an interactive, Internet-based weight loss program: a pilot study. Health Educ Res. 2008;23(3):371-381.
36. Cussler EC, Teixeira PJ, Going SB, et al. Maintenance of weight loss in overweight middle-aged women through the Internet. Obesity (Silver Spring). 2008;16(5):1052-1060.
37. Harvey-Berino J, Pintauro S, Buzzell P, et al. Does using the Internet facilitate the maintenance of weight loss? Int J Obes Relat Metab Disord. 2002;26(9):1254-1260.
38. Stevens VJ, Funk KL, Brantley PJ, et al. Design and implementation of an interactive Website to support long-term maintenance of weight loss. J Med Internet Res. 2008;10(1):e1.
39. Tate DF, Wing RR, Winett RA. Using Internet technology to deliver a behavioral weight loss program. JAMA. 2001;285(9):1172-1177.
40. Womble LG, Wadden TA, McGuckin BG, Sargent SL, Rothman RA, Krauthamer-Ewing ES. A randomized controlled trial of a commercial Internet weight loss program. Obes Res. 2004;12(6):1011-1018.
41. Harvey-Berino J, Pintauro SJ, Gold EC. The feasibility of using Internet support for the maintenance of weight loss. Behav Modif. 2002;26(1):103-116.
42. Cullen KW, Thompson D. Feasibility of an 8-week African American Web-based pilot program promoting healthy eating behaviors: Family Eats. Am J Health Behav. 2008;32(1):40-51.
43. Oenema A, Brug J, Lechner L. Web-based tailored nutrition education: results of a randomized controlled trial. Health Educ Res. 2001;16(6):647-660.
44. Allen M, Iezzoni LI, Huang A, Huang L, Leveille SG. Improving patient-clinician communication about chronic conditions: description of an Internet-based nurse e-coach intervention. Nurs Res. 2008;57(2):107-112.
45. Brattberg G. Internet-based rehabilitation for individuals with chronic pain and burnout: a randomized trial. Int J Rehabil Res. 2006;29(3):221-227.
46. Buhrman M, Faltenhag S, Strom L, Andersson G. Controlled trial of Internet-based treatment with telephone support for chronic back pain. Pain. 2004;111(3):368-377.
47. Schulz PJ, Rubinell S, Hartung U. An Internet-based approach to enhance self-managementof chronic low back pain in the italian-speaking population of Switzerland: results from a pilot study. Int J Public Health. 2007;52(5):286-294.
48. Andersson G, Lundstrom P, Strom L. Internet-based treatment of headache: does telephone contact add anything? Headache. 2003;43(4):353-361.
49. Devineni T, Blanchard EB. A randomized controlled trial of an Internet-based treatment for chronic headache. Behav Res Ther. 2005;43(3):277-292.
50. Strom L, Pettersson R, Andersson G. A controlled trial of self-help treatment of recurrent headache conducted via the Internet. J Consult Clin Psychol. 2000;68(4):722-727.
51. Linke S, Murray E, Butler C, Wallace P. Internet-based interactive health intervention for the promotion of sensible drinking: patterns of use and potential impact on members of the general public. J Med Internet Res. 2007;9(2):e10.
52. Barrera M Jr, Glasgow RE, McKay HG, Boles SM, Feil EG. Do Internet-based support interventions change perceptions of social support?: An experimental trial of approaches for supporting diabetes self-management. Am J Community Psychol. 2002;30(5):637-654.
53. Lorig KR, Ritter PL, Laurent DD, Plant K. Internet-based chronic disease self-management: a randomized trial. Med Care. 2006;44(11):964-971.
54. Bickel WK, Marsch LA, Buchhalter AR, Badger GJ. Computerized behavior therapy for opioid-dependent outpatients: a randomized controlled trial. Exp Clin Psychopharmacol. 2008;16(2):132-143.
55. Cook RF, Billings DW, Hersch RK, Back AS, Hendrickson A. A field test of a Web-based workplace health promotion program to improve dietary practices, reduce stress, and increase physical activity: randomized controlled trial. J Med Internet Res. 2007;9(2):e17.
56. Marshall AL, Leslie ER, Bauman AE, Marcus BH, Owen N. Print versus Website physical activity programs: a randomized trial. Am J Prev Med. 2003;25(2):88-94.
57. McKay HG, King D, Eakin EG, Seeley JR, Glasgow RE. The diabetes network Internet-based physical activity intervention: a randomized pilot study. Diabetes Care. 2001;24(8):1328-1334.
58. Steele RM, Mummery WK, Dwyer T. Examination of program exposure across intervention delivery modes: face-to-face versus Internet. Int J Behav Nutr Phys Act. 2007;4:7.
59. Goessens BM, Visseren FL, de Nooijer J, et al. A pilot-study to identify the feasibility of an Internet-based coaching programme for changing the vascular risk profile of high-risk patients. Patient Educ Couns. 2008;73(1):67-72.
60. Scherrer-Bannerman A, Fofonoff D, Minshall D, et al. Web-based education and support for patients on the cardiac surgery waiting list. J Telemed Telecare. 2000;6(suppl 2):S72-S74.
61. Southard BH, Southard DR, Nuckolls J. Clinical trial of an Internet-based case management system for secondary prevention of heart disease. J Cardiopulm Rehabil. 2003;23(5):341-348.
62. Owen JE, Klapow JC, Roth DL, et al. Randomized pilot of a self-guided Internet coping group for women with early-stage breast cancer. Ann Behav Med. 2005;30(1):54-64.
63. Gustafson DH, Hawkins R, Pingree S, et al. Effect of computer support on younger women with breast cancer. J Gen Intern Med. 2001;16(7):435-445.
64. Lau JT, Lau M, Cheung A, Tsui HY. A randomized controlled study to evaluate the efficacy of an Internet-based intervention in reducing HIV risk behaviors among men who have sex with men in Hong Kong. AIDS Care. 2008;20(7):820-828.
65. Wade SL, Carey J, Wolfe CR. An online family intervention to reduce parental distress following pediatric brain injury. J Consult Clin Psychol. 2006;74(3):445-454.
66. Wise M, Gustafson DH, Sorkness CA, et al. Internet telehealth for pediatric asthma case management: integrating computerized and case manager features for tailoring a Web-based asthma education program. Health Promot Pract. 2007;8(3):282-291.
67. Weinert C, Hill WG. Rural women with chronic illness: computer use and skill acquisition. Womens Health Issues. 2005;15(5):230-236.
68. Weinert C, Cudney S, Hill W. Retention in a computer-based outreach intervention for chronically ill rural women. Appl Nurs Res. 2008;21(1):23-29.
69. Tate DF, Jackvony EH, Wing RR. Effects of Internet behavioral counseling on weight loss in adults at risk for type 2 diabetes: a randomized trial. JAMA. 2003;289(14):1833-1836.
70. Brug J, van Assema P. Differences in use and impact of computer-tailored dietary fat-feedback according to stage of change and education. Appetite. 2000;34(3):285-293.
71. Brug J, Oenema A, Kroeze W, Raat H. The Internet and nutrition education: challenges and opportunities. Eur J Clin Nutr. 2005;59(suppl 1):S130-S137; discussion S138-S139.
72. Seeman N. Web 2.0 and chronic illness: new horizons, new opportunities. Healthc Q. 2008;11(1):104-108, 110.
73. Cousineau T, Houle B, Bromberg J, Fernandez KC, Kling WC. A pilot study of an online workplace nutrition program: the value of participant input in program development. J Nutr Educ Behav. 2008;40(3):160-167.
74. van den Berg MH, Schoones JW, Vliet Vlieland TP. Internet-based physical activity interventions: a systematic review of the literature. J Med Internet Res. 2007;9(3):e26.
This article has been cited 4 time(s).
Journal of Clinical PsychologyA Randomized Controlled Trial of an Internet Intervention for Adults with Insomnia: Effects on Comorbid Psychological and Fatigue SymptomsJournal of Clinical Psychology
American Journal of Health PromotionRecruitment Rates in Workplace Physical Activity Interventions: Characteristics for SuccessAmerican Journal of Health Promotion
International Journal of Clinical PracticeCan the Internet help people with cardiovascular disease?International Journal of Clinical Practice
Copd-Journal of Chronic Obstructive Pulmonary DiseaseReal-Time Telehealth for COPD Self-Management Using Skype (TM)Copd-Journal of Chronic Obstructive Pulmonary Disease
Chronic illness; Health behavior; Internet; Nursing informatics; Review article
© 2011 Lippincott Williams & Wilkins, Inc.
Highlight selected keywords in the article text.