The APP content developed by the scientific advisors contains 14 animations, 86 expert videos, and 17 patient experience videos. Each of these videos is 3 to 4 minutes long. The APP education modules can be accessed directly from NPF's websites15,16 (https://pancreasfoundation.org, http://www.animatedpancreaspatient.com) or through the APP YouTube channel (https://www.youtube.com/user/ThePancreasPatient).17 The APP website and YouTube channel education modules are publicized by NPF chapters and through NPF outreach at national conferences. The APP website homepage also prompts users to provide feedback on user identity (patient, family/caregiver, health care provider, other), impact of the provided content on future actions and commitment to change, and evaluation of the quality of the educational material. The list of available animations, expert videos, and patient experience videos is illustrated in Supplementary Table 1, http://links.lww.com/MPA/A686. The optional feedback survey questionnaire is illustrated in Supplementary Table 2, http://links.lww.com/MPA/A686.
User Metrics Measurement and Statistical Analysis
Data were reported as frequencies and proportion and mean (standard deviation) where appropriate. We evaluated audience reach, demographics, and metrics such as number of visit sessions, number of unique visitors, page views, duration of page views, and duration of video views for the APP website and the APP YouTube channel. We also calculated top views, top views by media type (animation, expert video, patient experience video, slide show), and top retention videos overall for the APP website and YouTube channel. Finally, we assessed the educational impact of the APP program from the feedback survey data.
Between September 6, 2013, and October 5, 2017, the APP website and YouTube channel had 1,475,252 total views (APP = 274,906; YouTube = 1,200,346) and 547,693 total unique visitors (APP = 67,553; YouTube = 480,140). Overall, the educational content was accessed by participants from 159 countries, with a total of 3,054,490 minutes watched on YouTube. Most of the unique visitors (63.1%) to the APP website were from the United States, and 36.9% were from other countries.
A total of 4869 participants took part in the feedback survey. More than half of participants (54.6%) identified as patients; the rest were family caregivers (16.9%), health care providers (13.9%), and other (14.6%). The survey participants indicated they had learned about the APP website via their doctor (6.5%), nurse/pharmacist (0.3%), family/friend (2.2%), internet search (84.2%), or other (6.8%).
Popular Topics for the Animation, Expert Videos, and Patient Videos
Table 1 lists the most popular topics for the animation and videos. “Role and Anatomy of the Pancreas” (361,115 views), “Chronic Pancreatitis” (289,923 views), “Acute Pancreatitis” (157,076 views), “Understanding ERCP” (114,472 views), and “Pancreatic Surgery: Benefits, Risks, and Relevant Anatomy” (57,977 views) were the top animations viewed, respectively.
The most common expert videos viewed by the participants were “Chronic Pancreatitis: What Foods and Beverages Should I Avoid?”, “How Can You Keep the Pancreas Healthy?”, “How Is Acute Pancreatitis Treated?”, “What Are the Different Stages of Pancreatic Cancer?”, and “What Is the Link Between Alcohol and Acute Pancreatitis?” (Table 1).
Among the patient experience videos, “What Symptoms Did You Experience That Lead to Your Diagnosis of Acute Pancreatitis?”, “What Symptoms Lead to Your Diagnosis of Chronic Pancreatitis?”, “What Symptoms Lead to Your Diagnosis of EPI? How Was It Diagnosed?”, “After Your Initial Acute Pancreatitis Attack, Did You Go Back to Being Symptom-free?”, and “After an Episode of Acute Pancreatitis, What Food and Beverages Do You Eat or Try to Avoid?” were the most viewed, respectively (Table 1).
Animations and Videos With the Highest Viewer Retention
Table 2 lists the top 10 animations and top 10 videos by viewer retention (as determined by the percentage of the total video length viewed). “Exocrine Pancreatic Insufficiency” and “What Is the Link Between Alcohol and Acute Pancreatitis?” are the top animation and video that had the highest retention. For both these videos, 78% of each video's content was viewed.
Participant Knowledge and Commitment to Change
Among participants who completed the online feedback survey (n = 4869), approximately 91% reported they learned new information, 84.6% learned new treatment options, and 83.2% learned new surgery options for pancreatic diseases. Most participants (>94%) also expressed a commitment to change in terms of using the information to better manage their pancreatic disease and indicated their intention to engage with their doctor in discussions (Fig. 3).
The data from our study show that NPF's APP pancreas education modules had approximately 1.5 million views and approximately 548,000 unique participants during the 4-year study period. The most popular topic of the animations was “Role and Anatomy of the Pancreas,” and the most common expert video viewed was “Chronic Pancreatitis: What Foods and Beverages Should I Avoid?” Participants who completed the online feedback survey reported knowledge gains and commitment to change by indicating they would discuss a new option with their physician or implement a newly learned self-management action.
Several studies reported that low health literacy negatively impacts patients' health outcomes,8–11 yet there are limited reliable educational resources specific to patient needs and interests in pancreatic diseases. The National Institutes of Health recommends a seventh- to eighth-grade reading level for easy-to-read health materials and the American Medical Association suggests fifth- to sixth-grade reading level for patient education print materials.11,18 However, current patient education content is predominantly text based and most often written at literacy levels above the comprehension level of laypersons in many areas of oncology including pancreatic cancer, palliative care, radiation oncology, internal medicine, and others.19–27
National Pancreas Foundation's Animated Pancreas Patient—An Animated Patient's Guide to Pancreatic Diseases uses visual learning formats to address patient barriers to health literacy and provide an accessible, evidence-based resource. Multidisciplinary expert faculty guide content development of the APP website, which provides free access to educational content through succinct animations with audio narration of easy-to-understand, grade 6 to 8 level content, focusing on frequently asked questions and key disease concepts; short video segments of experts answering questions; videos of patients sharing their experiences; and slide shows of content covered by the animations.15 The content of APP educational modules aligns with the health literacy literature on the effectiveness of visual aids and video in patient education.28 The feedback survey on self-reported gains in competence and intention to change also align with Moore and colleagues'29 level 4 outcomes for continuing medical education.
Strengths of our study include a large user sample size, reaching a nationwide audience, benefiting from the guidance of a multidisciplinary expert faculty in the development of content, and sourcing shared disease experiences directly from patients. We believe that the competencies that patients gain through using the APP can help them more effectively participate in shared decision making, which promotes patient satisfaction with their health care experience.30,31 The multimedia learning components of the APP are also helpful for use among clinicians with busy schedules and lack of patient education resources. Animated Pancreas Patient is also in the process of developing content relevant for pediatric patients in a format suited to their learning needs. A mobile App (Pancreas101) was introduced in July 2016 and is freely accessible for use by patients. To address the needs of Spanish-speaking audience, the NPF has also produced an equivalent resource in Spanish in April 2015 (www.PancreasAnimado.com). New videos are being added, and efforts are being made to translate APP educational content into other languages to benefit global communities with pancreatic diseases.
The limitations of our study include retrospective design, use of self-reported responses from a relatively small group of users taking part in the optional feedback survey, and generalization of a fairly limited number of user comments. Although the APP received approximately 1.5 million views worldwide, only few (n = 4869) participated in the feedback survey. This is because the feedback survey was optional (no monetary compensation provided) for completing the survey. The program also lacked a formal presurvey/postsurvey for assessment. Because of the nature of the survey, we were also unable to find out which specific modules participants accessed.
In conclusion, Animated Pancreas Patient—An Animated Patient's Guide to Pancreatic Diseases effectively delivers education to patients with diseases of the pancreas. This visual format of learning demonstrates wide reach and has vast potential to improve health outcomes by informing patients and their caregivers. Continued efforts should be made to provide patient resources that address health literacy and patient education, responding to the needs of patients for better quality of life in pancreatic diseases.
The authors thank Mechanisms in Medicine Inc for the development of the Animated Pancreas Patient—An Animated Patient's Guide to Pancreatic Diseases. The authors also thank Monica Nicosia, PhD, Nicosia Medical Writer LLC, for medical and writing services funded by Mechanisms in Medicine Inc.
1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2018. CA Cancer J Clin
2. Peery AF, Crockett SD, Barritt AS, et al. Burden of gastrointestinal, liver, and pancreatic diseases
in the United States. Gastroenterology
4. Etemad B, Whitcomb DC. Chronic pancreatitis: diagnosis, classification, and new genetic developments. Gastroenterology
5. Yadav D, Lowenfels AB. The epidemiology of pancreatitis and pancreatic cancer. Gastroenterology
6. HCUPnet. Healthcare Cost and Utilization Project: Diagnoses—ICD-9-CM
), Principal Diagnosis: 577.0 Acute Pancreatitis, 577.1 Chronic Pancreatitis 2014. Available at: https://hcupnet.ahrq.gov
. Accessed September 21, 2017.
7. Singh S, Singh PP, Singh AG, et al. Anti-diabetic medications and risk of pancreatic cancer in patients with diabetes mellitus: a systematic review and meta-analysis. Am J Gastroenterol
. 2013;108:510–519; quiz 520.
8. Berkman ND, Sheridan SL, Donahue KE, et al. Low health literacy
and health outcomes
: an updated systematic review. Ann Intern Med
9. Levy H, Janke A. Health literacy
and access to care. J Health Commun
. 2016;21(suppl 1):43–50.
10. Hersh L, Salzman B, Snyderman D. Health literacy
in primary care practice. Am Fam Physician
11. Weiss BD. Health Literacy and Patient Safety: Help Patients Understand. Manual for Clinicians
. 2nd ed. Chicago, IL: American Medical Association; 2007.
12. Institute of Medicine (US) Committee on Health Literacy
. What is health literacy
? In: Nielsen-Bohlman L, Panzer AM, Kindig DA, eds. Health Literacy: A Prescription to End Confusion
. Washington, DC: National Academies Press (US); 2004.
13. Halverson JL, Martinez-Donate AP, Palta M, et al. Health literacy
and health-related quality of life among a population-based sample of cancer patients. J Health Commun
14. Busch EL, Martin C, DeWalt DA, et al. Functional health literacy
, chemotherapy decisions, and outcomes among a colorectal cancer cohort. Cancer Control
20. Storino A, Castillo-Angeles M, Watkins AA, et al. Assessing the accuracy and readability of online health information for patients with pancreatic cancer. JAMA Surg
21. Prabhu AV, Hansberry DR, Agarwal N, et al. Radiation oncology and online patient education
materials: deviating from NIH and AMA recommendations. Int J Radiat Oncol Biol Phys
22. Prabhu AV, Donovan AL, Crihalmeanu T, et al. Radiology online patient education
materials provided by major university hospitals: do they conform to NIH and AMA guidelines? Curr Probl Diagn Radiol
23. Prabhu AV, Crihalmeanu T, Hansberry DR, et al. Online palliative care and oncology patient education
resources through Google: do they meet national health literacy
recommendations? Pract Radiat Oncol
24. Hansberry DR, Agarwal N, John ES, et al. Evaluation of internet-based patient education
materials from internal medicine subspecialty organizations: will patients understand them? Intern Emerg Med
25. Weiss KD, Vargas CR, Ho OA, et al. Readability analysis of online resources related to lung cancer. J Surg Res
26. Hansberry DR, Patel SR, Agarwal P, et al. A quantitative readability analysis of patient education
resources from gastroenterology society websites. Int J Colorectal Dis
27. Prabhu AV, Kim C, Crihalmeanu T, et al. An online readability analysis of pathology-related patient education
articles: an opportunity for pathologists to educate patients. Hum Pathol
29. Moore DE Jr, Green JS, Gallis HA. Achieving desired results and improved outcomes: integrating planning and assessment throughout learning activities. J Contin Educ Health Prof
30. Kane HL, Halpern MT, Squiers LB, et al. Implementing and evaluating shared decision making in oncology practice. CA Cancer J Clin
31. Katz SJ, Hawley S. The value of sharing treatment decision making with patients: expecting too much? JAMA
health literacy; health outcomes; pancreatic diseases; patient education; visual formats of learning
Supplemental Digital Content
Copyright © 2018 Wolters Kluwer Health, Inc. All rights reserved.