Secondary Logo

Journal Logo

Research Reports

Raising the Bar for the Care of Seriously Ill Patients

Results of a National Survey to Define Essential Palliative Care Competencies for Medical Students and Residents

Schaefer, Kristen G., MD; Chittenden, Eva H., MD; Sullivan, Amy M., EdD; Periyakoil, Vyjeyanth S., MD; Morrison, Laura J., MD; Carey, Elise C., MD; Sanchez-Reilly, Sandra, MD; Block, Susan D., MD

Author Information
doi: 10.1097/ACM.0000000000000271

Abstract

A growing body of evidence suggests that incorporating specialty-level palliative care into the care of patients with serious or life-threatening illness improves quality of life, dying, and bereavement and also affects larger social issues such as inappropriate use of ineffective and burdensome medical interventions for seriously ill patients and underuse of interventions that promote quality of life such as timely hospice referrals.1–4 However, there is a shortage of palliative care specialists across the United States compared with the growing number of patients facing serious and life-threatening illnesses.5 As national health care reform unfolds, with its emphasis on patient-centered care and “bending the cost curve,” experts highlight the need for improvements in palliative care service delivery.6 Improved generalist physician training in palliative care competencies is a critical need to attain these objectives.7,8

Introduction

Good evidence now demonstrates that palliative care competencies can be successfully taught at the undergraduate,9–12 graduate,13–15 and practicing physician level16–18; however, the content of existing curricula and methods of instruction are inconsistent across academic centers,19–22 and national standards for medical school and residency palliative care education are needed. Other fields, including geriatrics, pulmonary and critical care medicine, and emergency medicine, have published specialty-based consensus competencies for medical students, residents, and fellows.23–27 The purpose of this study was to create palliative care specialty-defined competencies for medical students and internal medicine and family medicine (IM/FM) residents.

This study builds on an extensive body of work over the past decade to define consensus-based clinical palliative care competencies and to standardize required competencies for hospice and palliative medicine (HPM) fellowship. In 2004, after a rigorous consensus process, the National Consensus Project for Quality Palliative Care published clinical guidelines for palliative care, and in 2007 the National Quality Forum released a set of preferred practices for palliative care based on these guidelines.28,29 Within the same time period, in accord with the Accreditation Council for Graduate Medical Education (ACGME)’s Outcome Project30 mandate for competency-based curriculum and assessment, leaders in academic palliative care began a process of iterative review to create comprehensive HPM fellowship competencies.31 The fellowship competencies, and more recently competency-based measurable outcomes and assessment methods, have been endorsed by the American Academy of Hospice and Palliative Medicine (AAHPM) and published on their Web site.32,33

Method

In this study, we used medical student and resident competencies derived from published HPM fellowship competencies as the basis for a national survey34,35 to assess content validity (i.e., were the proposed competencies comprehensive and developmentally appropriate?), to prioritize essential graduation competencies, and to rank the importance of palliative care domains for each learner group.

Drafting proposed competencies

In April 2010, we convened palliative care educators (K.G.S., E.H.C., V.S.P., S.S., L.J.M., E.C.C.) from six academic medical centers across the United States and a senior leader (S.D.B.) to form the Medical Student and IM/FM Residency Competencies Workgroup. All members were leaders in medical student or residency palliative care education at their institutions and had expertise with competencies and/or learner evaluation. We designed a multistep process to generate a list of comprehensive competencies for medical students and residents, respectively, using the published HPM fellowship competencies as a starting point. First, two members of the workgroup (E.C., K.S.) reviewed each fellowship competency and categorized it as a general medicine competency, a fellowship-level competency beyond the scope of generalist-level practice, or a fellowship-level competency that could be transformed into developmentally appropriate resident and medical student competencies. Next (from April 2010 through March 2011), through a process of e-mails, seven conference calls, and in-person meetings, we iteratively reviewed and revised each competency in the third category and derived corresponding developmentally appropriate medical student and IM/FM resident competencies. The language of each competency was kept as true to the published fellowship competencies as possible, and crafted to be “SMART” (specific, measureable, achievable, relevant, and timely).36 We sorted the resulting 18 medical student competencies and 18 corresponding resident competencies into five domains (pain and symptom management; communication; psychosocial, spiritual, and cultural aspects of care; terminal care and bereavement; and palliative care principles and practice), and presented them in a side-by-side table format to emphasize the developmental trajectory of knowledge, skills, and attitudes expected over the course of undergraduate and graduate training (see Supplemental Digital Appendix 1, http://links.lww.com/ACADMED/A203).

Survey design and implementation

We used Qualtrics (a Web-based tool) to develop the survey of experts’ ratings and rankings of proposed competencies and competency domains (survey available on request). Eighteen student competencies and 18 resident competencies were sorted into the five domains. To minimize the risk of order bias, the five domains were presented in random order in each survey, and items within each domain were also presented in random order. To minimize social desirability bias and protect confidentiality, survey instructions detailed that workgroup members would not have access to respondent identifiers, and all survey data would be deidentified and stored on a secure server after data collection. The study was approved by the Partners institutional review board and met requirements of institutional review boards for each of our institutions at the time.

We asked respondents to rate each com petency at each training level as “essential for all,” “important for all,” “important for some,” or “not appropriate for this level,” with no more than 10 competencies in each learner group as “essential for all.” A running tally of items selected as “essential” was shown on each survey page to assist in this process. Survey instructions defined a competency as “essential for all” if it was a prerequisite for graduation from medical school or residency. We provided a reference table to respondents showing medical student and corresponding resi dent competencies side-by-side by domain. To assess content validity—that is, whether the 18 competencies were comprehensive and covered important palliative care con tent—we gave respondents the oppor tunity to make comments to revise or refine com petencies or to suggest additional competencies they felt were missing.

Finally, to assess the relative weight that the group of educators collectively assigned to each domain, we asked each respondent to weigh the importance of each of the five palliative care domains for each learner group. The survey program automatically added the weights to ensure that the sum could not be greater than 100%. These domains were also presented in random order to minimize order bias. We requested the following demographic information of respondents: gender, number of years practicing clinical palliative care, proportion of clinical practice spent in palliative care, board certification in palliative care, faculty appointment, and length of time teaching various palliative care learner groups. Potential participants received advance notice about the study by e-mail from one of us (S.D.B.), followed by an e-mail invitation to participate with an embedded link to the survey. We sent the survey by e-mail in February 2012 with three e-mail reminder notices over a three-week period. No incentives were offered for participation.

Survey participant selection process

We identified a cohort of 98 expert palliative care physician educators using the three inclusion criteria below. Physicians who met any of the three criteria were eligible to participate (several participants met more than one selection criterion). No authors participated in the survey. Inclusion criteria were defined as follows.

Evidence of leadership role in medical student or resident education at the local or national level.

To fulfill this criterion, a participant could serve as a leader of a palliative care rotation or course, or have developed a curriculum or assessment tool for medical students or residents. In addition, he or she had to have taught as a faculty member for at least two years. We identified 49 educators fulfilling this criterion by e-mailing the AAHPM Fellowship Director listserv, Medical School Palliative Care Education project scholars,37 and educators who participated in the AAHPM Leadership Education and Academic Development leadership development program.

Evidence of publications related to medical student and IM/FM resident palliative care education.

To qualify, participants needed one publication as first or last author and board certification in HPM, or two or more publications as first or last author with any board certification. We performed a PubMed search using the key words “palliative care” and “medical education, undergraduate and graduate” and included articles from 1996 to the present. Board certification was confirmed with the American Board of Medical Specialties.38 We identified 32 potential participants by this process.

Evidence of a national leadership role in palliative care and significant experience teaching medical students and IM/FM residents.

To qualify, the 73 participants we identified needed to be leaders of palliative care programs or to have participated in medical education projects or committees at a national level, and have greater than five years’ experience teaching medical students or residents.

Data analysis

We carried out a descriptive analysis of survey items, reporting frequencies and percentages for categorical variables and means and standard deviations for continuous variables. To classify a competency as required for graduating medical students or residents, we specified a predetermined cutoff of 50% or greater percentage of experts rating that competency as “essential for all” and no more than 5% of respondents rating the item as “not appropriate for this level.” To assess within-group differences across individual competency ratings or across the five domains, as well as between groups by faculty rank, we carried out repeated-measures multivariate analysis of variance with contrasts. We specified a predetermined level of α = 0.05 (two-tailed) for tests of significance. Statistical analyses were performed using SAS/STAT version 9.3 (SAS Inc., 2012).

Results

The survey response rate was 72% (71/98) (79% of those invited to participate responded to the survey; however, six of these surveys were incomplete and not included in the analysis). Demographic characteristics of respondents are shown in Table 1. Most respondents reported spending the majority of their clinical time in palliative care. Both junior and senior faculty members are represented in this sample, and most have taught students, residents, fellows, and faculty for more than five years. At the time of data collection, 93% of respondents were board certified in HPM.

Table 1
Table 1:
Characteristics of 71 Palliative Care Experts Who Participated in a Survey About Essential Competencies for Medical Students and Residents, 2012

Rating of specific competencies

The proposed comprehensive palliative care competencies and essential competencies are shown in Supplemental Digital Appendix 1 at http://links.lww.com/ACADMED/A203.

Medical student competencies.

Table 2 shows that the majority of respondents rated all 18 medical student competencies as either “essential for all” or “important for all.” Seven medical student competencies, covering all five palliative care domains, were identified by 50% or more of respondents as essential for graduation. Only five items were rated as “not appropriate for this level,” and no more than four respondents gave this rating to an individual competency. Four respondents suggested items that were missing, and these suggestions were reviewed by the workgroup and assessed to be not meaningfully different from the 18 competencies already proposed. The number-one-ranked competency for medical students was to demonstrate the ability to describe ethical principles that inform decision making at the end of life. Two of the top seven medical student competencies fell within the domain of communication: using patient-centered techniques when giving bad news and discussing resuscitation preferences, and exploring patient and family understanding of illness, concerns, goals, and values that inform the plan of care. Two of the top seven competencies were in the domain of principles and practice of palliative care: developing the ability for self-reflection, especially when caring for patients at high risk for dying, and defining the philosophy and role of palliative care and hospice. Identifying psychosocial distress in patients and families and assessing pain systematically were also ranked in the top seven.

Table 2
Table 2:
Palliative Care Competencies for Graduating Medical Students, Developed From a Survey of 71 Palliative Care Experts, 2012a

Resident competencies.

Table 3 shows the competencies for graduating IM/FM residents. Similar to the medical student competencies, the majority of respondents rated each competency as either “essential for all” or “important for all” residents. No competency was rated as inappropriate for the residency level, and no respondents suggested items that were missing. Thirteen competencies were identified by 50% or more of respondents as essential for graduation. As with the essential medical student competencies, essential competencies represented all five palliative care domains. The top 2 resident competencies related to patient-centered communication and shared decision making. Three of the 13 essential competencies were in the terminal care and bereavement domain. Of note, 7 of the 13 essential resident competencies were the more advanced versions of the essential medical student competencies. Other competencies identified as essential for IM/FM residents included more detailed expertise in opioid use, diagnosis and initial management of psychiatric symptoms, handling strong patient and family emotion, integrating cultural values into the treatment plan, symptom management at the end of life, and communication with family after a patient dies.

Table 3
Table 3:
Palliative Care Competencies for Graduating Residents, Developed From a Survey of 70 Palliative Care Experts, 2012a

Ranking of palliative care domains

Figure 1 shows the relative weights assigned to each of the palliative care domains, for both medical students and residents. For both learner groups, the competency domains of communication and pain and symptom management received the highest weights. Differences between rankings for competency domains were statistically significant for all domains except between the two least weighted categories, psychosocial care and terminal care (student competencies, Wilks lambda for within-group difference F = 54.8, P < .0001; resident competences F = 71.7, P < .0001).

Figure 1
Figure 1:
Relative weight of importance of competencies assigned by 68 experts to each of five palliative care domains. Developed from a survey of 71 palliative care experts (data from 3 participants were missing or not given).

Discussion

On the basis of a national survey of expert palliative care physician educators, we have defined comprehensive and essential palliative care competencies specifically for medical students and IM/FM residents that can be applied to standardize the content and assessment of palliative care curricula at both levels and that can be the basis for future research to validate new assessment tools for all levels of learners. The palliative care competencies derived from our survey were crafted to be specific, measurable, achievable, and relevant for each learner group and can be linked to existing ACGME competencies and standardized assessment tools already used in HPM fellowship training.33 Further, the developmental framework of the competencies is consistent with the ACGME’s New Accreditation System mandate to identify “milestones,” or educational outcomes that can be demonstrated by the learner as he or she progresses through novice and advanced beginner levels, toward proficient and expert levels of competency.39,40 As residency programs strive to meet new ACGME credentialing requirements, these new palliative care competencies may be used to define reportable educational outcomes.41,42

In addition, the essential medical student and resident competencies suggest a developmental sequence for teaching and assessing palliative care competencies over the course of medical education. Developmentally, medical students must first establish an ethical compass to use when caring for seriously ill patients, and integrate their clinical experiences and the meaning of this work into their identity as physicians.43 Building on this foundation, residents need to revisit and deepen the knowledge, skills, and attitudes defined in the essential student competencies. For example, residents must not only be able to explain palliative care but must also appropriately refer to hospice; residents need to not only recognize psychosocial distress but also evaluate and appropriately refer patients and families with such distress; and residents must not only reflect on their own emotional reactions to caring for patients at the end of life but also model self-reflection for their team. In addition, the essential resident competencies include more complex symptom management, patient-centered communication to clarify goals of care, and an understanding of how hospice and palliative care fit into the health care system. Assessment approaches could also reflect these developmental differences. For example, a standardized patient simulation could be used to assess medical student proficiency with an algorithm for delivering bad news, whereas a 360-degree evaluation might be used to assess a resident on multiple communication competencies after an interdisciplinary family meeting.

Understanding that undergraduate and graduate learners will be at different skill levels at different times, these new expert-derived competencies should be applied with flexibility during training, based on the individual trajectory of each learner. It would be anticipated, for example, that a second-year resident might have attained minimum-level competency in some palliative care competencies but, by the end of the residency training, should be required to attain minimum-level competency in all 13 of the essential competencies. The competencies can also be used to assess for gaps in training throughout the course of medical education, including continuing medical education for practicing physicians. For example, all practicing internists should be able to demonstrate all of the 13 essential competencies, and continuing medical education programs can target ones that may not have been addressed effectively during residency training.

Finally, this study reinforces the need to teach and reinforce patient-centered communication techniques and symptom management at all levels of training. Patients with serious or life-threatening illnesses consistently rate communication with their physician and symptom management as high priorities for their care.44 Therefore, rigorous physician training in these and other basic palliative care competencies will be essential to the development and implementation of patient-centered models of care delivery for seriously ill patients.45

This study has some limitations. The drafting of the proposed comprehensive competencies represented mainly the work of seven palliative care experts. However, we derived the medical student and residency competencies from the HPM fellowship competencies, which were vetted widely by expert palliative care physician educators and leaders in a separate iterative process. In addition, the 72% response rate and balanced demographics of the survey respondents support the generalizability of the outcomes. Finally, despite the important and highly valued role nonphysician members of the interdisciplinary team play in the training of medical students and residents, we decided not to include representation from other disciplines in the survey. We believe that defining competencies required for independent physician practice is best done by physician experts. A critical next step to maximize the impact of this project and disseminate the results will be to seek input and endorsement from stakeholders in the broader medical education community. This will then allow for optimal integration of the competencies into medical training.

In conclusion, using expert iterative review and a national survey, we have defined comprehensive and essential generalist-level palliative care competencies that are specific, measurable, and relevant and that can be integrated into undergraduate and graduate medical education in IM/FM. We propose that the academic medical community should “raise the bar” to require that all graduating medical students and IM/FM residents demonstrate a minimum level of competence in the five domains of palliative care. Introducing these competencies early and in a thoughtful developmental sequence may improve physicians’ sense of clinical efficacy in these essential areas and, more important, improve the quality of care for patients with serious or life-threatening illness.

References

1. Temel JS, Greer JA, Muzikansky A, et al. Early palliative care for patients with metastatic non-small-cell lung cancer. N Engl J Med. 2010;363:733–742
2. Morrison RS, Penrod JD, Cassel JB, et al. Cost savings associated with U.S. hospital palliative care consultation programs. Arch Intern Med. 2008;168:1783–1790
3. Meier DE. Increased access to palliative care and hospice services: Opportunities to improve value in health care. Milbank Q. 2011;89:343–380
4. Casarett D, Pickard A, Bailey FA, et al. Do palliative consultations improve patient outcomes? J Am Geriatr Soc. 2008;56:593–599
5. Lupu DAmerican Academy of Hospice and Palliative Medicine Workforce Task Force. . Estimate of current hospice and palliative medicine physician workforce shortage. J Pain Symptom Manage. 2010;40:899–911
6. McCormick E, Chai E, Meier DE. Integrating palliative care into primary care. Mt Sinai J Med. 2012;79:579–585
7. Weissman DE. Next gen palliative care. J Palliat Med. 2012;15:2–4
8. Quill TE, Abernethy AP. Generalist plus specialist palliative care—Creating a more sustainable model. N Engl J Med. 2013;368:1173–1175
9. von Gunten CF, Mullan P, Nelesen RA, et al. Development and evaluation of a palliative medicine curriculum for third-year medical students. J Palliat Med. 2012;15:1198–1217
10. Schulz C, Möller MF, Seidler D, Schnell MW. Evaluating an evidence-based curriculum in undergraduate palliative care education: Piloting a phase II exploratory trial for a complex intervention. BMC Med Educ. 2013;13:1
11. Morrison LJ, Thompson BM, Gill AC. A required third-year medical student palliative care curriculum impacts knowledge and attitudes. J Palliat Med. 2012;15:784–789
12. Radwany SM, Stovsky EJ, Frate DM, et al. A 4-year integrated curriculum in palliative care for medical undergraduates. Am J Hosp Palliat Care. 2011;28:528–535
13. Szmuilowicz E, el-Jawahri A, Chiappetta L, Kamdar M, Block S. Improving residents’ end-of-life communication skills with a short retreat: A randomized controlled trial. J Palliat Med. 2010;13:439–452
14. Fischer SM, Gozansky WS, Kutner JS, Chomiak A, Kramer A. Palliative care education: An intervention to improve medical residents’ knowledge and attitudes. J Palliat Med. 2003;6:391–399
15. Olden AM, Quill TE, Bordley D, Ladwig S. Evaluation of a required palliative care rotation for internal medicine residents. J Palliat Med. 2009;12:150–154
16. Sullivan AM, Lakoma MD, Billings JA, Peters AS, Block SDPCEP Core Faculty. . Teaching and learning end-of-life care: Evaluation of a faculty development program in palliative care. Acad Med. 2005;80:657–668
17. Claxton R, Marks S, Buranosky R, Rosielle D, Arnold RM. The educational impact of weekly e-mailed fast facts and concepts. J Palliat Med. 2011;14:475–481
18. Stevens DP, Jones DH, Salerno JA, Ryan BJ. A strategy for improvement in care at the end of life: The VA Faculty Leaders Project. J Palliat Med. 1999;2:5–7
19. Lloyd-Williams M, MacLeod RD. A systematic review of teaching and learning in palliative care within the medical undergraduate curriculum. Med Teach. 2004;26:683–690
20. Case AA, Orrange SM, Weissman DE. Palliative medicine physician education in the United States: A historical review. J Palliat Med. 2013;16:230–236
21. Weissman DE, Quill TE, Block SD. Missed opportunities in medical student education. J Palliat Med. 2010;13:489–490
22. Mullan PB, Weissman DE, Ambuel B, von Gunten C. End-of-life care education in internal medicine residency programs: An interinstitutional study. J Palliat Med. 2002;5:487–496
23. Leipzig RM, Granville L, Simpson D, Anderson B, Sauvigne K, Soriano R. “Don’t kill Granny.” A consensus on geriatric competencies for graduating medical students. Acad Med. 2009;84:604–610
24. Williams BC, Warshaw G, Fabiny AR, et al. Medicine in the 21st century: Recommended essential geriatrics competencies for internal medicine and family medicine residents. J Grad Med Educ. 2010;2:373–383
25. Hogan TM, Losman ED, Carpenter CR, et al. Development of geriatric competencies for emergency medicine residents using an expert consensus process. Acad Emerg Med. 2010;17:316–324
26. Buckley JD, Addrizzo-Harris DJ, Clay AS, et al. Multisociety task force recommendations of competencies in pulmonary and critical care medicine. Am J Respir Crit Care Med. 2009;180:290–295
27. Chapman DM, Hayden S, Sanders AB, et al. Integrating the Accreditation Council for Graduate Medical Education core competencies into the model of the clinical practice of emergency medicine. Ann Emerg Med. 2004;43:756–769
28. Ferrell B, Connor SR, Cordes A, et al.National Consensus Project for Quality Palliative Care Task Force Members. The national agenda for quality palliative care: The National Consensus Project and the National Quality Forum. J Pain Symptom Manage. 2007;33:737–744
29. National Consensus Project for Quality Palliative Care. Clinical Practice Guidelines for Quality Palliative Care. 20133rd ed http://www.nationalconsensusproject.org. Accessed February 6, 2014
30. Swing SR. The ACGME outcome project: Retrospective and prospective. Med Teach. 2007;29:648–654
31. Morrison LJ, Scott JO, Block SDfor the ABHPM Competencies Workgroup. . Developing initial competency-based outcomes for the hospice and palliative medicine subspecialist: Phase 1 of the hospice and palliative medicine competencies project. J Palliat Med. 2007;10:313–330
32. American Board of Hospice and Palliative Medicine (ABHPM) Competencies Workgroup. . Hospice and Palliative Medicine Core Competencies, Version 2.3. www.aahpm.org/pdf/competenciesv2_3.pdf. Accessed February 6, 2014
33. American Board of Hospice and Palliative Medicine (ABHPM) Competencies Workgroup. . Measureable Outcomes for Hospice and Palliative Medicine Competencies, Version 2.3. www.aahpm.org/pdf/measurableoutcomes2_3.pdf. Accessed February 6, 2014
34. Dillman DA, Smyth JD, Christian LM Internet, Mail and Mixed-Mode Surveys: The Tailored Design Method. 20093rd ed Hoboken, NJ John Wiley and Sons
35. Fowler FJ Survey Research Methods. 20094th ed Thousand Oaks, Calif Sage Publications
36. Doran GT. There’s a S.M.A.R.T. way to write management’s goals and objectives. Manage Rev. 1981;70:35–36
37. Weissman DE, Quill TE, Block SD. Missed opportunities in medical student education. J Palliat Med. 2010;13:489–490
38. American Board of Medical Specialties. . My doctor is board certified. Is yours? http://www.certificationmatters.org/. Accessed February 6, 2014
39. Batalden P, Leach D, Swing S, Dreyfus H, Dreyfus S. General competencies and accreditation in graduate medical education. Health Aff (Millwood). 2002;21:103–111
40. Goroll AH, Sirio C, Duffy FD, et al.Residency Review Committee for Internal Medicine. A new model for accreditation of residency programs in internal medicine. Ann Intern Med. 2004;140:902–909
41. Green ML, Aagaard EM, Caverzagie KJ, et al. Charting the road to competence: Developmental milestones for internal medicine residency training. J Grad Med Educ. 2009;1:5–20
42. Chang A, Bowen JL, Buranosky RA, et al. Transforming primary care training-patient-centered medical home entrustable professional activities for internal medicine residents. J Gen Intern Med. 2013;28:801–809
43. Rabow MW, Remen RN, Parmelee DX, Inui TS. Professional formation: Extending medicine’s lineage of service into the next century. Acad Med. 2010;85:310–317
44. Steinhauser KE, Clipp EC, McNeilly M, Christakis NA, McIntyre LM, Tulsky JA. In search of a good death: Observations of patients, families, and providers. Ann Intern Med. 2000;132:825–832
45. Rittenhouse DR, Shortell SM. The patient-centered medical home: Will it stand the test of health reform? JAMA. 2009;301:2038–2040
© 2014 by the Association of American Medical Colleges