Further refinement of the competencies occurred as part of the July 2007 Association of American Medical Colleges (AAMC)/JAHF Consensus Conference on Competencies in Geriatric Education. A separate Conference Advisory Committee† was responsible for planning and facilitating the July 11–13, 2007 conference. This committee was convened by M. Brownell Anderson, principal investigator (PI) of the consensus conference grant from the JAHF to the AAMC, and comprised medical school faculty who had been PIs on the previous AAMC/JAHF grants, had participated in ongoing work with senior mentors programs, and had sustained their geriatrics initiatives at their schools after grant funding ended.10 They were selected on the basis of their willingness to participate and assist with the final documents from the working groups and their ability to facilitate a group. Committee members participated in drafting the conference agenda, leading the discussion groups, capturing the outcomes of the group discussion, and presenting outcomes to the larger group.
Content Domain Identification and Creating an Alpha Draft
As depicted in Table 1, in early 2007, the Steering Committee compiled a list of 52 nonmutually exclusive geriatric content domains from previously created curricular documents. To reduce the number to 25 domains, 38 other leaders in geriatric medical education took an online survey during February 2007, ranking each domain using a five-point Likert scale (1 = strongly disagree; 3 = neutral; 5 = strongly agree). Points were summed for each potential domain, with a maximum of 190 if all respondents strongly agreed that the domain was important and a score of 152 if all simply agreed. For the 25 top-scoring domains, scores ranged from 157 to 188, indicating that most participants agreed or strongly agreed that these were important. The Steering Committee then engaged in a collaborative online process (ending March 16, 2007) to assure that the domain names were clear and unique, resulting in 23 domains. Another online survey was posted (ending March 28, 2007), and we invited approximately 325 “geriatrically interested” individuals (members of Association of Directors of Geriatric Academic Programs, the PIs of Reynolds grants and of the JAHF geriatric Centers of Excellence, and the geriatric interest groups of the Society of General and Internal Medicine and the Society of Teachers of Family Medicine) to mark the 8 of these 23 domains they considered most important for medical students to learn about. One hundred seventeen respondents chose the following domains: (1) Medication Management, (2) Altered Mental Status: Delirium, Dementia and Depression, (3) Functional Assessments, (4) Falls, Balance, Gait Disorders, (5) Prevention Based on Function, (6) (Atypical) Presentation of Disease, (7) Palliative Care, and (8) Hospital Care for Elders.
During April, the Steering Committee derived three to five competencies for each content domain drawing from those developed by FCGME, Mount Sinai School of Medicine, and Florida State University. These competencies were posted on the Portal of Geriatric Online Education (www.pogoe.org) in a series of “wikis” that were open until May 2, 2007. Wikis are accessible online workspaces for asynchronous collaboration that allow users to exchange information, add data or examples, expand or challenge ideas, and maintain an accessible archive of communications during project development. This process allowed Steering Committee members to share, review, and comment on past and current revisions of these competencies at their own pace. Each member of the committee was able to see all edits, comments, and rationales. A final conference call in May 2007 resulted in agreement on an alpha draft comprising 35 potential competencies for the eight content domains.
Content Validity: E-Vetting the Alpha Draft With Key Stakeholders
We then surveyed three groups of key stakeholders/informants to ascertain the content validity of these 35 competencies for new interns. Stakeholders included residency program directors responsible for the care provided by interns and those with special interest in geriatrics (program directors of geriatric academic programs, the geriatric interest groups in internal medicine and family medicine, the American Geriatrics Society's Education Committee, and the PIs of D.W. Reynolds Aging and Quality of Life Program grants and the JAHF Center of Excellence in Geriatrics awards), and key informants included those responsible for the training of medical students—that is, clerkship directors in internal medicine and family medicine and deans of medical education and curriculum.
The Steering Committee developed and pilot tested an online survey that asked these key stakeholders and informants to indicate, for each of the 35 competencies, if an intern must, should, or does not need to be able to perform that competency at the start of his or her first postgraduate year. Professional associations facilitated distribution of invitations containing a direct link to the survey by direct personal e-mail listserves, or newsletter announcements to at least 1,857 individuals. The final online survey was conducted between May 14 and June 8, 2007.
There were 315 survey respondents: 26% geriatricians (n = 81), 21% family physicians (n = 67), 24% general internists (n = 77), 6% neurology program directors (n = 20), 14% general surgery program directors (n = 43), and 9% other (n = 28). Of the survey respondents, 24 were decanal appointees responsible for medical student education (e.g., associate dean for medical student education, assistant dean for curriculum). For each competency, we averaged the percentages of all respondents who replied must or should.
More than 75% of key informants reported that interns must or should be competent in 24 of the 35 competencies. Of the remaining 11 competencies, at least 58% of respondents indicated must or should for each (median 66%; range 58–74%). To compare responses by discipline, “agreement” was defined as >70% of a specialty's respondents indicating that their interns must or should have this competency at the start of their internship (i.e., ≤30% said that interns do not need this competency). Using this definition, general surgery agreed with 69% of the competencies (the lowest rate of agreement), whereas geriatrics had the highest rate, 94% (Figure 1).
The content validity process was robust, involving more than 300 clinicians, the majority of whom were not geriatricians. Many, but not all, disciplines who offer a postgraduate year one were represented in the process, with some specialties like pediatrics excluded because of relevance, and others, like otolaryngology, excluded because of small numbers of respondents. The short turnaround time for survey responses and/or the distribution list requirements of selected program director organizations limited access to adequate numbers of program directors in obstetrics-gynecology, psychiatry, or emergency medicine. Response rates to our e-mail invitations (embedded in the society's electronic newsletters and e-mail blasts) were low. Those who responded probably had the strongest predilection for geriatrics, but they also are most likely to be able to identify the critical competencies.
The alpha competency draft and content validity survey results served as the focus for a 2.5-day working conference attended by 98 people who responded to a combination of targeted invitations and general announcements about the conference. An HTML e-mail message was sent to more than 3,000 medical school faculty at all U.S. and Canadian medical schools involved in the 40 AAMC/JAHF educational programs for medical students. In addition, announcements of the conference were printed and distributed at the regional meetings of the AAMC Group on Educational Affairs and posted to the newsletters of the Society of Teachers of Family Medicine and the Association of Clerkship Directors. There was no application process, and participants paid their own way to attend the conference and covered registration fees from their own budgets, so all in attendance were there out of interest in the topic.
Participants represented 57 different U.S. medical schools and included representatives from the American Medical Association, the AAMC, the Canadian Geriatrics Society, the American Geriatrics Society, the Society of General Internal Medicine, and the American Medical Directors Association. Conference participants represented the specialties of geriatrics, gerontology, internal medicine, family medicine, and psychiatry and included those with roles as ambulatory providers, hospitalists, curriculum deans, clerkship directors, and program directors. Participants were preassigned to working groups to provide breadth of perspectives. The consensus conference participants used the key informants' results to inform their deliberations; however, they were not bound by them. Each working group was facilitated by members of the Conference Advisory Committee, focused on two competency domains, and was charged with developing, for each content domain, a final list of two to five competencies appropriate for graduating medical students that realistically could be achieved by all U.S. medical schools. During the conference, each working group's domain(s) and competencies were vetted and revised by the rest of the conference participants to broaden consensus. Conference participants changed three domain names to better capture the intended scope. (Altered Mental Status: Delirium, Dementia and Depression became Cognitive and Behavioral Disorders; Functional Assessments became Self-Care Capacity; and Prevention Based on Function became Health Care Planning and Promotion.)
Finalizing the Competencies
After the conference, members of the Steering and Conference Advisory Committees reviewed the final competencies and associated domains to provide consistency in terminology and to assure that the competencies were performance oriented and measurable and that they followed from the statement, “The graduating medical student, in the context of a specific older adult patient scenario (real or simulated), must be able to….”
The reframed competencies were then circulated to the conference working group leaders associated with that domain for review and comment. Competencies were revised, and the final document was then circulated electronically to all conference participants for their approval. Ninety-three percent have responded; all approved the final document. The final document consists of 26 competencies nested within the eight content domains (List 2).
Reflections and Future Work
The eight domains and 26 competencies identified through a multimethod consensus process present the floor—a minimum standard for performance—not a ceiling. Faculty from almost half (44%) of U.S. medical schools and representatives of several major medical education organizations participated in the consensus conference, with significant participation from other key informants across specialties during the initial competency development process.
For each domain, the specific competencies identify observable behaviors that medical students must demonstrate to prove competency. The importance of synthesis and integration, obtaining corroborating information, and working with caregivers and with the interdisciplinary care team has been made explicit within the appropriate competencies. Other behaviors and actions are less explicit, recognizing the limitations of measurement and medical school resources. For example, a competency that states “Interact with older adults without exhibiting ageism” might be difficult to evaluate, yet it can and should be addressed through instructional methods and strategies because it is a critical affective objective for all physicians and underlies many of the competencies listed.
Recognizing that the medical school curriculum is overwhelmed with “new” content areas (e.g., genomics, bioterrorism, quality improvement, global health), our highest priority was to minimize the number of competencies. For this reason, certain competencies in the alpha draft, such as the transient causes of urinary incontinence, did not make the final version. Others, such as frailty, were eliminated because of the lack of an agreed-on gold standard for diagnosis, whereas theories of aging were considered irrelevant to the care provided by a new intern. Consensus was achieved on the standard requiring that all students be competent in assessing gait, mental status, and function, but there was marked resistance at the consensus conference to requiring the use of a standardized tool for doing this, so the method of patient assessment was omitted.
For the last several years, the term “competency” in medical education has been assumed to refer to the six Accreditation Council for Graduate Medical Education (ACGME) competencies: medical knowledge, patient care, practice-based learning and improvement, interpersonal and communication skills, professionalism, and systems-based practice.11 However, the term “competency” has a long history in education as the term used to refer to required performance associated with a task/job. Although the medical student geriatric competencies were not written to fit specific ACGME competencies, each geriatric competency does match at least one of the six ACGME domains. For example, “Develop an evaluation and nonpharmacologic management plan for agitated demented or delirious patients” could be considered patient care (in the context of an actual observed patient encounter), medical knowledge (as an examination question), interpersonal and communication skills (as an OSCE station dealing with the family and/or staff), professionalism (as a 360-degree evaluation from the student's patient-care team), or systems-based practice (working with nursing to develop a protocol for nonpharmacologic management), depending on how a particular school has framed the ACGME competency domains and its curriculum.
The next steps in the process of incorporating these competencies into medical school curricula and in achieving the IOM goal of building a workforce competent to care for an aging America seem clear. Specific evaluation tools must be identified and, if necessary, developed, and a tracking system must be established to support medical schools' achievement of these competencies. Concurrently, the competencies we present provide a starting place for determining which additional proficiencies would be expected of the residents, fellows, and practicing physicians in every discipline, as performance expectations in medical training increase by training levels. For example, medical students have neither prescribing privileges nor primary responsibility for a patient's care; competencies for residents would need to explicitly address these added roles. Additionally, we view these competencies as dynamic, not static, and we recommend that these standards be reconsidered every five years to incorporate new knowledge, models of care, and changes in medical education.
All medical educators share a common goal of excellence in medical education and trainee performance. The systematic, multimethod approach to achieving consensus on minimum standards presented in this paper presents a model in the stepwise progression of competency-based education in geriatrics. The proceedings from the AAMC/JAHF Geriatrics Consensus Conference will be disseminated as part of the series of reports from the AAMC's Medical School Objectives Project. Medical students' achievement of these minimum competencies, grounded in evidence-based principles of quality care for older adults, will assure that, each year, older patients are in safer hands on July 1.
This work was funded by grants from the John A. Hartford Foundation to the Association of American Medical Colleges and by the American Geriatrics Society to the Mount Sinai School of Medicine.
1 U.S. Department of Health and Human Services, Health Resources and Services Administration, Bureau of Health Processions National Center for Health Workforce Analysis. Exhibit 2.11. Estimated percentage of physician's time spent providing care to patients, by age of patient. In: Changing Demographics: Implications for Physicians, Nurses, and Other Health Workers. Section 2: Aging of the Population. Available at: (http://bhpr.hrsa.gov/healthworkforce/reports/changedemo/images/2.11.htm
). Accessed January 23, 2009.
2 Institute of Medicine. Retooling for an Aging America: Building the Health Care Workforce. Washington, DC: The National Academies Press; 2008.
3 The Education Committee Writing Group of the American Geriatrics Society. Core competencies for the care of older patients: Recommendations of the American Geriatrics Society. Acad Med. 2000;75:252–255.
4 Warshaw G, Murphy J, Buehler J, Singleton S; Residency Assistance Program/Hartford Geriatrics Initiative. Geriatric medicine training for family practice residents in the 21st century: A report from the Residency Assistance Program/Hartford Geriatrics Initiative. Fam Med. 2003;35:24–29.
7 Granville LJ, Roos BA. Framework for developing a competency-based model for geriatric undergraduate medical education (UME): Florida's statewide collaboration. J Am Geriatr Soc. 2004;52(suppl 1):S84.
8 Goroll AH, Morrison G. Generalist clinical competencies. In: Core Medicine Clerkship Curriculum Guide: A Cooperative Project of the Society of General Internal Medicine and the Clerkship Directors in Internal Medicine. 2nd ed. 1998;9–17.
9 Anderson MB, ed. The AAMC-Hartford Geriatric Curriculum Program: Reports from 40 schools. Acad Med. 2004;79(7 suppl):S1–S226.
10 Eleazer GP, Wieland D. Senior mentorship in basic medical education developing programs for the teaching of aging. Gerontol Geriatr Educ. 2006;27:1–103.
∗M. Brownell Anderson (Association of American Medical Colleges), Rosanne M. Leipzig, MD, PhD (Mount Sinai School of Medicine), Lisa Granville, MD (Florida State University College of Medicine), Rainier P. Soriano, MD (Mount Sinai School of Medicine), G. Paul Eleazer, MD (University of South Carolina School of Medicine), Nathan Flacker, MD (Emory University School of Medicine), Bree Johnston, MD, MPH (UCSF School of Medicine), Sharon Levine, MD (FSU College of Medicine), Michael Mintzer, MD (University of Miami School of Medicine), Carol Reis-Starr, PhD (Emory University School of Medicine), Robert Rohrbaugh, MD (Yale University), Dan Swagerty, MD, MPH (University of Kansas Medical Center), Glenda Westmoreland, MD, MPH (Indiana University School of Medicine), Karen Sauvigné, MA (Mount Sinai School of Medicine).
†Edmund H. Duthie, Jr, MD (Medical College of Wisconsin), Maureen Dever-Bumba, DrPH, MSN, FNP-C (University of South Carolina School of Medicine/Palmetto Health), Mitchell T. Heflin, MD (Duke University School of Medicine), Michael Hosokawa, EdD (University of Missouri School of Medicine), Steven Zweig, MD, MSPH (University of Missouri-Columbia School of Medicine).© 2009 Association of American Medical Colleges