Graduate Medical Education
Perspective: Beyond Counting Hours: The Importance of Supervision, Professionalism, Transitions of Care, and Workload in Residency Training
Schumacher, Daniel J. MD; Slovin, Sara R. MD, MSPH; Riebschleger, Meredith P. MD; Englander, Robert MD, MPH; Hicks, Patricia J. MD; Carraccio, Carol MD, MA
When this article was written, Dr. Schumacher was research fellow, Division of Emergency Medicine, Cincinnati Children’s Hospital Medical Center, Cincinnati, Ohio. He is now associate program director, Boston Combined Residency Program in Pediatrics, Boston, Massachusetts.
When this article was written, Dr. Slovin was general academic pediatrics fellow, Department of Pediatrics, Johns Hopkins University, Baltimore, Maryland.
When this article was written, Dr. Riebschleger was pediatric rheumatology and health services research fellow, Department of Pediatrics and Communicable Diseases, University of Michigan, Ann Arbor, Michigan. She is now clinical lecturer, University of Michigan Hospitals and Health System, Ann Arbor, Michigan.
Dr. Englander is senior director of competency-based learning and assessment, Association of American Medical Colleges, Washington, DC.
Dr. Hicks is professor of clinical pediatrics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania.
Dr. Carraccio is director of competency-based assessment programs, American Board of Pediatrics, Chapel Hill, North Carolina.
Correspondence should be addressed to Dr. Schumacher, Boston Medical Center, One Boston Medical Center Place, Boston, MA 02118; telephone: (608) 772-5905; e-mail: firstname.lastname@example.org.
The medical education community’s conversations about residents’ duty hours have long focused solely on the number of those hours. In July 2011, the Accreditation Council for Graduate Medical Education (ACGME) enacted its most recent iteration of standards regarding duty hours. Those standards, as well as a 2008 Institute of Medicine report, look beyond the quantity of duty hours to address their quality as well. Indeed, the majority of the 2011 ACGME standards specify requirements for the qualitative components of residents’ working and learning environments, including supervision of residents; professionalism, personal responsibility, and patient safety; transitions of care; and clinical responsibilities (including workload). The authors believe that focusing on these qualitative (rather than quantitative) components of the resident’s working and learning environment provides the greatest promise for balancing patient care with resident education, thus optimizing the safety and effectiveness of both. For each of the four qualitative components that the authors discuss (enhancing supervision, nurturing professionalism and personal responsibility, ensuring safe transitions of care, and optimizing workloads and cognitive loads), they offer agendas for faculty development, educational program planning, and research. Thus, the authors call on the medical education community to expand its discussion beyond counting duty hours to focus on these critical issues that ensure quality resident education and patient care and to implement necessary strategies to address them.
In 1984, Libby Zion, an 18-year-old college student, died under the care of resident physicians. Two years later, a grand jury indicted the practice of allowing inexperienced and undersupervised residents to care for patients. It also noted the contribution of residents’ long duty hours. In response, New York State’s Bell Commission worked for 18 months to develop new regulations for New York residents before releasing a final report in October 1987. Although these recommendations focused on the importance of supervision, they also called for capping the number of duty hours at 80 hours per week averaged over 4 weeks and 24 consecutive hours. Following this, New York enacted that state’s, and the nation’s, first regulations limiting residents’ duty
hours in 1989.1 Around the same time, the Accreditation Council for Graduate Medical Education (ACGME) began adopting duty hours requirements, but these were limited in both scope and to specific specialties; by 2003, they restricted duty hours for all specialties to 80 hours per week.2
The Imperative for Qualitative Change
Five years after the ACGME’s first widespread limitation of duty hours, the Institute of Medicine (IOM) published Resident Duty Hours: Enhancing Sleep, Safety, and Supervision,3 which, while calling for further reduction in the quantity of residents’ hours, also addressed their quality, calling for enhanced supervision, improved transitions of care and safety reporting, and optimized workloads and time for reflection.
Shortly after the IOM report’s release, the ACGME formed the Task Force on Quality Care and Professionalism.4 At a June 2009 national congress, the task force heard testimony from a range of 67 stakeholder organizations, including the American Medical Association, the Association of Pediatric Program Directors, and the Resident and Associate Society of the American College of Surgeons. After an additional year of study, the task force opened their proposed standards to public commentary, finalizing them in September 2010. These standards, effective since July 2011, limit the consecutive duty hours of interns to 16 and those of more senior residents to 24 plus an additional 4 hours for transition of care.4,5 Similar to the IOM report, however, they also extensively address components of the resident working and learning environment that affect the quality of hours worked, including standards for supervision; transitions of care; clinical responsibilities (including optimal workload); professionalism, personal responsibility, and patient safety; teamwork; and alertness management and fatigue mitigation.4,5
Emphasizing the focus beyond the quantity of duty hours elaborated by the IOM and the ACGME, we believe that addressing the quality, rather than quantity, of duty hours holds the greatest promise for optimizing the safety and efficacy of both patient care and resident education. Indeed, focusing on work conditions is imperative because even well-rested residents can place patients at risk when undersupervised or cognitively overloaded. Furthermore, fragmented duty hours may stifle the cultivation of personal responsibility and professionalism. Despite these considerations, much of the current discussion in graduate medical education continues to focus on the quantity of duty hours. Thus, in this article, we call on the medical education community to shift from counting hours to addressing the critical issue of the quality of those hours worked. After briefly acknowledging the case for duty hours restrictions, we will focus on four aspects of the qualitative changes required to optimize patient and trainee outcomes: supervision, professionalism and personal responsibility, transitions of care, and workload/cognitive load. In each of these areas, we will discuss agendas for faculty development, educational program planning, and research.
Acknowledging the Case for Duty Hours Restrictions
There is evidence that the number of consecutive hours that residents work impacts patients’ safety as well as residents’ own safety and education. Residents working more than 24 hours have been shown (when compared, in most of these references, with those working 16 hours or less) to be more likely to commit serious medical errors,6–8 make diagnostic errors,7,8 experience failures in attention,6,7 sustain sharps injuries,6,9 and crash while driving home from work.6,10 Longer shifts have also been related to burnout.11,12 They may also be inversely related to knowledge acquisition. Indeed, on-call shifts of 30 hours every fourth night have been associated with worse working memory capacity scores and commission of more math errors.13 Furthermore, this working memory capacity, as well as sleepiness, may be affected for three to four days after an overnight call.13,14
However, the literature has not been uniform. For example, Hanlon et al15 found essentially equal daytime sleepiness whether residents worked 12 to 16 hours or 24 hours, and Reimann and colleagues16 found no cognitive performance deficits in sleep-deprived neurology residents. Furthermore, Friesen et al17 found that increased fatigue among interns correlated not with hours worked but, rather, with perceived stress.
Because the literature is mixed, limiting residents’ hours must be carefully balanced with other requirements in their working and learning environment to achieve the primary goals of residency education: safe and effective patient care now and in the future and safe and effective resident education.18 Supervision, professionalism and personal responsibility, transitions of care, and workload/cognitive load become critical considerations in achieving this balance.
As early as the Bell Commission Report, supervision was prioritized over duty hours limits as a way to improve patient outcomes.19 Research has repeatedly demonstrated the benefits of attending supervision of residents’ patient care.20–24 For example, emergency medicine attending physicians’ supervision of nonemergency medicine second- and third-year residents resulted in frequent, clinically significant changes in patients’ care.22 Attending physicians in an internal medicine continuity clinic made essential changes in residents’ management plans for 27.4% of the patients they evaluated and at least some change for an additional 57.6% of these patients.23 Most recently, Baldwin and colleagues24 showed that residents’ reports of inadequate supervision are directly related to reports of medical errors, sleep deprivation, stress, depression, interpersonal conflicts at work, working while impaired, and observing others falsifying records and are inversely related to learning, overall satisfaction with residency, and quality time spent with attendings.
Given the relationship between supervision and both patient care outcomes and residents’ education and well-being, the IOM called for greater focus on supervision in their report.3 The 2011 ACGME standards, too, include explicit and expansive language on supervision,4,5 setting down numerous supervision requirements, including that (1) first-year residents must work under direct supervision (faculty present with resident) or indirect supervision (faculty available for immediate consultation), with direct supervision immediately available if needed, (2) faculty must receive supervision assignments that ensure their ability to assess residents, (3) programs must set guidelines for when residents are required to communicate with supervising faculty, and (4) supervising faculty must appropriately delegate patient care to residents on the basis of their abilities.
A recent national survey of residents revealed that only 25.3% felt that the 2011 ACGME standards would increase faculty supervision.25 Indeed, recent duty hours reductions in Canada resulted in decreased supervision.26 This underscores the need for a better understanding and actualization of effective supervision. The work of Kennedy and colleagues27,28 provides the foundation of current understanding in this area and informs the following agendas for faculty development, educational program planning, and research.
In addition to classifying supervision levels,27 Kennedy and colleagues have demonstrated that physicians dynamically gauge the supervision trainees need by assessing their trustworthiness, which comprises four observable components: skill and knowledge, truthfulness, discernment, and conscientiousness.28 Training faculty to assess trustworthiness by, for example, double-checking work and triangulating the information learners present with other data sources adds depth to their supervisory capabilities and should be pursued.
The Pediatrics Milestone Project29–31 provides another consideration for faculty development. The larger Milestone Project, a partnership of the ACGME and the member boards of the American Board of Medical Specialties, seeks to further define and refine the six ACGME competencies in the context of each specialty and will lead to the ACGME’s Next Accreditation System.32,33 To achieve this for pediatrics, the Pediatrics Milestone Project elaborates brief, narrative descriptions of behaviors expected of physicians as they progress from medical school through clinical practice as attendings.30 These clearly defined milestones serve as a roadmap for both faculty and learners, letting both groups see where learners stand along the developmental continuum and identify the next steps to be taken. The narrative descriptions of behaviors for each milestone also make it possible to develop video vignettes that can then be used to train faculty evaluators. This shared model of what learners look like at given stages in their professional development should not only enhance the ability of supervisors to accurately and reliably assess learners using direct observation but also equip them to provide appropriate supervision levels based on their learners’ developmental levels and the resultant needs for patient safety and optimal resident education.
Educational program planning
As noted in the 2011 ACGME standards, it is important that faculty receive assignments that make it possible for them to assess residents, appropriately delegate patient care based on those assessments, and know when to entrust residents with less supervision.4,5 This necessitates educational programs that emphasize continuity between resident, supervising physician, and the working and learning environment.34 Currently, assignments are often too short for faculty to adequately assess the developmental levels of a resident. This makes it hard to determine an appropriate level of supervision that ensures both patients’ safety and the resident’s professional development. In the future, faculty supervisors must receive assignments that are long enough to avoid these common problems.
The connection between supervision, trustworthiness, and the work of ten Cate and Scheele35 on entrustable professional activities provides a research agenda that translates theory into practice. Entrustable professional activities are the routine activities of physicians that define their specialty, such as a general pediatrician caring for a well newborn. In essence, they require the integration of competencies within a clinical context. “Entrustable” describes a professional activity that a supervisor judges a supervisee capable of performing without direct supervision. Thus, supervision becomes a meaningful way of assessing clinical competence, with level of supervision decreasing as level of competence increases. By studying specialty-specific milestones and the behaviors expected at each stage of physician development, one can paint a descriptive picture of entrustable behaviors along the continuum. Furthermore, studying the rate of progression of most learners through the milestones should enable early screening and identification of outliers who need remediation. Thus, this type of research provides great promise for informing and advancing the abilities of both supervisors and learners.
Nurturing Professionalism and Personal Responsibility
The 2011 ACGME standards that focus on professionalism and personal responsibility mandate that residents and faculty learn about being appropriately rested and fit for duty, putting patients’ needs above self-interests, and taking responsibility for their role in patient care.4,5 Meeting these standards requires professional identity formation, a developmental process that begins with aspirations and imitation of role models, then moves to seeing oneself as a member of the profession, further advances to developing one’s own professional identity, and culminates in seeing oneself as a professional.36 This progression of professionalization is marked by an ever-increasing sense of responsibility that catalyzes a tendency toward behaviors that exemplify professionalism and personal responsibility for patient care.
This process of professional identity formation that cultivates professionalism and personal responsibility in patient care almost certainly requires developing meaningful relationships with patients.37 Many have ascribed a potential loss of professionalism to duty hours restrictions, blaming them for fragmenting relationships and getting in the way of patient care “ownership.”38 However, patient care experiences had been fragmented even before duty hours restrictions by block, rather than longitudinal, training structures.39 As evidence against this typical block rotation design, Ogur and Hirsh37 demonstrated that students in a longitudinal clerkship were able to develop relationships with patients that inspired learning and led to a sense of providing superior care, a feeling of empowerment as a care provider, and a view of providing care as a privilege. Residents would likely experience the same benefits of greater continuity.
We know from the formation of professional identity that learners early in their development cannot be expected to immediately internalize the behaviors and personal responsibility of the profession—This comes with further development.36 It is important not to leave this maturation to chance but, instead, to explicitly help learners weave these characteristics into the fabric of their professional being. Explicitness is especially critical to move learners from simple imitation to true understanding and internalization of behaviors.36 Faculty who are trained to recognize the stages of professional identity formation can help learners further develop through feedback. They can also serve as role models, describing the rationale for their own behaviors, with an emphasis on important components of professionalism and personal responsibility, such as teamwork. Faculty should also engage learners in reflective dialogue to facilitate their internalization of professional identity.40
Educational program planning
As previously noted, continuity of care and longitudinal relationships are paramount when planning educational programs that promote the development of professionalism and personal responsibility.34,37 Greater continuity might be achieved by, among other things, moving from monthlong rotations to longer educational experiences,39 ensuring that primary care residents assume primary responsibility for a panel of patients over time, and letting surgical residents follow patients from clinic through surgery and into postoperative management and follow-up.
While professionalism and personal responsibility are aspects of residency training that are challenging to measure, we have much to gain from the development of valid and reliable metrics. The Milestone Project holds promise for guiding this work. Through defining and studying the developmental continuum of physician behaviors in areas of professionalism and personal responsibility, such as professional identity development and demonstrating a “responsiveness to patient needs that supersedes self-interest,”5 it will be possible to identify normative ranges for achieving each developmental milestone in these areas. As we described in the section on supervision, this will then help faculty and institutions to identify when learners’ development is delayed, prompting a structured intervention informed by the relevant research.
Ensuring Safe Transitions of Care
Recent years have seen an increased focus on transitions of care and ensuring patient safety when handoffs occur, as highlighted by the inclusion of handoffs as a Joint Commission National Patient Safety Goal.41 Likewise, the 2011 ACGME standards require minimizing transitions when designing care structures, ensuring and monitoring structured handoff processes, ensuring that residents are competent in handoff communication, and guaranteeing that all caregivers can identify the attending physicians and residents primarily responsible for patients.4,5
The interest in improving handover quality is deeply rooted in patient safety. Ineffective handovers, often the result of communication failures, lead to adverse events for patients. Studying internal medicine residents, Arora and colleagues42 found that communication failures during handovers were most often omissions of content pertinent to caring for the patient (such as active problems or current medications and treatments) or failure-prone communication strategies (such as not performing handovers face-to-face or a “double sign-out” within a few hours). Indeed, a recent survey of pediatric residents found that almost 73% of the respondents had experienced uncertainty regarding a patient care plan because of an incomplete verbal handoff, and only 19% reported that written sign-outs were up-to-date when their shifts began.43 Demonstrating that communication failures are likely magnified when learners perform handovers, Petersen et al44 found that patients suffering potentially preventable adverse events were much more likely to be cared for by cross-covering residents, especially interns. Escalating this concern is the report that interns at some programs are left to do handovers alone.45
Ensuring successful transitions of care through faculty development is elusively straightforward. Faculty themselves must learn how to perform handovers successfully and systematically so that they can model the necessary communication skills and assess them in their learners and peers. Although this agenda is clear, the best structure and setting for successful and systematic handovers remain unclear, necessitating further research.
Educational program planning
The 2011 ACGME standards provide an excellent foundation for an educational program planning agenda, including requirements to minimize transitions when designing care structures, monitor structured handover processes, and ensure that residents are competent in handover communication.4,5 There are myriad considerations for achieving these goals. For example, inpatient transitions can be minimized through work schedules that avoid “short call” shifts where residents care for patients for only a few hours. When transitions must occur, it is important to not only train residents in structured handovers but also train senior residents and faculty to observe and refine others’ skills. In addition, schedules should be structured so that interns and senior residents transition at the same time, improving the likelihood of both role modeling and oversight.
The literature presents many models for teaching and assessing handovers,41,46 but few studies have evaluated the quality of handovers.47 Thus, the primary research agenda for handovers must include (1) elucidating the critical components to safe handover communication, (2) understanding the ideal conditions (e.g., time, location, optimal members of the health care team), and (3) identifying the key knowledge, skills, and attitudes that learners must gain before being entrusted to perform handovers without direct supervision. Fortunately, national efforts are currently under way to address the first two agenda items,48 and the Milestone Project and concept of entrustable professional activities hold promise for addressing the third item.
Optimizing Workloads and Cognitive Loads
The 2011 ACGME standard for clinical responsibility states that “responsibilities for each resident must be based on [post-graduate year]-level, patient safety, resident education, severity and complexity of patient illness/condition and available support services.”5 Inherent to this standard is the consideration of both workload and cognitive load.
Fieldston et al49 suggest that residents’ workloads increase with the number of patients on their census; the acuity and complexity of those patients; the number of patient turnovers through admissions, discharges, and transfers; the nongeographic grouping of patients within the hospital; the number of attending/supervising physicians; the number of handovers; and lower levels of ancillary services or other system inefficiencies. Some of these factors refer to workload and others to cognitive load, which is the amount of mental energy required for the working memory to process information. Compounding a heavy workload with a heavy cognitive load, as often occurs in the resident’s working and learning environment, can incapacitate residents and place both patient care and resident learning at risk.
Cognitive load can be divided into germane load—the mental energy spent processing and developing a framework for thinking about something; intrinsic load—the mental energy required because of the inherent difficulty and complexity of the material; and extraneous load—the mental energy required because of the way the material is presented.50 All learners can be burdened by intrinsic and extraneous loads, but early learners, because of their limited experience, also face a heavy germane load, making cognitive load especially important when considering this group’s workload.
Haney and colleagues51 have proposed a theoretical model of how residents learn in which the relationship between learning and workload (or patient care load) follows a parabolic curve. Learning increases along with workload until it reaches an optimal point, after which learning begins to decrease as workload continues to increase. Studying this hypothesized model, they found that internal medicine interns reported learning best when they had about three patients on their census and no new admissions. Senior residents felt that optimal learning occurred with six or seven patients on their census and six new admissions.
Although interns cannot optimally learn with zero admissions,51 the findings of Haney et al underscore the weight that each new patient adds to learners’ cognitive loads and workloads. This consideration is especially important in the context of the 2011 ACGME standards because further limiting duty hours may, by compressing work,52 unintentionally increase cognitive loads and workloads.
Faculty understanding of the complex interplay between cognitive load and workload is critically needed. Although faculty supervisors are often keenly aware of the impact of some elements of workload, such as high census, high acuity, geographic dispersion of patients, and high patient turnover, they may not be as familiar with cognitive load theory. Faculty should be taught to identify situations where learners are at risk for cognitive overload and how to employ mitigating strategies in those situations. One such strategy is explicitly teaching learners how faculty experts mentally organize disease features, a proactive technique that, by enhancing the knowledge content and structure that residents use in their clinical reasoning,53 can decrease their germane cognitive load (the mental energy spent processing and developing a framework for thinking about something).
Educational program planning
The recent 16-hour duty restrictions for interns have been shown to increase work compression,52 which increases both cognitive load and workload. As institutions adjust to these changes, it will be important to identify mitigating strategies. Although the work of Haney et al51 could be used to support capping the number of patients and new admissions for learners, focusing only on numbers of patients is an oversimplification. Rather, all the workload components proposed by Fieldston et al49 (patient numbers and turnovers, acuity/complexity, handover frequency, system inefficiencies, etc.) should be considered when developing and implementing educational programs and resident team structures.
The three types of cognitive load should also be considered when designing the educational environment. For example, extraneous load can be decreased by creating electronic medical records that avoid confusing and overly exhaustive notes in favor of more streamlined and reader-friendly formats. Germane load can be lightened by faculty explicitly modeling the steps in clinical decision making, as noted previously. Finally, balancing the distribution of more complex patients among multiple learners can help address intrinsic load.
Measuring workload in the clinical setting is complex, with its many elements that relate to patients (number, complexity, acuity, ebb and flow), the work environment (geographic cohorting, administrative tasks, patient-care-related tasks), the learner (development of clinical reasoning skills, working memory for the clinical context, fatigue and wellness factors), and the supervisor (presence, expertise). Understanding how these elements, as well as their combination and interactions, impact cognitive load and workload provides a rich research agenda.
Moving Beyond Duty Hours
Recent recommendations and standards from the IOM and ACGME highlight the need to focus on the qualitative aspects of residents’ working and learning environments rather than solely on the quantity of hours worked. We must follow this lead and expand our conversations to address these critical qualitative components of a resident’s time at work. The challenges are undoubtedly great. However, from challenge comes opportunity. If we focus on these qualitative aspects of residency education and study the impact of the 2011 ACGME standards that address them, there is great promise that we can significantly improve outcomes both for our learners and for their patients.
Funding/Support: At the time this article was written, Dr. Slovin was supported by a Health Research and Service Administration National Research Service Award (T32HP10004), and Dr. Riebschleger was supported by a National Institute of Child Health and Human Development institutional research training grant (T32HD07534).
Other disclosures: None.
Ethical approval: Not applicable.
1. Bell B. Reconsideration of the New York State laws rationalizing the supervision and the working conditions of residents. Einstein J Biol Med. 2003;20:36–40
2. Philibert I, Friedmann P, Williams WT. New requirements for resident duty hours. JAMA. 2002;288:1112–1114
3. Ulmer C, Wolman DM, Johns MM. Institute of Medicine Resident Duty Hours: Enhancing Sleep, Supervision and Safety. 2009 Washington, DC National Academies Press
4. Philibert I, Amis Sand the ACGME Task Force on Quality Care and Professionalism. . The ACGME 2011 Duty Hour Standards: Enhancing Quality of Care, Supervision, and Resident Professional Development. 2011 Chicago, Ill Accreditation Council for Graduate Medical Education
6. Lockley SW, Barger LK, Ayas NT, et al. Effects of health care provider work hours and sleep deprivation on safety and performance. Jt Comm J Qual Patient Saf. 2007;33:7–18
7. Lockley SW, Landrigan CP, Barger LK, Czeisler CA. When policy meets physiology: The challenge of reducing resident work hours. Clin Orthop Relat Res. 2006;449:116–127
8. Landrigan CP, Rothschild JM, Cronin JW, et al. Effect of reducing interns’ work hours on serious medical errors in intensive care units. N Engl J Med. 2004;351:1838–1848
9. Ayas NT, Barger LK, Cade BE, et al. Extended work duration and the risk of self-reported percutaneous injuries in interns. JAMA. 2006;296:1055–1062
10. Barger LK, Cade BE, Ayas NT, et al. Extended work shifts and the risk of motor vehicle crashes among interns. N Engl J Med. 2005;352:125–134
11. Golub JS, Weiss PS, Ramesh AK, Ossoff RH, Johns MM. Burnout in residents of otolaryngology–head and neck surgery: A national inquiry into the health of residency training. Acad Med. 2007;82:596–601
12. Martini S, Arfken CL, Balon R. Comparison of burnout among medical residents before and after the implementation of work hours limits. Acad Psychiatry. 2006;30:352–355
13. Gohar A, Adams A, Gertner E, et al. Working memory capacity is decreased in sleep-deprived internal medicine residents. J Clin Sleep Med. 2009;5:191–197
14. Rose M, Manser T, Ware JC. Effects of call on sleep and mood in internal medicine residents. Behav Sleep Med. 2008;6:75–88
15. Hanlon JG, Hayter MA, Bould MD, Joo HS, Naik VN. Perceived sleepiness in Canadian anesthesia residents: A national survey. Can J Anaesth. 2009;56:27–34
16. Reimann M, Manz R, Prieur S, Reichmann H, Ziemssen T. Education research: Cognitive performance is preserved in sleep-deprived neurology residents. Neurology. 2009;73:e99–e103
17. Friesen LD, Vidyarthi AR, Baron RB, Katz PP. Factors associated with intern fatigue. J Gen Intern Med. 2008;23:1981–1986
18. Guralnick S, Rushton J, Bale JF, Norwood V, Trimm RF, Schumacher DJ. The response of the APPD, CoPS and AAP to the Institute of Medicine report on resident duty hours. Pediatrics. 2010;125:786–790
19. Bell B. Supervision, not regulation of hours, is the key to improving the quality of patient care. JAMA. 1993;269:403–404
20. Schmidt UH, Kumwilaisak K, Bittner E, George E, Hess D. Effects of supervision by attending anesthesiologists on complications of emergency tracheal intubation. Anesthesiology. 2008;109:973–977
21. Kroboth FJ, Brown FH, Stewart R, Karpf R, Karpf M, Levey GS. Impact of attending level supervision of the emergency department experience. Ann Emerg Med. 1982;11:192–196
22. Holliman CJ, Wuerz RC, Kimak MJ, et al. Attending supervision of nonemergency medicine residents in a university hospital ED. Am J Emerg Med. 1995;13:259–261
23. Gennis VM, Gennis MA. Supervision in the outpatient clinic: Effects on teaching and patient care. J Gen Intern Med. 1993;8:378–380
25. Drolet BC, Spalluto LB, Fischer SA. Residents’ perspectives on ACGME regulation of supervision and duty hours—A national survey. N Engl J Med. 2010;363:e34
26. Bismilla Z, Breakey VR, Swales J, et al. Prospective evaluation of residents on call: Before and after duty-hour reduction. Pediatrics. 2011;127:1080–1087
27. Kennedy TJT, Lingard L, Baker GR, Kitchen L, Regehr G. Clinical oversight: Conceptualizing the relationship between supervision and safety. J Gen Intern Med. 2007;22:1080–1085
28. Kennedy TJT, Regehr G, Baker GR, Lingard L. Point-of-care assessment of medical trainee competence for independent clinical work. Acad Med. 2008;83(10 suppl):S89–S92
30. Hicks PJ, Schumacher DJ, Benson, et al. The pediatrics milestones: Conceptual framework, guiding principles, and approach to development. J Grad Med Educ.. 2010;2:410–418
31. Hicks PJ, Englander R, Schumacher DJ, et al. Pediatrics milestone project: Next steps toward meaningful outcomes. J Grad Med Educ.. 2010;2:577–584
32. Nasca T. Where will the ‘milestones’ take us? The next accreditation system. ACGME Bull. September 2008
33. Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system—Rationale and benefits. N Engl J Med. 2012;366:1051–1056
34. Hirsh DA, Ogur B, Thibault GE, Cox M. “Continuity” as an organizing principle for clinical education reform. N Engl J Med. 2007;356:858–866
35. ten Cate O, Scheele F. Competency-based postgraduate training: Can we bridge the gap between theory and clinical practice? Acad Med. 2007;82:542–547
36. Forsythe GB. Identity development in professional education. Acad Med. 2005;80(10 suppl):S112–S117
37. Ogur B, Hirsh D. Learning through longitudinal patient care—Narratives from the Harvard Medical School–Cambridge integrated clerkship. Acad Med. 2009;84:844–850
38. Reed DA, Levine RB, Miller RG, et al. Effect of residency duty-hour limits: Views of key clinical faculty. Arch Intern Med. 2007;167:1487–1492
39. Holmboe E, Ginsburg S, Bernabeo E. The rotational approach to medical education: Time to confront our assumptions? Med Educ. 2010;45:69–80
40. Rabow MW, Remen RN, Parmelee DX, Inui TS. Professional formation: Extending medicine’s lineage of service into the next century. Acad Med. 2010;85:310–317
41. Arora V, Johnson J. A model for building a standardized hand-off protocol. Jt Comm J Qual Patient Saf. 2006;32:646–655
42. Arora V, Johnson J, Lovinger D, Humphrey HJ, Meltzer DO. Communication failures in patient sign-out and suggestions for improvement: A critical incident analysis. Qual Saf Health Care. 2005;14:401–407
43. McSweeney ME, Lightdale JR, Vinci RJ, Moses J. Patient handoffs: Pediatric resident experiences and lessons learned. Clin Pediatr (Phila). 2010;50:57–63
44. Petersen LA, Brennan TA, O’Neil AC, Cook EF, Lee TH. Does housestaff discontinuity of care increase the risk for preventable adverse events? Ann Intern Med. 1994;121:866–872
45. Horwitz LI, Frumholz HM, Green ML, Huot SJ. Transfers of patient care between house staff on internal medicine wards: A national survey. Arch Intern Med. 2006;166:1173–1177
46. Kalet A, Pugnaire MP, Cole-Kelly K, et al. Teaching communication in clinical clerkships: Models from the Macy initiative in health communications. Acad Med. 2004;79:511–520
47. Raduma-Tomas MA, Flin R, Yule S, Willaims D. Doctors’ handovers in hospitals: A literature review. BMJ Qual Saf. 2011;20:128–133
48. Agency for Healthcare Research and Quality. . TEAMSTEPPS: National Implementation. 2012 http://teamstepps.ahrq.gov/
Accessed March 6
49. Fieldston ES, Zaoutis L, Hicks P, et al. Framework for Quantifying & Matching Workload & Workforce in Healthcare Settings. Poster presented at: Pediatric Academic Societies Annual Meeting. April 30, 2011 Denver, Colo
50. Sweller J, van Merrienboer JJGPaas FGWC. . Cognitive architecture and instructional design. Educ Psychol Rev. 1998;10:251–296
51. Haney EM, Nicolaidis C, Hunter A, Chan BKS, Cooney TG, Bowen JL. Relationship between resident workload and self-perceived learning on inpatient medicine wards: A longitudinal study. BMC Med Educ. 2006;6:35
52. Tessing S, Amendt A, Jennings J, Thomson J, Auger KA, Gonzalez del Rey JA. One possible future for resident hours: Interns’ perspective on a one-month trial of the Institute of Medicine recommended duty hour limits. J Grad Med Educ. 2009;1:185–187
53. Cutrer WB, Castro D, Roy KM, Turner TL. Use of an expert concept map as an advance organizer to improve respiratory failure understanding. Med Teach. 2011;33:1018–1026
This article has been cited 2 time(s).
Bmj Quality & SafetySelf-reported patient safety competence among new graduates in medicine, nursing and pharmacyBmj Quality & Safety
Academic RadiologyIntroductory Lecture Series for First-Year Radiology Residents: Implementation, Investment and AssessmentAcademic Radiology
© 2012 Association of American Medical Colleges
What does "Remember me" mean?
By checking this box, you'll stay logged in until you logout. You'll get easier access to your articles, collections,
media, and all your other content, even if you close your browser or shut down your
To protect your most sensitive data and activities (like changing your password),
we'll ask you to re-enter your password when you access these services.
What if I'm on a computer that I share with others?
If you're using a public computer or you share this computer with others, we recommend
that you uncheck the "Remember me" box.
Data is temporarily unavailable. Please try again soon.