Secondary Logo

Journal Logo

Constructing a Shared Mental Model for Faculty Development for the Core Entrustable Professional Activities for Entering Residency

Favreau, Michele A., PhD, MSEd, MACM; Tewksbury, Linda, MD; Lupi, Carla, MD; Cutrer, William B., MD, MEd; Jokela, Janet A., MD, MPH; Yarris, Lalena M., MD, MCR for the AAMC Core Entrustable Professional Activities for Entering Residency Faculty Development Concept Group

doi: 10.1097/ACM.0000000000001511
Articles
Free
SDC

In 2014, the Association of American Medical Colleges identified 13 Core Entrustable Professional Activities for Entering Residency (Core EPAs), which are activities that entering residents might be expected to perform without direct supervision. This work included the creation of an interinstitutional concept group focused on faculty development efforts, as the processes and tools for teaching and assessing entrustability in undergraduate medical education (UME) are still evolving. In this article, the authors describe a conceptual framework for entrustment that they developed to better prepare all educators involved in entrustment decision making in UME. This framework applies to faculty with limited or longitudinal contact with medical students and to those who contribute to entrustment development or render summative entrustment decisions.

The authors describe a shared mental model for entrustment that they developed, based on a critical synthesis of the EPA literature, to serve as a guide for UME faculty development efforts. This model includes four dimensions for Core EPA faculty development: (1) observation skills in authentic settings (workplace-based assessments), (2) coaching and feedback skills, (3) self-assessment and reflection skills, and (4) peer guidance skills developed through a community of practice. These dimensions form a conceptual foundation for meaningful faculty participation in entrustment decision making.

The authors also differentiate between the UME learning environment and the graduate medical education learning environment to highlight distinct challenges and opportunities for faculty development in UME settings. They conclude with recommendations and research questions for future Core EPA faculty development efforts.

M.A. Favreau is associate professor of pediatrics, and adjunct associate professor, Division of Management, Oregon Health and Science University School of Medicine, Portland, Oregon. She was also associate dean for professional development and lifelong learning, Oregon Health and Science University School of Medicine, Portland, Oregon, at the time this work was done.

L. Tewksbury is associate dean for student affairs and associate professor of pediatrics, New York University School of Medicine, New York, New York.

C. Lupi is assistant dean for learning and teaching and professor of obstetrics and gynecology, Florida International University Herbert Wertheim College of Medicine, Miami, Florida.

W.B. Cutrer is assistant professor of pediatrics, Vanderbilt University School of Medicine, Nashville, Tennessee.

J.A. Jokela is professor and head, Department of Medicine, University of Illinois College of Medicine at Urbana-Champaign, Urbana, Illinois.

L.M. Yarris is associate professor of emergency medicine and program director for emergency medicine, Oregon Health and Science University School of Medicine, Portland, Oregon.

Editor’s Note: An Invited Commentary by Th.J.(Olle) ten Cate appears on pages 736–738.

Funding/Support: This project was supported by the Association of American Medical Colleges and the Core Entrustable Professional Activities for Entering Residency pilot institutions.

Other disclosures: None reported.

Ethical approval: Reported as not applicable.

Correspondence should be addressed to Michele A. Favreau, Oregon Health and Science University School of Medicine, Mail Code: CDRC, 3107 SW Sam Jackson Park Rd., Portland, OR 97239; telephone: (503) 494-4265; e-mail: favreau@ohsu.edu.

Entrustable professional activities (EPAs) are a recent addition to the competency-based medical education model that undergirds the current physician training continuum. EPAs are real-life, core professional or workplace activities that a professional is entrusted to perform once she or he has attained a sufficient level of competency.1–4 More succinctly, EPAs “translate competencies into clinical practice.”3 That is, they describe the authentic clinical activities in which learners demonstrate their competence. These clinical activities are broad enough to be applied across different clinical contexts and specialties. Most recently, the EPA framework has been applied to undergraduate medical education (UME) with the development of 13 Core EPAs for Entering Residency (Core EPAs), which aim to delineate the activities that entering residents might be expected to perform on day one of residency without direct supervision.5

While the EPA framework allows for innovative teaching, learning, and assessment across the spectrum of medical education, the Core EPAs also present new opportunities and challenges for UME faculty educators who participate in the assessment–entrustment continuum at varying levels of engagement. At one end of this continuum are the faculty who primarily interact with learners in the workplace. During each encounter, these faculty make decisions about what they trust learners to do independently. In this capacity, they are well suited to assess learner performance through direct observations; these decisions eventually may inform entrustment decisions. On the other end of the continuum are the educators who review all available data to make summative entrustment decisions. Acknowledging the critical need for faculty development for a heterogeneous group of educators who will be involved in entrustment decision making, in 2014, the Association of American Medical Colleges established the Core EPAs pilot, which included the creation of an interinstitutional concept group to focus specifically on faculty development. The purpose of this article is to provide a critical synthesis of the EPA literature and to describe a shared mental model for faculty development6–8 that this concept group developed, which encompasses a foundational conceptual framework for entrustment, to better prepare faculty and to align faculty development efforts in teaching, assessment, and entrustment judgments.

Back to Top | Article Outline

Trust, Trustworthiness, and Entrustment: Constructing a Mental Model for Entrustment

ten Cate and colleagues9 proposed that trust is an interdependent endeavor between learner and supervisor, an exercise in “relational autonomy” that involves a receptivity to “being vulnerable to the actions of a trustee.” Entrustment, then, constitutes a socially complex, shared endeavor for both learner and supervisor.10 That is, the learner demonstrates her or his entrustability to influence supervisors’ decisions to confer entrustment. As such, the EPAs create a workplace-based context for the development and assessment of learner competence through core professional activities across different roles.11 Because the workplace environment is also a “shared performance space,” both learners and clinical faculty educators engage in the entrustment experience, partnering in the pursuit of trust.12

Trust is key to determining learner competence and independence.1–6 Further, this trust judgment is an intuitive and observational assessment that is both complex and multifactorial.6–16 Trust is the “gatekeeper” to increased levels of learner participation in the clinical workplace.17 This is significant because it is through gradually increasing clinical responsibilities and ongoing participation in the clinical “zone of proximal development”18 that the learner develops competence and demonstrates entrustability to achieve an entrustment determination from supervising faculty. Supervisor/learner interactions and relationships then constitute a valuable currency of entrustment within the workplace.

Trustworthiness has emerged as a multidimensional concept that is essential to making decisions of entrustment.3,19 O’Neill’s20 model of trustworthiness includes aspects of competence, honesty, and reliability, each of which is connected to the others in the expression of trustworthiness. Kennedy and colleagues19 described a four-dimensional model of trustworthiness that included the following: (1) clinical knowledge and skills, (2) discernment or the awareness of one’s own knowledge limits, (3) conscientiousness or the comprehensiveness of data gathering and diligence in follow-up, and (4) truthfulness or the level of honesty in one’s interactions with a supervisor. Together, these dimensions shape the expression of trustworthiness. ten Cate3 interpreted the notion of trustworthiness through a broader set of features that impact entrustment decisions. These included (1) attributes of the learner, (2) attributes of the supervisor, (3) the supervisor/learner relationship, (4) the situational context for entrustment, and (5) the level of complexity of the EPA. Supervisory style,21 fluency in the language of medicine,19 supervisors’ clinical skills abilities, and differing comparability points of reference (most notably self)22 are additional characteristics proposed to affect entrustment decisions. Trustworthiness, then, is a trait that both the learner and supervisor shape through their relationships and interactions; the learner demonstrates trustworthiness for the purposes of achieving entrustment, and likewise the clinical faculty member role models trustworthiness to catalyze and advance learners’ clinical participation, to create a positive workplace environment, and to optimize learning.17,23,24

The ultimate goal of an entrustment decision is to “predict learners’ future behaviors and assess their potential to competently care for patients.”17 Making these types of decisions requires the development of faculty members’ observation skills and ability to analyze and interpret learners’ observed behaviors. Clinical faculty supervisors also must possess a heightened level of self-awareness, experience, and clinical skills expertise to effectively participate in the entrustment of learners.17,22

Based on this critical synthesis of the EPA literature, we identified the following four dimensions as constructs for a shared mental model for Core EPA faculty development: (1) observation skills in authentic work environments (workplace-based assessments), (2) feedback and coaching skills, (3) self-assessment skills (including reflective practice) that ensure the appropriate role modeling of desired behaviors and attitudes, and (4) peer guidance skills developed through a community of practice that inculcates a transformative EPA culture.

Back to Top | Article Outline

Faculty Development to Foster Observation Skills in Authentic Settings

Steinert and colleagues25 described the value of experiential learning in faculty development programs, which is applicable to teaching the Core EPAs. They also posited that “immediate relevance and practicality are key.” Along those same lines, workplace-based assessments have gained prominence in the literature as an effective model for driving learning related to the EPAs.26,27 In this context, workplace-based assessments serve to define critical data points to aid faculty in making high-stakes entrustment decisions, given that such decisions fundamentally include multiple evidence-informed assessments of learners’ performance in authentic settings.

Observations in workplace settings are particularly important in teaching and assessing the Core EPAs as they allow faculty the opportunity to promote and assess the attributes of trustworthiness in learners.27 Learners are exposed to complex, unpredictable tasks in the workplace, and their performance may fluctuate, which can challenge their sense of competence.28 Taking time to observe learners who are deeply engaged in authentic patient activities can help build trust between the learner and faculty supervisor. Learners will likely be more willing to seek help from a faculty supervisor who has taken the time to observe her or him and share in the patient care experience.29

Workplace observations to drive attainment of entrustment according to the Core EPAs should be focused on identifying and addressing learners’ needs in real time. This enables a trusting relationship in which the learner is comfortable disclosing uncertainties and areas of weakness. Observations of learners engaged with patients provide additional opportunities for faculty to identify and discuss any inconsistencies between the information gathered and the information presented or documented by the learner. Likewise, these types of focused observations may provide valuable information as to how conscientiously the learner follows through on any observed gaps in patient care. Thus, teaching and assessing the Core EPAs in the workplace calls for faculty development that promotes direct observation and workplace-based assessment skills. These need to occur in the context of strong, trusting partnerships between faculty and learners to facilitate the assessment of trustworthiness and the critical development of entrustability.

Back to Top | Article Outline

Faculty Development to Foster Feedback and Coaching Skills

Clinical faculty who have the opportunity to directly assess learners are uniquely suited to participate in workplace-based assessments, including real-time entrustment decisions. Each real-time assessment data point collected over a longitudinal period of time has the potential to inform high-stakes, summative entrustment decisions. Each one also offers an opportunity to improve learner performance, if those observations can be translated into specific, appropriately timed, face-to-face feedback encounters.30 Educators have recognized the importance of feedback in improving performance, and both observation and feedback are essential to the acquisition of expertise.31 To this end, the literature includes descriptions of multiple educational interventions to improve faculty members’ skills in peer observation, feedback delivery, and clinical teaching communication.32–36

Recently, the emphasis in the feedback literature has shifted from a focus on feedback delivery to an exploration of the factors that influence learner responsiveness to feedback, which is a necessary step towards acceptance and incorporation of feedback. Eva and colleagues37 found that learner factors, such as confidence, experience, and fear of not appearing knowledgeable, may affect learners’ interpretation and uptake of feedback. Furthermore, the importance of feedback-seeking behavior in learners has been highlighted, and specific tips to encourage this behavior may be translated to EPA teaching and assessment program development.38 Finally, our emerging understanding of the relationship of emotion to motivation and learning in medical education has important implications for Core EPA performance assessment and should be considered when designing feedback systems.37–39

Faculty development efforts that aim to improve the ability of clinical faculty to engage in meaningful conversations with learners about their observed performance, and to coach them in their pursuit of entrustment, should incorporate not only feedback delivery methods but also foundational training regarding the factors that impact learner responsiveness and acceptance. However, even with motivated faculty and receptive learners, the effectiveness of feedback also may depend on the culture of the learning environment. Thus, faculty development efforts should include systems and curricula that are specifically designed to promote trusting learner–supervisor relationships, thereby placing faculty in a longitudinal coaching role.40,41

Back to Top | Article Outline

Faculty Development to Foster Self-Assessment, Role Modeling, and Reflective Practice

Eva and Regehr42 noted that self-assessment is an essential skill for learners and practitioners in the health professions. This is especially true for faculty educators engaged in the UME entrustment process as they serve as frontline role models of the skills, behaviors, and attitudes that promote trustworthiness. Studies indicate, however, that self-assessments are often inaccurate when they focus solely on unguided reviews.42 Sargeant and colleagues43 suggested that what is needed is “informed self-assessment,” a process which uses external and internal data sources to generate an appraisal of one’s own abilities. Schumacher and colleagues44 described a similar construct in “self-directed self-assessment,” which is dependent on an individual’s ability to identify and seek out multiple external sources of information to create a more robust self-assessment. This type of self-assessment is complex because of the potential for different interpretations of information, internal and external contextual influences and tensions, and assorted responses to information.43 Faculty need the skills to identify high-quality, internal and external data sources regarding their own abilities and heightened self-awareness training to be able to adequately interpret and apply the solicited feedback.

Just-in-time reflection in practice is another facet of self-assessment.42,45 Reflection in practice underpins discernment and, in combination with help-seeking behavior, is an essential skill set for faculty entrustment role models as well as for trustworthy learners. Reflection must supplement self-assessment to support the learning necessary for increasing levels of entrustment for both the faculty educator and learner. All faculty involved in entrustment decision making will likely need ongoing training to hone these skills and processes that will be tailored to their specific contributions to the entrustment decision. Faculty demonstrating these behaviors within their own practices can serve as exemplary role models for learners and peer coaches for faculty educators to foster buy-in and instill a desire to develop informed self-assessment.

Back to Top | Article Outline

Faculty Development as a Community of Practice

Wenger46 defines communities of practice as “groups of people who share a concern or a passion for something they do and learn how to do it as they interact regularly.” Translating the complexities of entrustment decision making into the educational roles and responsibilities of faculty educators brings unique challenges because entrustment decision making is as much a cognitive task as it is a social task. Establishing communities of practice around the Core EPAs simultaneously provides a built-in network of peer support, coaching, and guidance for clinical educators while socializing cultural and educational constructs of entrustment. Creating a community of entrustment provides a context for “social learning”47,48 through ongoing interaction, collaboration, and shared guidance. It likewise provides a context for “legitimate peripheral participation”48—that is, all clinical faculty who are involved at all levels of entrustment decision making are able to make valuable contributions to the entrustment process. Steinert and colleagues25 underscored the role of a community of peers both as role models to enable the ongoing exchange of information and ideas and as a professional network of “collegial support to promote and maintain change.” Thus, the establishment of communities of entrustment is essential to the ongoing development, support, and socialization of faculty as entrustment educators and decision makers.

Back to Top | Article Outline

UME as a Unique Entrustment Environment

The current UME clinical learning environment is still one of relatively brief exposures for learners to a wide variety of clinical faculty and residents from multiple specialties in many different settings. Although this variety presents the opportunity for rich workplace-based assessments, it also may hinder the formation of longitudinal learner–supervisor relationships that facilitate effective feedback, coaching, and ultimately informed learner assessment. As medical schools begin to build more longitudinal clinical and coaching experiences for medical students, these experiences must occur simultaneously with faculty development efforts to optimize the potential for “entrustment partnerships” to form.

Hauer and colleagues17 suggested that junior faculty do not yet possess the necessary experience and skills to effectively contribute to entrustment decisions. This suggestion seems to run counter to current educational practices in UME. Junior faculty, residents, and fellows all supervise and teach medical students and contribute to entrustment decisions. This group of educators also makes important observations regarding learners’ conscientiousness, truthfulness, and discernment in their educational environments. Although it is important for all faculty who contribute to entrustment decisions to have a shared mental model for entrustment, faculty development efforts should specifically target the unique needs of faculty based on their role. For example, faculty who primarily participate in workplace-based assessments and make informal, snapshot entrustment decisions with every teaching encounter may require different skill development than faculty who assess learners over an extended period of time or those who make summative entrustment decisions.

Ultimately, an entrustment system that both maximizes safe patient care and optimizes trainees’ learning must clearly define the role and value of all educators’ contributions to entrustment, given the understanding that contributions from a diverse set of faculty render a more comprehensive and detailed picture of the learner. Such a system needs to explicitly address the expectations for and the development of all educators to ensure that they make competent entrustment decisions that are appropriate for both the faculty member’s role and the learner’s indicated level of supervision. Engaging junior faculty and other physician trainees is essential to the sustainability of the entrustment community of practice. As junior educators progress in their careers, they will be better able to contribute their entrustment expertise to their learners and peers, thus creating a renewable and sustainable entrustment community.

Within the evolving Core EPA entrustment framework, making entrustment decisions may prove more challenging in the UME environment than in the graduate medical education environment. For example, the majority of faculty in residency training programs typically reside in one clinical department, allowing for the physical community of practice to more easily coalesce. In UME, however, faculty members are distributed across many clinical departments and increasingly across multiple institutional sites, neither of which readily supports a physically cohesive community of practice. Additionally, UME faculty may assign medical students to more peripheral roles in patient care activities which could limit learners’ opportunities to participate in some of the Core EPAs. Finally, UME faculty from across specialties spend less time with individual medical students, which may limit supervisor–learner continuity and the establishment of longitudinal entrustment partnerships to the same degree that they develop in graduate medical education settings.

Back to Top | Article Outline

Conclusions

In summary, our conceptual understanding of entrustment continues to evolve across the continuum of medical education. To codify our understanding of the role of faculty development and faculty development research across the assessment–entrustment continuum, we have developed a list of recommendations and research questions (see Lists 1 and 2). These provide a road map for ongoing inquiry and examination of faculty development practices related to the Core EPAs and for future directions in Core EPA faculty development research. Although UME faculty development for the Core EPAs remains in its beginning stages, a critical synthesis of the EPA literature has revealed the following dimensions for faculty development: (1) observation skills in authentic settings (workplace-based assessments), (2) feedback and coaching skills, (3) self-assessment and reflection skills, and (4) peer guidance skills developed through a community of practice.

Defining a cogent, comprehensive entrustment framework for UME educators warrants further study. The framework we have described can assist in creating effective strategies, processes, and methods for meaningful faculty engagement in teaching and assessing the Core EPAs. It can likewise serve to more clearly delineate the shared role of trust and trustworthiness in medical student training. Our recommendations for ongoing faculty development efforts and future directions in faculty development research highlight the many opportunities and challenges accompanying the implementation of the Core EPAs in UME (see Lists 1 and 2). As more medical schools engage in the systematic development and assessment of the Core EPAs, these lists will both expand and contract as existing questions find answers and new questions and recommendations arise.

Back to Top | Article Outline

List 1Faculty Development Recommendations From the Core Entrustable Professional Activities for Entering Residency Faculty Development Concept Group

  • Develop and disseminate a shared mental model for entrustment for educators in undergraduate medical education (UME).
  • Pair faculty and learner development to better inculcate a culture of shared entrustment, reciprocal feedback-seeking behaviors, and meaningful learner–educator partnerships.
  • Structure medical school curricula to support longitudinal observations and relationships to foster trust.
  • Clearly define the guidelines and behaviors necessary for effectively fulfilling the dual roles of UME educators to ensure both patient safety and learner development.
  • Reduce variability in faculty members’ assessments of learners through informed self-assessment training and practice for faculty.
  • Create multiple opportunities for faculty to engage in deliberate practice to integrate informed self-assessment and feedback-seeking behaviors as continuous performance improvement.
  • Align faculty rater skills development with programs to advance faculty clinical skills development.
  • Develop communities of practice for all faculty educators who teach and assess the Core Entrustable Professional Activities for Entering Residency.
Back to Top | Article Outline

List 2Future Directions for Faculty Development Research From the Core Entrustable Professional Activities for Entering Residency Faculty Development Concept Group

  • What are the roles, contributions, and training for junior faculty, residents, and fellows engaged in entrustment judgments related to the Core Entrustable Professional Activities for Entering Residency (Core EPAs)? What are the best approaches to develop and support junior entrustment educators?
  • What are the contributions to Core EPA entrustment judgments and the necessary training needs for faculty educators who solely engage in “brief interactions” with medical students?
  • How do we assess the baseline understanding of clinical faculty regarding the definition and conceptualization of the Core EPAs and entrustment? How does this understanding change with training?
  • What is the “core content” of Core EPA teaching and assessment? What is the impact of teaching this core content on faculty performance?
  • What level of systems support, in terms of time, compensation, and acknowledgment, will be necessary to achieve the level of faculty development required for educators in undergraduate medical education (UME)?
  • What types of systems are needed for high-stakes entrustment decisions to balance patient safety and learner development?
  • What are the barriers in the current UME educational environment to meaningful engagement for UME educators in the entrustment process?
  • How do we involve faculty in the design and implementation of entrustment assessment tools?
  • What are the specific knowledge, skills, and attitudes necessary for faculty to effectively make summative entrustment decisions?

Acknowledgments: The authors wish to thank the Association of American Medical Colleges and the Core Entrustable Professional Activities for Entering Residency Faculty Development Concept Group members: Jamie Noble, MD, MS, Columbia University College of Physicians and Surgeons; Allison Ownby, PhD, MEd, University of Texas Health Science Center at Houston McGovern Medical School; Eve Colson, MD, MEd, Yale School of Medicine; Greg Trimble, MD, Virginia Commonwealth University School of Medicine, Inova Campus; Angie Thompson-Busch, MD, PhD, Michigan State University College of Human Medicine; Jefry Biehler, MD, Florida International University Herbert Wertheim College of Medicine; Yoni Amiel, MD, Columbia University College of Physicians and Surgeons; and Jan Bull, MA, Association of American Medical Colleges.

Back to Top | Article Outline

References

1. Chen HC, van den Broek WE, ten Cate OThe case for use of entrustable professional activities in undergraduate medical education. Acad Med. 2015;90:431–436.
2. ten Cate O, Scheele FCompetency-based postgraduate training: Can we bridge the gap between theory and clinical practice? Acad Med. 2007;82:542–547.
3. Ten Cate OTrusting graduates to enter residency: What does it take? J Grad Med Educ. 2014;6:7–10.
4. Mulder H, Ten Cate O, Daalder R, Berkvens JBuilding a competency-based workplace curriculum around entrustable professional activities: The case of physician assistant training. Med Teach. 2010;32:e453–e459.
5. Englander R, Aschenbrener CA, Call SA, et alCore entrustable professional activities for entering residency. MedEdPORTAL. https://www.mededportal.org/icollaborative/resource/887. Published May 28, 2014. Accessed October 4, 2016.
6. Ten Cate O, Billett SCompetency-based medical education: Origins, perspectives and potentialities. Med Educ. 2014;48:325–332.
7. Carraccio C, Englander R, Holmboe ES, Kogan JRDriving care quality: Aligning trainee assessment and supervision through practical application of entrustable professional activities, competencies, and milestones. Acad Med. 2016;91:199–203.
8. Kogan JR, Holmboe ESPreparing residents for practice in new systems of care by preparing their teachers. Acad Med. 2014;89:1436–1437.
9. ten Cate O, Hart D, Ankel F, et alEntrustment decision making in clinical training. Acad Med. 2016;91:191–198.
10. Rekman J, Gofton W, Dudek N, Gofton T, Hamstra SJEntrustability scales: Outlining their usefulness for competency-based clinical assessment. Acad Med. 2016;91:186–190.
11. Boyce P, Spratt C, Davies M, McEvoy PUsing entrustable professional activities to guide curriculum development in psychiatry training. BMC Med Educ. 2011;11:96.
12. Sklar DPTrust is a two-way street. Acad Med. 2016;91:155–158.
13. Carraccio C, Burke AEBeyond competencies and milestones: Adding meaning through context. J Grad Med Educ. 2010;2:419–422.
14. Ten Cate OWhat is a 21st-century doctor? Rethinking the significance of the medical degree. Acad Med. 2014;89:966–969.
15. Frank JR, Snell LS, Cate OT, et alCompetency-based medical education: Theory to practice. Med Teach. 2010;32:638–645.
16. Ten Cate OCompetency-based education, entrustable professional activities, and the power of language. J Grad Med Educ. 2013;5:6–7.
17. Hauer KE, Ten Cate O, Boscardin C, Irby DM, Iobst W, O’Sullivan PSUnderstanding trust as an essential element of trainee supervision and learning in the workplace. Adv Health Sci Educ Theory Pract. 2014;19:435–456.
18. Vygotsky LMind in Society: The Development of Higher Psychological Processes. 1978.14th ed. Cambridge, MA: Harvard University;
19. Kennedy TJ, Regehr G, Baker GR, Lingard LPoint-of-care assessment of medical trainee competence for independent clinical work. Acad Med. 2008;83(10 suppl):S89–S92.
20. O’Neill OWhat we don’t understand about trust [TED talk]. https://www.ted.com/talks/onora_o_neill_what_we_don_t_understand_about_trust. Filmed June 2013. Accessed October 4, 2016.
21. Goldszmidt M, Faden L, Dornan T, van Merriënboer J, Bordage G, Lingard LAttending physician variability: A model of four supervisory styles. Acad Med. 2015;90:1541–1546.
22. Kogan JR, Conforti LN, Bernabeo E, Iobst W, Holmboe EHow faculty members experience workplace-based assessment rater training: A qualitative study. Med Educ. 2015;49:692–708.
23. Irby DMHow attending physicians make instructional decisions when conducting teaching rounds. Acad Med. 1992;67:630–638.
24. Pinsky LE, Irby DM“If at first you don’t succeed”: Using failure to improve teaching. Acad Med. 1997;72:973–976.
25. Steinert Y, Mann K, Centeno A, et alA systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME guide no. 8. Med Teach. 2006;28:497–526.
26. Driessen E, Scheele FWhat is wrong with assessment in postgraduate training? Lessons from clinical practice and educational research. Med Teach. 2013;35:569–574.
27. Holmboe ESRealizing the promise of competency-based medical education. Acad Med. 2015;90:411–413.
28. Govaerts MJ, Van de Wiel MW, Schuwirth LW, Van der Vleuten CP, Muijtjens AMWorkplace-based assessment: raters’ performance theories and constructs. Adv Health Sci Educ Theory Pract. 2013;18:375–396.
29. Kilminster S, Cottrell D, Grant J, Jolly BAMEE guide no. 27: Effective educational and clinical supervision. Med Teach. 2007;29:2–19.
30. Archer JCState of the science in health professional education: Effective feedback. Med Educ. 2010;44:101–108.
31. Ericsson KADeliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79(10 suppl):S70–S81.
32. Duffy FD, Gordon GH, Whelan G, et alAssessing competence in communication and interpersonal skills: The Kalamazoo II Report. Acad Med. 2004;79:495–507.
33. Kogan JR, Conforti LN, Bernabeo EC, Durning SJ, Hauer KE, Holmboe ESFaculty staff perceptions of feedback to residents after direct observation of clinical skills. Med Educ. 2012;46:201–215.
34. Mookherjee D, Tsumagari MMechanism design with communication constraints. J Polit Econ. 2014;122:1094–1129.
35. Starmer AJ, O’Toole JK, Rosenbluth G, et alI-PASS Study Education Executive Committee. Development, implementation, and dissemination of the I-PASS handoff curriculum: A multisite educational intervention to improve patient handoffs. Acad Med. 2014;89:876–884.
36. Watling C, Driessen E, van der Vleuten CP, Lingard LLearning culture and feedback: An international study of medical athletes and musicians. Med Educ. 2014;48:713–723.
37. Eva KW, Armson H, Holmboe E, et alFactors influencing responsiveness to feedback: On the interplay between fear, confidence, and reasoning processes. Adv Health Sci Educ Theory Pract. 2012;17:15–26.
38. Crommelinck M, Anseel FUnderstanding and encouraging feedback-seeking behaviour: A literature review. Med Educ. 2013;47:232–241.
39. Artino AR Jr.When I say … emotion in medical education. Med Educ. 2013;47:1062–1063.
40. Watling CCognition, culture, and credibility: Deconstructing feedback in medical education. Perspect Med Educ. 2014;3:124–128.
41. Watling CWhen I say … learning culture. Med Educ. 2015;49:556–557.
42. Eva KW, Regehr GKnowing when to look it up: A new conception of self-assessment ability. Acad Med. 2007;82(10 suppl):S81–S84.
43. Sargeant J, Armson H, Chesluk B, et alThe processes and dimensions of informed self-assessment: A conceptual model. Acad Med. 2010;85:1212–1220.
44. Schumacher DJ, Englander R, Carraccio CDeveloping the master learner: Applying learning theory to the learner, the teacher, and the learning environment. Acad Med. 2013;88:1635–1645.
45. Schön DAEducating the Reflective Practitioner: Toward a New Design for Teaching and Learning in the Professions. 1990.San Francisco, CA: Jossey-Bass;
46. Wenger ECommunities of practice and social learning systems. Organization. 2000;7:225–246.
47. Cruess RL, Cruess SR, Boudreau JD, Snell L, Steinert YA schematic representation of the professional identity formation and socialization of medical students and residents: A guide for medical educators. Acad Med. 2015;90:718–725.
48. Lave J, Wenger ESituated Learning: Legitimate Peripheral Participation. 1991.Cambridge, England: Cambridge University Press;
© 2017 by the Association of American Medical Colleges