Secondary Logo

Journal Logo

Research Reports

Continuity With Patients, Preceptors, and Peers Improves Primary Care Training: A Randomized Medical Education Trial

Henschen, Bruce L. MD, MPH; Liss, David T. PhD; Golden, Blair P. MD; Cameron, Kenzie A. PhD, MPH; Bierman, Jennifer A. MD; Ryan, Elizabeth R. EdD; Gard, Lauren A. MPH; Neilson, Eric G. MD; Wayne, Diane B. MD; Evans, Daniel B. MD

Author Information
doi: 10.1097/ACM.0000000000003045
  • Free

Abstract

“Every system is perfectly designed to get the results it gets.”1 This oft-quoted adage accurately applies to 21st-century medical education. Traditional medical school curricula emphasize department-specific knowledge acquisition in transient, physician-centered learning environments.2 These models may contribute to a loss of patient-centered attitudes and reduced empathy, possibly by exposing students to fragmented care.3 While this curricular structure produces clinicians effective at providing acute care, it may not develop the optimal skills needed to practice in the team-based, patient-centered systems necessary for managing a population increasingly burdened by chronic illness.4,5

Introducing continuity with patients into medical school curricula may foster these skills.2 Continuity of care promotes professional identity growth and enables students to experience the “heroism of incremental care.”6–8 Students who have continuity experiences are more involved in patient care, perceive a greater sense of pride in their work, and identify themselves as health educators.9,10 While negative aspects of the hidden curriculum may lead to depersonalization,11,12 longitudinal experiences may preserve patient-centered attitudes and ensure that patient preferences, needs, and values guide clinical decisions.13–15 Transient, chaotic learning environments may result in a loss of professional efficacy.16,17 Having an “educational home” may enable students to feel more grounded and experience a greater sense of accomplishment in a more supportive learning environment.18–21 Importantly, studies of medical school continuity experiences have to date only reported observational data involving subsets of students.13,22–25

The Education Centered Medical Home (ECMH) at Northwestern University Feinberg School of Medicine (FSM) is a 4-year, longitudinal primary care clerkship (PCC) emphasizing continuity with patients, preceptors, and peers.25 While other longitudinal models integrate students in a single clerkship for a discrete time period,26 the ECMH enables students to have a continuity clinic alongside their other clinical and academic responsibilities. Our prior study of this model demonstrated that students who self-selected the ECMH reported significantly more satisfaction with their primary care training compared with students in a traditional curriculum,25 though these findings were limited by potential volunteer bias. To better evaluate the ECMH’s curricular effectiveness, we designed a randomized, controlled, medical education trial. We organized our hypotheses using Kirkpatrick’s framework.27 Specifically, we hypothesized the ECMH model, when compared with an enhanced individual preceptorship (IP) control group, would result in the following: improved primary care experiences and higher satisfaction with the learning environment (level 1: reactions and learning environment), higher patient-centered and team-oriented attitudes with comparable medical knowledge acquisition (level 2: attitudes, perceptions, and knowledge), and higher professional efficacy and more therapeutic relationships with patients (level 3: behavioral outcomes).

Method

Clerkship descriptions

In the years preceding this trial, students at FSM were given a choice of 2 models for primary care training: the ECMH or the IP (Table 1).28

Table 1
Table 1:
Comparison of ECMH and IP Models, Northwestern University Feinberg School of Medicine

The ECMH is a 4-year, team-based, longitudinal PCC emphasizing continuity with patients, peers, and preceptors.23 In each ECMH, 16 students (4 from each class) are embedded in existing primary care clinics. Students attend clinic bimonthly throughout the 4 years of medical school (M1, M2, M3, M4). During each clinic, pairs of students (e.g., a junior M1/M2 paired with a senior M3/M4) see patients with preceptor oversight. To promote continuity, preceptors attempt to recruit a consistent panel of medically complex, high-risk patients who return to the ECMH regularly. Peer teaching plays a central role; M3/M4 students review clinical concepts, scientific principles, and physical examination skills with their M1/M2 peers before, during, and after encounters. Students track the quality of care they deliver and act as health coaches to potentially add value to patient care.29,30

The IP is a 2-year, 1:1 preceptor apprenticeship model. IP students attend clinic bimonthly for their first 2 years, seeing and presenting patients at the preceptor’s discretion. IP students may see some patients for follow-up encounters during their 2-year experience, though this occurs more by happenstance than deliberate educational design. This model is typical for early clinical immersion in medical school.31 In both models, faculty preceptors oversee clinical care, model professional behavior, and provide feedback.

During the first 2 years, both ECMH and IP students attend clinical skills sessions with standardized patients on alternate weeks. Curricular content and weekly learning objectives during these sessions are identical between groups. In the third year, all IP students enroll in a 4-week PCC where they attend at least 26 clinic sessions. In contrast, ECMH students attend their ECMH clinic at least 26 times during their M3/M4 years. Some ECMH students choose to enroll in the PCC in addition to their ECMH and receive 4 weeks of elective credit. All students complete the National Board of Medical Examiners (NBME) Ambulatory Medicine Subject Examination.

Setting and participants

The study was approved by the Northwestern University Institutional Review Board (STU#00200764, approved 6/30/15). The study period was August 2015 to August 2018.

At matriculation in July 2015 and July 2016, we randomly assigned all first-year students to the ECMH or IP. As in a prior comparative effectiveness study,32 we used a modified constrained randomization approach across 2 randomization waves.33 Because of a predetermined need for Spanish language skills at several ECMH clinics, randomization occurred within blocks of students stratified by Spanish proficiency. For each incoming class, we simulated 20,000 randomization schemes and then examined balance across the following covariates: sex, MD/PhD program matriculation, race/ethnicity (non-Hispanic white vs other), and interest in pediatrics (to ensure adequate enrollment in pediatric ECMH clinics). After identifying randomization schemes that were balanced across all covariates of interest, we randomly selected one balanced randomization scheme. We obtained individual written informed consent from matriculated students to survey them longitudinally and to allow access to academic records.

The number of available spaces for ECMH students was smaller (256) than the total number of students (650). Over the 3-year study period, 4 ECMH clinics were added. Interested students were allowed to switch as space became available or if a switch was appropriate for a student’s academic needs. If space was available for crossover, students were randomly selected from a wait list. We analyzed data using an intent-to-treat approach. Students were analyzed according to their original group assignment regardless of crossover.

Survey distribution

We distributed surveys to all consenting students at 4 timepoints: baseline, end of first year, end of second year, and end of third year. For Kirkpatrick level 1 outcomes (reactions and learning environment), we included previously published questions about FSM-specific experiences and students’ likelihood to recommend ECMH to an incoming medical student. For level 2 outcomes (attitudes, perceptions, and knowledge), we included the Attitudes Toward Health Care Teams (ATHCT) scale, which measures perceptions of team-based care34; the Patient–Practitioner Orientation Scale (PPOS), which measures patient-centered attitudes35; the Communication, Curriculum, and Culture (C3) survey, assessing perceptions of the hidden curriculum, that is, the set of unwritten behaviors that influence the learning climate36; and questions regarding career choice. We evaluated effects on level 3 behavioral outcomes using the Maslach Burnout Inventory–General Survey (MBI-GS), which contains 3 subscales: emotional exhaustion, cynicism, and professional efficacy.37 Additionally, we asked questions regarding students’ achievement of continuity of care during clerkships. Instruments used in this study were administered to medical students in comparable settings in prior research.13,17,34–36,38,39 Baseline surveys contained items that could be asked before the start of clinical experiences; follow-up surveys were identical to each other. The majority of surveys were administered during in-person sessions using Research Electronic Data Capture (REDCap) online tools hosted at Northwestern University FSM.40 One initial survey was collected using SurveyMonkey (SurveyMonkey Inc., San Mateo, California). We emailed individual survey links to students who were absent or who had not completed surveys.

Power and statistical analysis

Statistical power estimates were extrapolated from results of a prior observational study focusing on PPOS scores, which measures perceptions of patient-centered attitudes on a scale where a higher score indicates greater patient-centeredness.25 We hypothesized that IP students’ PPOS scores would remain flat at 4.3, while ECMH scores would increase gradually over 4 years from 4.3 to 4.8. Using a repeated measures ANOVA with α = 0.05 and within-student correlation of 0.7 between annual PPOS measures, a sample size of 329 students provided 82% power to detect such a hypothetical difference between the groups.

Analyses were conducted in Stata statistical software, version 14.2 (StataCorp LLC, College Station, Texas). We estimated regression models with generalized estimating equations (GEEs), which accounted for longitudinal data clustered at the student level using an independent working correlation matrix and robust variance estimates. For continuous outcomes, we estimated models using an identity link and normal family. Intention-to-treat analysis investigated the intervention effect over the entire follow-up period, with the beta coefficient of interest in each regression model representing a constant ECMH effect across 3 years. All regression models adjusted for baseline characteristics above, as well as Spanish language proficiency, baseline interest in primary care, and year of matriculation. We obtained predictive margins using Stata’s “margins” command, with group-level scores adjusted across the sample’s covariate distribution. We explored effect modification in the trial’s final year (a potential dose–response effect) by separately estimating models with an ECMH-by-year 3 interaction. We elected not to impute missing data. GEE regression models assumed data were missing at random.41

Results

In total, 329 students were randomized; 316 (96%) consented to academic data collection and surveys. We finished the study with an 88% response rate across 1,264 potential follow-up survey opportunities (100% baseline, 85% year 1, 94% year 2, and 85% year 3). Figure 1 illustrates participant flow, and Table 2 displays demographic characteristics.42 In accordance with our randomization approach,33 the 2 trial arms were highly balanced with regard to randomization covariates (P ≥ .71 for sex, MD/PhD program enrollment, race/ethnicity, and interest in pediatrics). Eighteen students (9.9%) initially assigned to IP crossed over to ECMH, while 5 students (3.7%) originally assigned to ECMH crossed over to IP. Preceptor retention during the study was > 90% in both groups.

Table 2
Table 2:
Baseline Demographic Characteristics of 316 Entering Medical Student ECMH and IP Participants Across 2 Years of Enrollment, From a Randomized Study of Continuity of Care in Primary Care Training, Northwestern University Feinberg School of Medicine, 2015–2018
Figure 1
Figure 1:
Flow of participants, from a randomized study of continuity of care in primary care training, Northwestern University Feinberg School of Medicine, 2015–2018. Abbreviations: ECMH, Education Centered Medical Home; IP, individual preceptorship.

Figure 2 displays the effect size of each outcome using regression modeling as described above. Data in tables represent the adjusted mean outcomes of participants based on these effect sizes.

Figure 2
Figure 2:
Effect sizes of regression models comparing 135 ECMH participants and 181 IP participants across outcomes by Kirkpatrick level, from a randomized study of continuity of care in primary care training, Northwestern University Feinberg School of Medicine, 2015–2018. Abbreviations: IP, individual preceptorship; ECMH, Education Centered Medical Home; ATHCT, Attitudes Toward Health Care Teams; PPOS, Patient–Practitioner Orientation Scale; C3, Communication, Curriculum, and Culture; MBI, Maslach Burnout Inventory. ªData points reverse coded for figure.

Level 1: Reactions and learning environment

Across 3 years of follow-up, the ECMH model improved learner reactions across several measures (Table 3). ECMH students reported higher scores on survey items about looking forward to going to clinic, feeling involved in clinical care, achieving continuity with patients, and developing rapport with patients in clinic (P < .001 for all). ECMH students reported higher satisfaction with their learning environment. ECMH students reported higher satisfaction with the atmosphere for learning during primary care training, higher quality of mentoring/feedback from all sources, and higher overall quality of primary care training (P < .001 for all). Regarding likelihood to recommend, 70.1% of all respondents recommended the ECMH model to a hypothetical incoming M1 student, 9.8% recommended the IP, and 20.1% were undecided. ECMH participation was associated with 59% increased odds of recommending the ECMH (95% confidence interval [CI] 1.19, 1.98; P < .001).

Table 3
Table 3:
Adjusted Scores for 135 ECMH Participants and 181 IP Participants on Kirkpatrick Levels 1–3 Ratings Over 3 Years of Medical School, From a Randomized Study of Continuity of Care in Primary Care Training, Northwestern University Feinberg School of Medicine, 2015–2018a

Level 2: Attitudes, perceptions, and knowledge

ECMH participants’ ATHCT were significantly more positive across all years (P = .007) than IP participants, while patient-centered attitudes were comparably high in both ECMH and IP groups (Table 3). On the C3 hidden curriculum survey, ECMH participants reported greater perceived support from their peers and preceptors when conducting patient-centered tasks (P < .001). Regarding medical knowledge acquisition, there were no significant differences in United States Medical Licensing Examination Step 1 scores (ECMH 241.2 [95% CI 238.6, 243.9] vs IP 241.0 [95% CI 238.7, 243.3], P = .90) or NBME Ambulatory Medicine Subject Examination scores (ECMH 80.9 [95% CI 79.3, 82.5] vs IP 80.7 [95% CI 79.5, 82.0], P = .87).

Participants in both groups reported similar levels of interest in primary care as a career (Table 3, P = .34). ECMH students were more likely to report increased interest in a primary care career as a result of their training experience (P < .001).

Level 3: Behavioral outcomes

Participants in the ECMH reported actively following 2.2 patients, on average, compared with 0.3 in the IP (Table 3, P < .001). ECMH participants also reported establishing more patient relationships and more active involvement in patient care than IP participants (Table 3, P < .001 on all measures). Regarding wellness and burnout, the ECMH experience significantly increased professional efficacy (Table 3, P = .02). Participants’ levels of emotional exhaustion and cynicism were similar over the course of the study.

Table 4
Table 4:
Adjusted Effect Sizes for 135 ECMH Participants and 181 IP Participants on Kirkpatrick Levels 1–3 Ratings, Stratified by Years 1–2 and Year 3 of Medical School, From a Randomized Study of Continuity of Care in Primary Care Training, Northwestern University Feinberg School of Medicine, 2015–2018a

Effect modification analysis

In an exploratory analysis, we investigated whether the ECMH had a different effect during the clerkship year (M3) compared with the preclinical years (Table 4). All level 1 outcomes remained significant for M3 participants, other than ability to balance clerkship responsibilities which remained nonsignificant (P = .90). Among level 2 outcomes, the ECMH was associated with a greater effect on the hidden curriculum in M3, particularly in preceptor role modeling and support for patient-centered behaviors (Table 4). Level 3 outcomes related to continuity of care were significant across all years. Finally, ECMH effects on MBI professional efficacy scores were greater for M3 participants, while cynicism and exhaustion subscales remained unchanged (Table 4).

Discussion

In this randomized, controlled medical education trial, the ECMH—a team-based, longitudinal PCC—outperformed a traditional primary care education model across a broad range of outcomes. The ECMH conferred positive effects on students’ perceptions of the learning environment, improved attitudes toward team-based care, and reduced exposure to negative aspects of the hidden curriculum. These findings suggest that ECMH students are better prepared to practice in the team-based, collaborative, patient-centered settings needed in the modern health care system.4 Students in both groups recommended the ECMH to incoming students, demonstrating the popularity of the model and replicating high satisfaction found in prior studies.25 Finally, ECMH students demonstrated comparable medical knowledge acquisition, improved continuity of care with patients, and significantly improved professional efficacy—one of the 3 defining components of burnout.20 Effects on the hidden curriculum and on professional efficacy accelerated during the third year, suggesting a dose–response relationship and potentially additive effects when layering a longitudinal ambulatory experience onto an existing discipline-based block clerkship curriculum.

This study of longitudinal clerkships compared with traditional models is unique for several reasons. Randomized, controlled medical education studies are rare due to difficulties in recruitment, varying institutional structures, logistical constraints preventing multicenter collaboration, and small sample sizes limiting statistical power.43–46 In this study, we compared 2 primary care curricular models using a prospective randomized design with inclusion of 96% of eligible subjects, high survey response rates (88%), and 3 years of follow-up. Previous observational studies of longitudinal clerkship models have demonstrated improved education outcomes,13,22–24 and various curricular and extracurricular activities to promote student wellness have been implemented at U.S. medical schools.47 However, to our knowledge, our study is the first to use a randomized design to demonstrate improved outcomes in both education and well-being, sustained over 3 years.

The ECMH model promotes rewarding aspects of patient care including building relationships with patients and working with peers in a supportive environment.10 In qualitative interviews, ECMH students describe themselves as advocates, health educators, and care managers, rather than simply passive learners or shadowers.10 Working in this active, team-based environment prompts students to try new roles earlier in their training, accelerating their professional development.9 When asked whether they were making real differences in the lives of their patients, ECMH students reported that they were doing so more than once a month. As they enter the often-chaotic, fragmented world of clinical clerkships, these experiences may better prepare ECMH students to withstand potential negative forces in the hidden curriculum. Promoting active clinical roles may help students build resiliency to overcome the challenges of clinical clerkships and form a greater sense of professional efficacy.48 We postulate that adding a longitudinal ambulatory clerkship alongside existing discipline-based clerkships allows students to return iteratively to a safe harbor and feel a sense of growth over time. Although our findings show promising effects on professional efficacy, further work is clearly needed to reduce other aspects of burnout, notably the persistent high levels of exhaustion and cynicism.17 As the ECMH and IP were small portions of a student’s overall medical curriculum, other factors, such as demanding duty hours, loss of autonomy, and stress regarding evaluations, may be greater contributors to emotional exhaustion and cynicism. Further research may help optimize longitudinal curricula to best address this phenomenon.

Our study has several limitations. It was conducted at a single institution. There was crossover between groups; however, if this produced any impact, it would bias our findings toward the null. We attempted to minimize bias in outcome assessment to the extent possible; though results were not blinded, survey data were collected online so there were no data collectors who could have introduced bias in the outcome assessment process. Additionally, the data analyst had no contact with students and thus could not bias responses. We did not perform a Bonferroni correction on the data; though we had multiple outcomes, we did not have sufficient statistical power due to real-world sample size constraints. However, out of 25 observed outcomes, 17 were in favor of the ECMH; 8 showed no difference; and 0 favored the IP, a pattern unlikely to be due to chance. More research may be needed to confirm our observed effects where P is closer to .05. More ECMH clinics were located in Federally-Qualified Health Centers or community sites; however, this was driven by clinical site availability rather than trial design and reflects the reality of conducting a randomized medical education study. ECMH preceptors received a stipend to offset productivity losses. Many of the IP preceptors were in compensation plans that gave ~10% effort credit for teaching, scholarship or citizenship and, while IP preceptors’ time demand was overall substantially less, they had more one-on-one time with students. Finally, the ECMH model of team-based care does not reflect current primary care practice models. However, the key features of ECMH—continuity with patients, near-peer education, and longitudinal preceptors—are achievable in other settings and could be used to inform future practice models. Importantly, the ECMH structure may reflect the team-based care models in which our students will eventually practice.49

In conclusion, our findings provide convincing evidence that the ECMH results in superior educational outcomes across multiple Kirkpatrick levels of evaluation.50 Further studies may shed light on the ECMH effect on Kirkpatrick level 4 outcomes (effects on the system), including patient-level effects. Overall, this study validates the efficacy of the ECMH as a new paradigm for primary care education. Continuity with patients, peers, and preceptors is achievable for medical students—and results in superior primary care training.

Acknowledgments:

The authors thank Raymond Curry, MD, John X. Thomas, PhD, and Marianne Green, MD, for their support for the ECMH and assistance in project implementation. The authors also thank the organizations that have served as ECMH sites, including PCC Community Wellness Center, Erie Family Health Center, Community Health Clinic of Chicago, Near North Health Service Corporation, and Northwestern Medical Group.

References

1. Institute for Healthcare Improvement. Multimedia Team. Like magic? (“every system is perfectly designed...”). http://www.ihi.org/communities/blogs/origin-of-every-system-is-perfectly-designed-quote. Revised August 21,2015. Accessed September 3, 2019.
2. Hirsh DA, Ogur B, Thibault GE, Cox M. “Continuity” as an organizing principle for clinical education reform. N Engl J Med. 2007;356:858–866.
3. Bell SK, Krupat E, Fazio SB, Roberts DH, Schwartzstein RM. Longitudinal pedagogy: A successful response to the fragmentation of the third-year medical student clerkship experience. Acad Med. 2008;83:467–475.
4. Lucey CR. Medical education: Part of the problem and part of the solution. JAMA Intern Med. 2013;173:1639–1643.
5. Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness. JAMA. 2002;288:1775–1779.
6. O’Brien BC, Poncelet AN, Hansen L, et al. Students’ workplace learning in two clerkship models: A multi-site observational study. Med Educ. 2012;46:613–624.
7. Asgarova S, MacKenzie M, Bates J. Learning from patients: Why continuity matters. Acad Med. 2017;92(11 suppl):S55–S60.
8. Gawande A. The heroism of incremental care. New Yorker Magazine. Annals of Medicine. https://www.newyorker.com/magazine/2017/01/23/the-heroism-of-incremental-care. Revised January 23,2017. Accessed September 3, 2019.
9. Smith SE, Tallentire VR, Cameron HS, Wood SM. The effects of contributing to patient care on medical students’ workplace learning. Med Educ. 2013;47:1184–1196.
10. Golden BP, Henschen BL, Gard LA, et al. Learning to be a doctor: Medical students’ perception of their roles in longitudinal outpatient clerkships. Patient Educ Couns. 2018;101:2018–2024.
11. Lawrence C, Mhlaba T, Stewart KA, Moletsane R, Gaede B, Moshabela M. The hidden curricula of medical education: A scoping review. Acad Med. 2018;93:648–656.
12. Chen DC, Kirshenbaum DS, Yan J, Kirshenbaum E, Aseltine RH. Characterizing changes in student empathy throughout medical school. Med Teach. 2012;34:305–311.
13. Hirsh D, Gaufberg E, Ogur B, et al. Educational outcomes of the Harvard Medical School-Cambridge integrated clerkship: A way forward for medical education. Acad Med. 2012;87:643–650.
14. Scholl I, Zill JM, Härter M, Dirmaier J. An integrative model of patient-centeredness—A systematic review and concept analysis. PLoS One. 2014;9:e107828.
15. Institute of Medicine Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. 2001.Washington, DC: National Academies Press.
16. Brazeau CM, Schroeder R, Rovi S, Boyd L. Relationships between medical student burnout, empathy, and professionalism climate. Acad Med. 2010;85(10 suppl):S33–S36.
17. Dyrbye LN, Thomas MR, Massie FS, et al. Burnout and suicidal ideation among U.S. medical students. Ann Intern Med. 2008;149:334–341.
18. Evans D. The patient-centered medical home as a curricular model: Medical students need an “educational home.” Acad Med. 2011;86:e2.
19. Curry RH. Meaningful roles for medical students in the provision of longitudinal patient care. JAMA. 2014;312:2335–2336.
20. Shanafelt TD, Dyrbye LN, West CP. Addressing physician burnout: The way forward. JAMA. 2017;317:901–902.
21. Williams D, Tricomi G, Gupta J, Janise A. Efficacy of burnout interventions in the medical education pipeline. Acad Psychiatry. 2015;39:47–54.
22. Wamsley MA, Dubowitz N, Kohli P, Cooke M, O’Brien BC. Continuity in a longitudinal out-patient attachment for year 3 medical students. Med Educ. 2009;43:895–906.
23. Henschen BL, Garcia P, Jacobson B, et al. The patient centered medical home as curricular model: Perceived impact of the “education-centered medical home.” J Gen Intern Med. 2013;28:1105–1109.
24. Drees BM, Arnold L, Jonas HS. The University of Missouri-Kansas City School of Medicine: Thirty-five years of experience with a nontraditional approach to medical education. Acad Med. 2007;82:361–369.
25. Henschen BL, Bierman JA, Wayne DB, et al. Four-year educational and patient care outcomes of a team-based primary care longitudinal clerkship. Acad Med. 2015;90(11 suppl):S43–S49.
26. Thistlethwaite JE, Bartle E, Chong AA, et al. A review of longitudinal community and hospital placements in medical education: BEME guide no. 26. Med Teach. 2013;35:e1340–e1364.
27. Kirkpatrick JD, Kirkpatrick WK. Kirkpatrick’s Four Levels of Training Evaluation. 2016.Alexandria, VA: Association for Talent Development.
28. Heiman HL, O’Brien CL, Curry RH, et al. Description and early outcomes of a comprehensive curriculum redesign at the Northwestern University Feinberg School of Medicine. Acad Med. 2018;93:593–599.
29. O’Neill SM, Henschen BL, Unger ED, et al. Educating future physicians to track health care quality: Feasibility and perceived impact of a health care quality report card for medical students. Acad Med. 2013;88:1564–1569.
30. Lin SY, Schillinger E, Irby DM. Value-added medical education: Engaging future doctors to transform health care delivery today. J Gen Intern Med. 2015;30:150–151.
31. Wenrich MD, Jackson MB, Wolfhagen I, Ramsey PG, Scherpbier AJ. What are the benefits of early patient contact?—A comparison of three preclinical patient contact settings. BMC Med Educ. 2013;13:80.
32. Ciolino JD, Jackson KL, Liss DT, et al. Design of healthy hearts in the heartland (H3): A practice-randomized, comparative effectiveness study. Contemp Clin Trials. 2018;71:47–54.
33. Nietert PJ, Jenkins RG, Nemeth LS, Ornstein SM. An application of a modified constrained randomization process to a practice-based cluster randomized trial to improve colorectal cancer screening. Contemp Clin Trials. 2009;30:129–132.
34. Heinemann GD, Schmitt MH, Farrell MP, Brallier SA. Development of an Attitudes Toward Health Care Teams Scale. Eval Health Prof. 1999;22:123–142.
35. Haidet P, Dains JE, Paterniti DA, et al. Medical student attitudes toward the doctor-patient relationship. Med Educ. 2002;36:568–574.
36. Haidet P, Kelly PA, Chou C; Communication, Curriculum, and Culture Study Group. Characterizing the patient-centeredness of hidden curricula in medical schools: Development and validation of a new measure. Acad Med. 2005;80:44–50.
37. Maslach C, Jackson SE, Leiter MP, Schaufeli WB, Schwab RL. Maslach Burnout Inventory manual. 2018.3rd ed. Palo Alto, CA: Consulting Psychologists Press.
38. Darlow B, Coleman K, McKinlay E, et al. The positive impact of interprofessional education: A controlled trial to evaluate a programme for health professional students. BMC Med Educ. 2015;15:98.
39. Walmsley L, Fortune M, Brown A. Experiential interprofessional education for medical students at a regional medical campus. Can Med Educ J. 2018;9:e59–e67.
40. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–381.
41. Diggle P, Heagerty P, Liang K, Zeger S. Analysis of Longitudinal Data. 2002.2nd ed. Norfolk, UK: Oxford University Press.
42. Schulz KF, Altman DG, Moher D; CONSORT Group. CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332.
43. Papadakis MA, Kagawa MK. A randomized, controlled pilot study of placing third-year medical clerks in a continuity clinic. Acad Med. 1993;68:845–847.
44. Pangaro L, Gibson K, Russell W, Lucas C, Marple R. A prospective, randomized trial of a six-week ambulatory medicine rotation. Acad Med. 1995;70:537–541.
45. Peters AS, Greenberger-Rosovsky R, Crowder C, Block SD, Moore GT. Long-term outcomes of the New Pathway Program at Harvard Medical School: A randomized controlled trial. Acad Med. 2000;75:470–479.
46. Ockene JK, Hayes RB, Churchill LC, et al. Teaching medical students to help patients quit smoking: Outcomes of a 10-school randomized controlled trial. J Gen Intern Med. 2016;31:172–181.
47. Dyrbye LN, Sciolla AF, Dekhtyar M, et al. Medical school strategies to address student well-being: A national survey. Acad Med. 2019;94:861–868.
48. Greenhill J, Fielke KR, Richards JN, Walker LJ, Walters LK. Towards an understanding of medical student resilience in longitudinal integrated clerkships. BMC Med Educ. 2015;15:137.
49. Brown-Johnson CG, Chan GK, Winget M, et al. Primary Care 2.0: Design of a transformational team-based practice model to meet the quadruple aim. Am J Med Qual. 2019;34:339–347.
50. Yardley S, Dornan T. Kirkpatrick’s levels and education ‘evidence’. Med Educ. 2012;46:97–106.
Copyright © 2019 by the Association of American Medical Colleges