Special Theme Research Report
Medical Student Evaluation of the Quality of Hospitalist and Nonhospitalist Teaching Faculty on Inpatient Medicine Rotations
Hunter, Alan J. MD; Desai, Sima S. MD; Harrison, Rebecca A. MD; Chan, Benjamin K.S. MS
Dr. Hunter is assistant professor of medicine, director of inpatient medicine/hospitalist program, and associate residency program director, and Dr. Desai and Dr. Harrison are assistant professors of medicine and hospitalist, Department of Medicine; Mr. Chan is research associate, Division of Medical Informatics and Outcomes Research; all are at Oregon Health & Science University School of Medicine, Portland, Oregon.
Correspondence and requests for reprints should be addressed to Dr. Hunter, Department of Medicine, CR-119, Oregon Health & Science University, 3181 S.W. Sam Jackson Park Road, Portland, OR 97239; telephone: (503) 494-8114; fax: (503) 494-6344; e-mail: 〈firstname.lastname@example.org〉.
Purpose: To evaluate the impact of academic hospitalists on third-year medical students during inpatient medicine rotations.
Method: The authors conducted a retrospective quantitative assessment of medical student evaluations of hospitalist and nonhospitalist Department of Medicine faculty at Oregon Health & Science University, for the 1998–00 academic years. Using a nine-point Likert-type scale, students evaluated the faculty on the following characteristics: communication of rotation goals, establishing a favorable learning climate, use of educational time, teaching style, evaluation and feedback, contributions to the student’s growth and development, and overall effectiveness as a clinical teacher.
Results: A total of 138 students rotated on the university wards during the study period; 100 with hospitalists, and 38 with nonhospitalists. Of these students, 99 (71.7%) returned evaluations. The hospitalists received higher numeric evaluations for all individual attending characteristics. Significance was achieved comparing communication of goals (p = .011), effectiveness as a clinical teacher (p = .016), and for the combined analysis of all parameters (p < .001). Despite lack of achieving statistical significance, there was a trend toward hospitalists being more likely to contribute to the medical student’s perception of growth and development during the period evaluated (p = .065).
Conclusions: In addition to performing the responsibilities required of full-time hospital-based physicians, hospitalists were able to provide at least as positive an educational experience as did highly rated nonhospitalist teaching faculty and in some areas performed better. A hospitalist model can be an effective method of delivering inpatient education to medical students.
The integration of the hospitalist in the care of inpatients has become widespread since the appearance of hospitalists as a care-delivery strategy in 1996.1,2 Hospitalists are physicians who spend greater than 25% of their professional time being the physician of record for inpatients and ultimately return these patients back to the care of the patient’s primary care physician.1,2 The impact of hospitalists on medicine in the United States has been described in economic, clinical, and educational domains.1,3–5 Studies have explored benefits related to the fiscal operations of health care systems,6–13 the impact on patient satisfaction, continuity of care,9,12,14,15 and housestaff education.6,10,16 Although opinions and perspectives exist, absent from the literature are any research descriptions of the impact of hospitalists on medical student education.
In 1995, our Department of Medicine and residency program recognized a progressive decline in medical student and housestaff satisfaction with the educational experiences on the university hospital inpatient rotation. To a large extent, this was attributed to reductions in faculty availability due to increasing clinical and research demands. In response, the Department of Medicine established a hospitalist program with the initial goal of improving housestaff and medical student education. At the end of the first year of operation, as part of an internal quality assessment of the program, we identified some interesting trends in the student evaluations of hospitalist faculty and embarked on further evaluation.
The purpose of this study was to formally assess the impact of hospitalist teaching faculty on the experiences of medical students on their inpatient medicine rotations, as compared to the impact of highly rated nonhospital-based teaching faculty.
We performed a retrospective analysis, comparing third-year medical student evaluations of hospitalist and nonhospitalist ward faculty on their inpatient medicine clerkship rotations.
Setting and Sample
We conducted our study at the 397-bed tertiary-care University Hospital affiliated with Oregon Health & Science University School of Medicine, in Portland, Oregon. Before the formal establishment of the Hospitalist Program in 1998, the university inpatient housestaff teams were staffed by a variety of models. In 1995, based on housestaff evaluative data, such as overall performance, availability and consistency, the number of faculty members was reduced from 51 to 22. In 1998, the Hospitalist Program was formed with six hospitalists staffing 34 to 36 out of 48 months, on one-month rotations. Faculty members from the previously selected attending pool staffed the remaining months.
Full-time hospitalists at our institution attend six months on the inpatient teaching wards and spend three months on a general medicine consult service. During their inpatient rotations, hospitalists are expected to maximize their clinical revenues with complete medical documentation; participate in committees, educational conferences, and in the medical school and intern selection process; and staff an ambulatory clinic one-half day per week. Eleven “nonhospitalists” and three chief medical residents staff the remaining ward months. The nonhospitalist faculty was outpatient based, and had been selected based on previous favorable housestaff feedback and program review. The chief residents attended a total of three months per year, but were considered to be fourth-year residents, and thus were not included in our analysis of faculty evaluations. We analyzed student evaluations comparing hospitalists and nonhospitalists, for the 1998–00 academic years. Data on demographic characteristics were not collected for medical students, but were obtained for the faculty members from our faculty database. The ward model in place during our study consisted of four general medicine inpatient teams, each with one faculty attending, one resident, and one intern. Three teams have one to two third-year medical students whereas one ward team does not have third-year medical students. Third-year medical students receive 12 weeks of internal medicine training and elect to spend six weeks of those either at the university hospital or the affiliated Veterans Affairs Medical Center. The other six weeks is spent at a community-based hospital. The medical student can request the rotation site, but the medical student clerkship office designates team and faculty assignments without student input.
Medical students submit a numeric and qualitative evaluation of each attending they work with at the completion of each of their clerkships (see Table 1). The evaluation forms were created locally, and are loosely based on the work of Skeff et al.17 Faculty were evaluated numerically on a nine-point Likert-type scale (1 = poor; 9 = outstanding) on the following characteristics: communication of rotation goals, establishing a favorable learning climate, use of educational time, teaching style, evaluation and feedback, and two general assessments (contributions to the student’s growth and development, and overall effectiveness as a clinical teacher). Faculty may not review students’ evaluations of them before completing their evaluations of the students. The initial project, data collection, and analysis were part of an internal quality assessment, which later developed into an educational then scholarly focus. Thus, we obtained Institutional Review Board review and endorsement after completing the project.
Statistics and Analysis
At our institution, students’ numeric evaluations of faculty are skewed toward the high end of the Likert-type scale (7–9 on the nine-point scale). Because of this non–bell-shaped response distribution, we analyzed group results using (nonparametric) Mann-Whitney rank sum tests for numeric variables and Fisher exact test for dichotomous variables. All reported p values are two-sided. An administrative assistant not involved in the study entered primary data. We did not review the original evaluations and only viewed aggregated data.
Demographic characteristics of the hospitalist and nonhospitalist faculty evaluated in our study are shown in Table 2. Hospitalists were all general internists who graduated more recently from training programs (4.2 years versus 10.9 years, p = .034) and staffed the inpatient service more months per year then did the nonhospitalist faculty (p < .001). Hospitalists were more likely to be recent graduates from training programs, even with one of them having been in practice for 22 years (p = .034). The nonhospitalists were mostly general internists and a few subspecialists. There were no differences in age, gender, academic rank, specialty, or whether they had a formal role in education.
A total of 138 students rotated on the university wards during the study period; 100 with the hospitalists, and 38 with the nonhospitalists. Of these students, 99 (71.7%) returned evaluations (see Table 3). We reviewed data from all 99 evaluations. There was no statistical difference in the percentage of submitted medical student evaluations when we compared evaluations of hospitalists (72.0%) to evaluations of nonhospitalists (71.1%, p = .912). The hospitalists received higher numeric evaluations for all individual attending characteristics (see Table 3). Of these, statistical significance was demonstrated when we compared communication of rotation goals (p = .011), effectiveness as a clinical teacher (p = .016), and for the combined analysis of all parameters (p < .001). There was no significant difference between hospitalists and nonhospitalists when we looked at learning climate, use of educational time, teaching style, evaluation and feedback, and contributing to the growth and development. Evaluation results did not differ significantly among hospitalists.
Academic hospitalists constitute the minority of hospitalists in the United States,2 yet they have great potential to affect medical trainees at all levels.3–5 Although others have evaluated the impact of hospitalists on resident perceptions of education,5,10,18–21 we present the first discussion of medical student assessment of hospitalists as teachers in a university-based inpatient clerkship rotation.
Our study demonstrates that in addition to performing the responsibilities required of a full-time hospital-based physician, hospitalists in our program were able to provide at least as positive an educational experience as did highly rated nonhospitalist teaching faculty. Medical students felt the hospitalists were more likely to communicate clear goals for the rotations, and to demonstrate favorable skills as clinical teachers. Numerous factors may have contributed to the increased student satisfaction. First, because of the nature of their job description and departmental support for teaching, the hospitalists were more likely to be available in the afternoons, and thus may have had more contact time with students. Students may have favorably perceived this increased availability. Second, hospitalists were selected based on their enthusiasm for teaching which may have been evident to student learners. Although all the hospitalists were selected based on their interest in teaching, our results were reassuring because the nonhospitalist faculty were already viewed as highly effective and respected teachers.
The most significant limitation of our study was that it was retrospective and conducted at a single institution. Although these limitations raise questions of broader applicability, we believe that the initial observations are likely not unique and can likely can be applied on a broader scale. Based on the study design, there may have been several biases affecting the results. First, because one of the core objectives of the hospitalist program was to improve the educational experience of our trainees, this focus on education may have favored the hospitalists. Although this may be true, we also believe this is one of the strengths of our program and faculty. This potential bias was likely mitigated to some degree since the nonhospitalist faculty had already been selected based on their strong performance as educators. We believe this only strengthens the conclusions of our study. Third, the students’ selection of the university rotations was nonrandom, but because individual faculty assignments were made independently of student preferences, there was likely no response bias. Finally, our study more accurately reflected an evaluation comparing academic hospital-based physicians to academic nonhospital-based physicians, and, thus, our results may not be generalizable for evaluating a private staffing model that employs hospitalists.
In conclusion, there continues to be scant literature exploring the impact of hospitalists on medical students’ experience on inpatient rotations. Future evaluation should be conducted to reproduce our findings as well as to assess the impact of hospitalists on measurable knowledge and skills outcomes, not just learner satisfaction; and to assess the impact of increased faculty (hospitalist) presence on the autonomy and decision making of learners. Our study provides early evidence that hospitalists can provide as positive, and maybe better, educational experiences to medical students on inpatient internal medicine rotation, as do traditional highly-rated nonhospitalist faculty.
The authors would like to thank D. Lynn Loriaux, MD, (chairman, Department of Medicine, Oregon Health & Science University) for essential support and review of the manuscript, and John Benson, MD (dean, emeritus, Oregon Health & Science University School of Medicine), Donald E. Girard, MD (associate dean for graduate medical education, Oregon Health & Science University), Gordon Noel, MD (chief medicine service, Portland Veterans Affairs Hospital) and Judith A Bowen, MD (chief, Division of General Medicine and Geriatrics, Oregon Health & Science University) for critical appraisal, advise, and counsel.
1.Wachter RM, Goldman L. The emerging role of “hospitalists” in the American health care system. N Engl J Med. 1996;335(7):514–7.
2.Lindenauer PK, Pantilat SZ, Katz PP, Wachter RM. Hospitalists and the practice of inpatient medicine: results of a survey of the National Association of Inpatient Physicians. Ann Intern Med. 1999;130:343–9.
3.Goldman L. The impact of hospitalists on medical education and the academic health system. Ann Intern Med. 1999;130:364–7.
4.Sox HC. The hospitalist movement: perspectives of the patient, the internist, and internal medicine. Ann Intern Med. 1999;130:368–72.
5.Schroeder SA, Schapiro R. The hospitalist: new boon for internal medicine or retreat from primary care?Ann Intern Med. 1999;130:382–7.
6.Brown MD, Halpert A, McKean S, Sussman A, Dzau VJ. Assessing the value of hospitalists to academic health centers: Brigham and Women’s Hospital and Harvard Medical School. Am J Med. 1999;106:134–7.
7.Craig DE, Hartka L, Kikosky WH, Caplan WM, Litsky P, Smithey J. Implementation of a hospitalist system in a large health maintenance organization: the Kaiser Permanente experience. Ann Intern Med. 1999;130:355–9.
8.Diamond HS, Goldberg E, Janosky JE. The effect of a full-time faculty hospitalist on the efficiency of care at a community teaching hospital. Ann Intern Med. 1998;129:197–203.
9.Freese RB. The Park Nicollet experience in establishing a hospitalist system. Ann Intern Med. 1999;130:350–4.
10.Wachter RM, Katz P, Showstack J, Bindman AB, Goldman L. Reorganizing an academic medical service. JAMA. 1998;279(19):1560–5.
11.Stein MD, Hanson S, Tammaro D, Hanna L, Most A. Economic effects of community versus hospital-based faculty pneumonia care. J Gen Intern Med. 1998;13:774–7.
12.Davis KM, Koch KE, Harvey KJ, Wilson R, Englert J, Gerard P. Effects of hospitalists on cost, outcomes and patient satisfaction in a rural health system. Am J Med. 2000;108:621–6.
13.Wachter RM, Whitcomb WF, Nelson JR. Financial implications of implementing a hospitalist program. Healthc Financ Manage. 999:48–51.
14.Redelmeier DA. A Canadian perspective on the American hospitalist movement. Arch Intern Med. 1999;159:1665–8.
15.Dowling PT. The Hospitalist and the care of the patient. West J Med. 1999;171:371–2.
16.Whitcomb WF, Nelson JR. The role of hospitalists in medical education. Am J Med. 1999;107:305–9.
17.Skeff KM, Stratos GA, Berman J, Bergen MR. Improving clinical teaching: evaluation of a national dissemination program. Arch Intern Med. 1992;152:1156–61.
18.Hauer KH, Wachter RM. Implications of the Hospitalist Model for Medical Students’ Education. Acad Med. 2001;76(4):324–30.
19.Showstack J, Katz PP, Weber E. Evaluating the impact of hospitalists. Ann Intern Med. 1999;130:376–81.
20.Landrigan C, Muret-Wagstaff S, Chiang VW, Nigrin D, Goldmann D, Finkelstein J. Effect of a Pediatric Hospitalist System on Housestaff Education and Experience. Arch Pediatr Adolesc Med. 2002;156(9):877–83.
21.Chung P, Morrison J, Jin L, Levinson W, Humphrey H, Meltzer D. Resident Satisfaction on an Academic Hospitalist Service: Time to Teach. Am J Med. 2002;112(7):597–601.
This article has been cited 20 time(s).
American Journal of MedicineClosing the gap between internal medicine training and practice: Recommendations from recent graduatesAmerican Journal of Medicine
Clinical TherapeuticsImproving the management of patients after myocardial infarction, from admission to dischargeClinical Therapeutics
Journal of the National Medical Association
Hospitalists in medical education: Coming to an academic medical center near you
Journal of the National Medical Association, 98(9):
American Journal of MedicineEvolution of an academic hospitalist program: Clinical, educational, and financial valueAmerican Journal of Medicine
American Journal of MedicineThe future of hospital medicine: Evolution or revolution?American Journal of Medicine
Medical EducationUse of critical incidents to develop a rating form for resident evaluation of faculty teachingMedical Education
Mount Sinai Journal of MedicineHospitalist Educators: Future of Inpatient Internal Medicine TrainingMount Sinai Journal of Medicine
Teaching and Learning in MedicineMedical subinternship: Student experience on a resident uncovered hospitalist serviceTeaching and Learning in Medicine
Medical Clinics of North AmericaThe state of hospital medicine in 2008Medical Clinics of North America
Journal of General Internal Medicine
Hospitalists in teaching hospitals: Opportunities but not without danger
Journal of General Internal Medicine, 19(4):
Learning/feedback activities and high-quality teaching: Perceptions of third-year medical students during an inpatient rotation
Academic Medicine, 80():
Journal of PediatricsHospitalists in children's hospitals: What we know now and what we need to knowJournal of Pediatrics
Archives of Internal Medicine
Archives of Internal Medicine, 168():
Journal of Hospital Medicine
Introduction to the core competencies in hospital medicine
Journal of Hospital Medicine, 1():
Swiss Medical Weekly
The expanding role of hospitalists in the United States
Swiss Medical Weekly, 136():
Journal of Hospital MedicineCore competencies in hospital medicine: Development and methodologyJournal of Hospital Medicine
Journal of Hospital MedicineThird-year medical students' evaluation of hospitalist and nonhospitalist faculty during the inpatient portion of their pediatrics clerkshipsJournal of Hospital Medicine
Journal of Hospital MedicineEffect of Hospitalist Attending Physicians on Trainee Educational Experiences: A Systematic ReviewJournal of Hospital Medicine
Southern Medical JournalHospitalist Physicians as Educators in a Community Hospital: The Trainee’s ViewSouthern Medical Journal
© 2004 Association of American Medical Colleges