Internal Medicine Clerkship Characteristics Associated With Enhanced Student Examination Performance
Griffith, Charles H. III MD; Wilson, John F. PhD; Haist, Steve A. MD; Albritton, T Andrew MD; Bognar, Bryan A. MD, MPH; Cohen, Stuart J. MD; Hoesley, Craig J. MD; Fagan, Mark J. MD; Ferenchick, Gary S. MD; Pryor, Othelia W. PhD; Friedman, Erica MD; Harrell, Heather E. MD; Hemmer, Paul A. MD; Houghton, Bruce L. MD; Kovach, Regina MD; Lambert, David R. MD; Loftus, Tayloe H. MD; Painter, Thomas D. MD; Udden, Mark M. MD; Watkins, Raquel S. MD; Wong, Raymond Y. MD
Dr. Griffith is professor of medicine, University of Kentucky College of Medicine, Lexington, Kentucky.
Dr. Wilson is professor of behavioral science, University of Kentucky College of Medicine, Lexington, Kentucky.
Dr. Haist is associate vice president for test development, National Board of Medical Examiners, Philadelphia, Pennsylvania.
Dr. Albritton is professor of medicine, Medical College of Georgia, Augusta, Georgia.
Dr. Bognar is associate professor of internal medicine, University of South Florida College of Medicine, Tampa, Florida.
Dr. Cohen is associate professor of medicine, University of Alabama at Birmingham School of Medicine, Birmingham, Alabama.
Dr. Hoesley is associate professor, University of Alabama at Birmingham School of Medicine, Birmingham, Alabama.
Dr. Fagan is professor of medicine, Brown University School of Medicine, Providence, Rhode Island.
Dr. Ferenchick is professor of medicine, Michigan State University College of Human Medicine, East Lansing, Michigan.
At the time of this study, Dr. Pryor was assistant professor of internal medicine, Michigan State University College of Human Medicine, East Lansing, Michigan.
Dr. Friedman is associate dean for undergraduate medical education, Mount Sinai School of Medicine, New York, New York.
Dr. Harrell is associate professor of medicine, University of Florida College of Medicine, Gainesville, Florida.
Dr. Hemmer is professor of medicine, Uniformed Services University of the Health Sciences–F. Edward Hebert School of Medicine, Bethesda, Maryland.
Dr. Houghton is associate professor of medicine, Creighton University School of Medicine, Omaha, Nebraska.
Dr. Kovach is director, Third-Year Curriculum, Southern Illinois University School of Medicine, Springfield, Illinois.
Dr. Lambert is senior associate dean of medical student education, University of Rochester School of Medicine and Dentistry, Rochester, New York.
Dr. Loftus is professor of medicine, State University of New York Upstate Medical University, Syracuse, New York.
Dr. Painter is professor of medicine, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania.
Dr. Udden is professor of medicine, Baylor College of Medicine, Houston, Texas.
Dr. Watkins is assistant professor of medicine, Wake Forest University School of Medicine, Winston-Salem, North Carolina.
Dr. Wong is program director, Student Education in Internal Medicine, Loma Linda University School of Medicine, Loma Linda, California.
Please see the end of this article for information about the authors.
Correspondence should be addressed to Dr. Griffith, K507 Kentucky Clinic, Lexington, KY, 40536-0284; telephone: (859) 257-5499; fax: (859) 257-2605; e-mail: (email@example.com).
Purpose: To determine which internal medicine (IM) clerkship characteristics are associated with better student examination performance.
Method: The authors collected data from 17 U.S. medical schools (1,817 students) regarding characteristics of their IM clerkships, including structural characteristics, pedagogical approaches, patient contact, and clinical teacher characteristics. Outcomes of interest were postclerkship National Board of Medical Examiners (NBME) subject examination score, United States Medical Licensing Examination (USMLE) 2 score, and change in score from USMLE 1 to 2. To examine how associations of various clerkship characteristics and examination performance may differ for students of different prior achievement, the authors categorized students into those who scored in the top ¼ of the cohort on USMLE 1 and the bottom ¼. The authors conducted analyses at both the school and the individual student levels.
Results: In school-level analyses (using a reduced four-variable model), independent variables associated with higher NBME subject examination score were more small-group hours/week and use of community-based preceptors. Greater score increase from USMLE 1 to 2 was associated with students caring for more patients/day. Several variables were associated with enhanced student examination performance at the student level. The most consistent finding was that more patients cared for per day was associated with higher examination performance. More structured learning activities were associated with higher examination scores for students with lower baseline USMLE 1 achievement.
Conclusion: Certain clerkship characteristics are associated with better student examination performance, the most salient being caring for more patients per day.
Surprisingly, the academic medicine community knows little of how the characteristics of clinical clerkships influence student learning.1 For example, one would surmise that students on longer clinical clerkships in a particular discipline would learn more about that discipline, but results of studies of clerkship length and examination performance have been mixed,1–8 and—even in the positive studies—explain only 1% to 2% of the variance in examination scores.4,5 Clerkship directors often decide on a pedagogical approach (lectures, small-group discussion, computer-based instruction), but little is known about which approaches are most effective for student learning in clinical clerkships. Some studies assume lectures are necessary to deliver curriculum and enhance learning; these show that style of lecture delivery (Web-based, telemedicine, PowerPoint) makes no difference in student learning outcomes.9–12 To our knowledge, Oregon Health Sciences University conducted the only study comparing student learning in a clerkship with and without a core lecture series; in this 1980s study, National Board of Medical Examiners (NBME) subject examination scores in medicine were about a half a standard deviation higher after the implementation of a 50-hour lecture series that was delivered across a 12-week clerkship compared with the scores of students who experienced no lecture series.13 Two other studies suggested the importance of lectures. Their results showed that students who fail to attend lectures or complete case study assignments do not perform as well on NBME subject examinations,14,15 although one wonders whether habitual student absence reflects inherent student characteristics, which explain the lower examination scores more than the content missed from lecture. Finally, small-group discussions as a means of curriculum delivery typically engage students more than lecture formats, but they are not associated with enhanced student learning as measured by scores on written examinations.16 In summary, some sort of structured curriculum (such as a core lecture series) seems to be important for student learning, but only two studies from the 1980s have documented this13,17; the literature has not supported the superiority of one pedagogical approach over another.
One could posit that student learning is most affected and most engrained by learning from patient encounters, but the evidence for this supposition is also sparse. For example, the volume of patients a student encounters has not been associated with enhanced student learning, at least as measured by examination scores.8,18–21 Site of patient encounters could be influential. For example, encountering patients in ambulatory settings would seem ideal for student learning, given that the broader array of common clinical conditions experienced in the outpatient setting is much more representative of usual clinical practice than that experienced in quaternary care academic medical centers.1 Nevertheless, the evidence that students learn more in ambulatory settings than in inpatient settings is sparse. An occasional single-site study shows a positive correlation,22 but most studies fail to show such an advantage.1,8,23 Longitudinal ambulatory rotations and experiences seem compelling, allowing for continuity of care, continuity of curriculum, and continuity of supervision.24 Yet, again, the literature does not support the conclusion that these experiences enhance student learning, and some studies actually suggest an association with decrements in selected examination performances.25–27 In contrast to the inconclusive evidence about the influence of location or type of clinical rotation on student learning, several studies have documented the benefits of excellent clinical teaching in enhancing student examination performance.28–33 Excellent resident teaching may be even more critical to enhanced student learning.31,32
One could conclude from these studies that the length of clerkships, pedagogical approaches to undergraduate medical education, the type of clerkship sites, and the type and number of patients encountered are all irrelevant to student learning. In other words, just send students out to work with the better teachers and learning will occur. Such a conclusion would be premature because these studies have many limitations. For one, the vast majority of them are single-institution, raising questions of generalizability.2–3,6–22,26–33 In addition, many of these studies, even those that include multiple institutions (such as those from NBME data sets4–5,8), generally focus on just one structural variable,2–3,6–19,21,22,26–33 such as length of clerkship, percentage of ambulatory time, number of lectures, or number of patients seen; these studies do not consider how these variables all interact in various ways to affect learning. For example, the results of one rare study that, to a degree, did consider this interplay, showed that volume of clinical experiences alone did not predict the attainment of student “competence” on clerkship examinations, but the interaction of quality clinical supervision with patient volume was influential.20 Finally, these studies do not take into account differences in students. For example, one could posit that high-achieving students may benefit less from formal didactic exercises or formal teaching rounds, suggesting that a one-curricular-approach-fits-all strategy is a fallacy. The purpose, therefore, of this project was to determine which IM clerkship characteristics were associated with better student examination performance, across multiple institutions, considering a multitude of clerkship characteristics. We hypothesized that various clerkship structural features, pedagogical approaches, teacher characteristics, and patient contact would be associated with differences in student examination performance, and that these variables would differ for students of high and low past examination achievement.
Participants were a convenience sample of clerkship directors well known to the principal investigator (PI; C.G.) from interactions at the Clerkship Directors of Internal Medicine national meetings. The PI selected the schools to achieve diversity of both geography and school characteristics (large, medium, small; private or not) and to broadly represent the 126 U.S. IM clerkships. NBME exam and United States Medical Licensing Examination (USMLE) exam results for these schools were similar to national averages. The clerkship directors, all coinvestigators, participated in the study design including achieving funding for the project, refining the questions, and attaining IRB approval from their institutions. An important criterion to participate was the use of the NBME subject examination in medicine as a clerkship final examination. Of 19 clerkship directors solicited (including the PI), 2 were unable to participate because they did not use the NBME subject examination in their program.
Our conceptual framework suggested that several clerkship characteristics could influence student learning:
(1) structural characteristics,
(2) pedagogical approaches,
(3) patient contact, and
(4) clinical teacher characteristics.
On the basis of this framework, in the spring of 2003 the PI conducted a semistructured, 30-minute telephone interview of participating clerkship directors regarding characteristics of their clerkships.
Table 1 shows the characteristics we examined. We knew some characteristics (length of clerkship, % ambulatory time) with absolute certainly. Some data (e.g., the average number of patients on a student’s ward service) represent our best estimate, based on our knowledge of the teaching services and sites on our clerkships. In addition, some of these characteristics (e.g., presence of hospitalists, whether a faculty member is a generalist or not, and faculty members’ average months of attending per year and length of inpatient attending rotations) were included in the study data set because we hypothesized that these characteristics could potentially be associated with student learning, although at the time of this study no literature existed on these variables’ influence. In addition, we could conceptualize some variables in different ways (such as weeks of ambulatory time versus percentage of ambulatory time; total hours of lecture or small-group time versus hours per week), so we performed separate analyses, operationalizing these variables in these different ways, and the results were similar.
Each site coinvestigator provided data regarding examination scores from individual students who rotated on their third-year IM clerkship in academic year 2002–2003 (each student in the data set remained anonymous). Examination scores included those on the NBME subject examination in medicine, USMLE 1, and USMLE 2.
Our primary analysis used multiple linear regression approaches from the general linear model. Unit of analysis presented a challenge. On the one hand, many of our clerkship characteristics (e.g., length of clerkship, average number of patients for whom a student cares) represent data on a school level, so the most conservative analysis entailed the school as unit of analysis. On the other hand, for our investigation into how clerkship characteristics affect students of different prior academic achievement, the individual student seemed the more appropriate unit of analysis, and we performed these student-level analyses as well. One outcome of interest was the score on the NBME subject examination in medicine. We used each school’s mean NBME subject examination score as the value in school-level analyses, and individual NBME subject examination scores in the student-level analyses. Independent variables included all the clerkship characteristics listed in Table 1. Each variable produced a true two-tailed hypothesis in that we could posit the influence of each variable in a positive or negative fashion. For example, we could hypothesize that students would learn more from being involved in the care of more patients. On the other hand, caring for too many patients could compromise reading time and, therefore, compromise learning. For school-level analyses, the small number of degrees of freedom (n = 17) prohibited using all clerkship characteristics in analyses and limited the power of the analyses. To compensate in different analyses, we included one variable from each of the four categories of our conceptual model as an independent variable, based on those variables that exhibited the best distribution across our 17 schools (the structural characteristic of length of clerkship; the pedagogical approach of numbers of small-group hours per week; the patient-contact variable of average number of patients per day for whom a student cares; and whether the attending faculty in the inpatient setting was community based or not). We used SAS statistical software (Copyright 2009 SAS Institute Inc., Cary, North Carolina).
As stated above, some evidence suggests that aspects of an IM clerkship—specifically, exposure to the “best” clinical teachers—can have sustained beneficial effects, as suggested by higher USMLE 2 scores.29,30 To analyze the effect of teaching on USMLE 2 scores, we used mean USMLE 2 score from each school for the school-level analyses. For the student-level analyses, we used the individual student’s score. In addition, we studied a third outcome of interest: the change in score from USMLE 1 to USMLE 2. We used the individual student’s change score in the student-level analyses. Change score by school is less useful because, within a school, mean student scores on USMLE 1 and 2 are very similar. Instead, we chose to focus on the percentage of students within a school who had significant changes from their USMLE 1 to USMLE 2 scores. We defined “significant” change as a difference of at least ½ standard deviation on the test, which amounted to a change in score of 10 points or more.
In addition, a primary purpose of our study was to investigate how clerkship structural variables associated with enhanced student learning might differ for students of higher versus lower prior academic achievement. We could account for prior academic achievement by using students’ USMLE 1 scores as a control variable, as indeed, many studies have suggested that USMLE 1 score does account for much of the variance in USMLE 2 scores (62% of the variance in one study).5 However, for our study, we were interested in what aspects of clinical clerkships explained student examination performance over and above Step 1 scores. In addition, in our initial examination of the distribution of the study data, we found that the use of the USMLE 1 score violated assumptions in that it was not equally linear across the range of the two prime dependent variables, USMLE score and NBME subject examination. Thus, correcting for the score for either school- or individual student-level analyses would not be appropriate. In addition, given that regression to the mean occurs for many students on licensing and other examinations, for the purposes of student-level analyses we categorized students into two distinct groups that would be unlikely to have much overlap: those in the top ¼ of USMLE 1 scores (those who earned a score of 233 or higher) and those with the bottom ¼ of USMLE 1 scores (those who earned a score of less than 200), analyzing these groups separately. This approach allowed us
(1) to control for level of performance on USMLE 1,
(2) to avoid the problem of covariance assumptions that we encountered with normal use of USMLE 1 as a regression control covariate, and
(3) to correct for much of the problem of regression to the mean.
In addition, this approach makes conceptual sense because high and low scorers on USMLE 1 are likely to differ in multiple characteristics (background, motivation, preparation, expectations) that are not really linear dimensions. In essence, both statistically and conceptually, we believed that high and low scorers represented two different types of students and that such an analytic framework would best represent the data.
Balancing Type I and Type II errors is always a dilemma for studies that have multiple predictor and outcome variables. We tried to mitigate these errors by reducing the number of absolute comparisons; however, we believe that the only real confirmation must come from replication, and, in this type of study, Type II errors are the major concern. Another approach we used to balance Type I and II errors was an analytic style that tried to determine how robust each finding was. We did this by examining the statistically significant findings for potentially spurious relationships (correlations with other factors) and by using regression influence statistics to determine whether statistical outliers were overly influencing the findings.
We received data regarding 1,817 students from 17 different medical schools. Sixteen of the schools provided data about all of their students. One school’s IRB required prospective written informed consent from students for the use of their examination scores, and subsequently fewer than 50% of students signed such a consent. However, results were similar with or without this school’s data in the study analysis, so, for purposes of presentation, the findings below include data from all 17 schools.
Mean USMLE 1 score was 216.9 (SD 21.2), mean USMLE 2 score was 216.4 (SD 22.3), and mean NBME subject examination score was 73.8 (SD 7.6). Mean student Step 1 to Step 2 change score was −0.4 (SD 17.1), with a range of −58 to + 75. On a school level, the mean percentage of students who had significant improvements in their Step 1 to Step 2 score was 27.9% (SD 9.0; range 17.1%–50.5%); the mean percentage of students who had significant decrements in their Step 1 to Step 2 score was 27.5% (SD 9.4; range 8.7%–44.9%). For the cohort of students who had scored in the top ¼ on USMLE 1, the mean USMLE 2 score was 237.3 (SD 15.8; range 183–275), and the mean NBME subject examination score was 79.9 (SD 7.1; range 57–97). For the students who scored in the bottom ¼ of USMLE 1, the mean USMLE 2 score was 196.5 (SD 16.3; range 151–242) and the mean NBME subject examination score was 68.2 (SD 5.7; range 51–99). Table 1 summarizes the results from the various clerkship characteristics.
In school-level analyses (N = 17), we used a conceptual model that included the clerkship characteristic of length of clerkship; the pedagogical approach of numbers of small-group hours per week; the patient-contact variable of average number of patients per day for whom a student cared; and whether the attending faculty in the inpatient was community based or not. In this model, independent factors that were associated with higher mean NBME scores included a larger number of small-group hours per week (F = 4.37; P < .05) and use of community-based preceptors (F = 4.74; P < .05). The R2 of the model was 0.44, suggesting that the model explained 44% of the variance in NBME subject examination scores. For mean USMLE 2 score, no variable emerged as significantly associated. However, the percentage of students in the school with significant improvement in their USMLE 1 to USMLE 2 score was associated with a greater number of patients per day on average for whom these third-year students cared (F = 7.93; P < .01; R2 0.47). Similarly, the fewer the number of patients the third-year students followed on average was associated with a greater percentage of students with a significant drop in scores from USMLE 1 to 2 (F = 6.55; P < .02; R2 0.44).
Table 2 summarizes the findings from the student-level analyses. For students who achieved high USMLE 1 scores, factors that were associated significantly with higher NBME subject examination scores were more patients cared for per day, greater length of rounds with the attending, and any use of computer-based instruction. Higher USMLE 2 scores were associated with longer attending rotations (four weeks versus two weeks) and any use of hospitalists. Greater increase in USMLE 1 to USMLE 2 was associated with more patients cared for per day, any use of hospitalists, and four-week (versus two-week) attending rotations. For students who achieved low USMLE 1 scores, factors that were associated significantly with higher NBME subject examination score were a greater number of small-group hours, any use of computer-based instruction, use of a separate teaching attending, greater ambulatory time, and more clerkship weeks. Higher USMLE 2 scores were associated with more patients cared for per day and a greater number of small-group hours. Greater increase in USMLE 1 to USMLE 2 was associated with more patients cared for per day, four-week (versus two-week) attending rotations, and more admissions to the ward services per call night. R2 for these models ranged from 0.08 to 0.21.
Our study is unique in accounting for a large number of clerkship structural characteristics across multiple institutions. Unlike the high number of negative or equivocal studies done in the past, our findings suggest that many aspects of IM clinical clerkships are associated with enhanced student learning, as measured by performance on NBME-type examinations. Perhaps the most consistent finding is that higher examination performance is associated with students caring for more patients. Even after taking into account other clerkship pedagogical practices, contact with patients is the most salient factor for most of our outcomes. This is especially true of outcomes that reflect more engrained learning, such as performance on USMLE 2. In an era in which patient contact is more harried (in busy inpatient and outpatient settings) and in which instructional supplements (e.g., standardized patients, computerized virtual patients) are advocated, contact with patients still remains the factor that is most associated with and appears most influential for student learning.
One should be cautious and not interpret our results to suggest that other clerkship characteristics are unimportant, a form of pedagogical nihilism. Indeed, an interesting finding unique to our study is that the more structured pedagogical approaches (a greater number of small-group hours, computer-based instruction, and formal rounds with a separate teaching attending—not lectures, however) seem to benefit the students who achieve lower scores, especially for the postclerkship subject examination. Studies that fail to show improvements in learning from various educational interventions should take into account the fact that different educational strategies may benefit one group of students more than the others. High-achieving students may learn regardless of a lecture series or small-group sessions; nevertheless, course directors should consider that the lower-achieving students may need that more formal structured curriculum. Future studies should continue this line of investigation, examining how various clerkship teaching strategies affect different types of students.
In addition, one should not use our findings to suggest that third-year medical students should care for huge numbers of patients. Indeed, our clerkship directors generally expected students to follow three to four patients, and the most expected was five to six. We speculate that there is a threshold effect; that is, at some point, too many patients results in an inability to learn from an individual patient, with reading time and reflection time curtailed. In addition, we do not have data on exactly how many patients individual students followed, just how many patients they were expected to follow. We surmise that in clerkships where students are expected to care for more patients, they probably do, and our student census numbers are comparable to what students themselves report (mean number of patients 3.2, SD 1.1 in one large multisite study).34 Nevertheless, future research should consider actual numbers of patients per student, taking into account other clerkship structural variables and such factors as patient acuity and complexity, not just raw numbers.
Our study has several limitations. For one, many of our measures were quite crude. For example, we specified neither the degree of computer-based instruction nor what, exactly, having community-based faculty on the wards entails; we simply categorized each of these (and some other measures) as yes or no. In addition, measuring precisely such variables as the number of patients an individual student followed or the exact rounding characteristics of each individual student’s attending was beyond the scope of this study (besides the challenges of measuring these variables, accounting for such factors as the complexity of students’ patients or the quality of time teaching versus rounding is extremely difficult; these are daunting, but perhaps ripe, areas for future study). The crudeness of some of our measures added error variance to our analyses, and it would have been a great concern if we had demonstrated negative findings. Indeed, because of the imprecision of measures, one should be cautious in interpreting as definitive the variables that we found to have no association with examination performance. However, showing statistically significant associations despite this background “noise” in the data set strengthens our confidence in our primary findings. Nevertheless, even though our study does provide some answers to which clerkship characteristics are or are not especially associated with student learning, these answers are not definitive; rather, our study’s answers are most useful for pointing the direction for future research in this area.
A second limitation is that most of our clerkship variables reflect inpatient experiences, with ambulatory experiences merely the percentage of time in clinics. Originally, we aimed to ascertain in more detail the influence of ambulatory characteristics, such as whether faculty were community based or not, the type of practice, the types of patients seen, and so on. However, what became apparent in our semistructured interviews was that course directors had detailed and intimate knowledge of the inpatient services, as those experiences were more uniform for students, with similar hospital and ward teams. However, ambulatory experiences reflected a huge number of permutations involving many different practices and faculty across a wide array of settings, many of them off-site, and clerkship directors knew only cursory details of these rotations. Future work should investigate in more detail the influence of ambulatory clerkship characteristics on student learning. Third, our outcomes are limited to national board-type multiple-choice examinations. Clerkship characteristics may influence many other outcomes such as student attitudes, the development of professionalism, and clinical skills.35
Still, despite these limitations, our study has many strengths, including the cross-institution study design, data on a variety of clerkship variables rather than a single characteristic, data on both short-term (NBME subject examination) and long-term (USMLE 2 examinations) learning outcomes, and a focus on students with different prior academic achievement, which captures the notion that clerkship features may have a different influence on different types of students.
A structured curriculum and pedagogical approach is associated with enhanced learning especially for the lower-achieving students, particularly for achievement on end-of-clerkship examinations. A variety of clerkship characteristics are associated with enhanced student learning, but, in the end, the most beneficial aspect of clinical clerkships in terms of student learning is caring for patients.
This project was funded (in part) by the National Board of Medical Examiners (NBME) Edward J. Stemmler, MD Medical Education Research Fund Grant. The project does not necessarily reflect NBME policy, and NBME support provides no official endorsement.
1 Irby DM. Teaching and learning in ambulatory settings: A thematic review of the literature. Acad Med. 1995;70:898–931.
2 Edwards RK, Davis JD, Kellner KR. Effect of obstetrics–gynecology clerkship duration on medical student examination performance. Obstet Gynecol. 2000;95:160–162.
3 Myles TD. Effect of a shorter clerkship on third-year obstetrics and gynecology final examination scores. J Reprod Med. 2004;49:99–104.
4 Case SM, Ripkey DR, Swanson DB. The effects of psychiatry clerkship timing and length on measures of performance. Acad Med. 1997;72(10 suppl):S34–S36.
5 Ripkey DR, Case SM, Swanson DB. Predicting performances on the NBME surgery subject test and USMLE Step 2: The effects of surgery clerkship timing and length. Acad Med. 1997;72(10 suppl):S31–S33.
6 Jacobson MJ, Sherman L, Perlman I, Lefferts R, Soroff H. Clerkship site and duration: Do they influence student performance? Surgery. 1986;100:306–311.
7 Huang WY, Dains JE, Chang TH, Rogers JC. Does a reduction in family medicine clerkship time affect educational outcomes? Fam Med. 2001;33:435–440.
8 Fincher RM, Case SM, Ripkey DR, Swanson DB. Comparison of ambulatory knowledge of third-year students who learned in ambulatory settings with that of students who learned in inpatient settings. Acad Med. 1997;72(10 suppl):S130–S132.
9 Solomon DJ, Ferenchick GS, Laird-Fick HS, Kavanaugh K. A randomized trial comparing digital and live lecture formats. BMC Med Educ. 2004;4:27.
10 Stain SC, Mitchell M, Belue R, et al. Objective assessment of videoconferenced lectures in a surgical clerkship. Am J Surg. 2005;189:81–84.
11 Martin VL, Bennett DS. Creation of a Web-based lecture series for psychiatry clerkship students: Initial findings. Acad Psychiatry. 2004;28:209–214.
12 Ricer RE, Filak AT, Short J. Does a high tech (computerized, animated PowerPoint) presentation increase retention of material compared to a low tech (black on clear overheads) presentation? Teach Learn Med. 2005;17:107–111.
13 Magarian GJ. Influence of a medicine clerkship conference series on students’ acquisition of knowledge. Acad Med. 1993;68:923–926.
14 Riggs JW, Blanco JD. Is there a relation between student lecture attendance and clinical science subject examination score? Obstet Gynecol. 1994;84:311–313.
15 Shokar GS, Burdine RL, Callaway M, Bulik RJ. Relating student performance on a family medicine clerkship with completion of Web cases. Fam Med. 2005;37:620–622.
16 Fischer RL, Jacobs SL, Herbert WN. Small-group discussion versus lecture format for third-year students in obstetrics and gynecology. Obstet Gynecol. 2004;104:349–353.
17 Ende J, Pozen JT, Levinsky NG. Enhancing learning during a clinical clerkship: The value of a structured curriculum. J Gen Intern Med. 1986;1:232–237.
18 Neumayer L, McNamara RM, Dayton M, Kim B. Does volume of patients seen in an outpatient setting impact test scores? Am J Surg. 1998;175:511–514.
19 Libbin JB, Hauge LS, Myers JA, Millikan KW. Evaluation of student experience and performance in a surgical clerkship. Am Surg. 2003;69:280–286.
20 Wimmers PF, Schmidt HG, Splinter TA. Influence of clerkship experiences on clinical competence. Med Educ. 2006;40:450–458.
21 Chåtenay M, Maguire T, Shakun E, Chang G, Cook D, Warnock GL. Does volume of clinical experience affect performance of clinical clerks on surgery exit examinations? Am J Surg. 1996;172:366–372.
22 Grum CM, Richards PJN, Woolliscroft JO. Consequences of shifting medical-student education to the outpatient setting: Effects on performance and experiences. Acad Med. 1996;71(1 suppl):S99–S101.
23 Bowen JL, Irby DM. Assessing quality and costs of education in the ambulatory setting: A review of the literature. Acad Med. 2002;77:621–680.
24 Hirsh DA, Ogur B, Thibault GE, Cox M. “Continuity” as an organizing principle for clinical education reform. N Engl J Med. 2007;356:858–866.
25 Ogrinc G, Mutha S, Irby DM. Evidence for longitudinal ambulatory care rotations: A review of the literature. Acad Med. 2002;77:688–693.
26 Frattarelli LC, Kamemoto LE. Obstetrics and gynecology medical student outcomes: Longitudinal multispecialty clerkship versus traditional block rotations. Am J Obstet Gynecol. 2004;191:1800–1804.
27 Lewin LO, Papp KK, Hodder SL, et al. Performance of third-year primary-care track students in an integrated curriculum at Case Western Reserve University. Acad Med. 1999;74(suppl 1):S82–S89.
28 Griffith CH, Wilson JF, Haist SA, Ramsbottom-Lucier M. Relationships of how well attending physicians teach to their students’ performances and residency choices. Acad Med. 1997;72(10 suppl 1):S118–S120.
29 Griffith CH, Georgesen JC, Wilson JF. Six-year documentation of the association between excellent clinical teaching and improved students’ examination performances. Acad Med. 2000;75(10 suppl):S62–S64.
30 Griffith CH, Wilson JF, Haist SA, Ramsbottom-Lucier M. Do students who work with better housestaff in their medicine clerkship learn more? Acad Med. 1998;73(10 suppl):S57–S59.
31 Blue AV, Griffith CH, Wilson JF, Sloan DA, Schwartz RW. Surgical teaching quality makes a difference. Am J Surg. 1999;177:86–89.
32 Roop SA, Pangaro L. Effect of clinical teaching on student performance during a medicine clerkship. Am J Med. 2001;110:205–209.
33 Stern DT, Williams BC, Gill A, Gruppen LD, Woolliscroft JO, Grum CM. Is there a relationship between attending physicians’ and residents’ teaching skills and students’ examination scores? Acad Med. 2000;75:1144–1146.
34 Guarino CM, Ko CY, Baker LC, Klein DJ, Quiter MS, Escarce JJ. Impact of instructional practices on student satisfaction with attendings’ teaching in the inpatient component of internal medicine clerkships. J Gen Intern Med. 2006;21:7–12.
35 Dawson DJ, Patel VL. Bedside encounter and clinical performance of junior clinical clerks. Proc Annu Conf Res Med Educ. 1983;22:186–191.
This article has been cited 2 time(s).
Journal of Surgical EducationCase Based Review Questions, Review Sessions, and Call Schedule Type Enhance Knowledge Gains in a Surgical ClerkshipJournal of Surgical Education
© 2009 Association of American Medical Colleges