Secondary Logo

Journal Logo

Research Report

Factors Affecting Resident Performance: Development of a Theoretical Model and a Focused Literature Review

Mitchell, Maya MD; Srinivasan, Malathi MD; West, Daniel C. MD; Franks, Peter MD; Keenan, Craig MD; Henderson, Mark MD; Wilkes, Michael MD, PhD

Author Information
  • Free

Abstract

The clinical performance of physicians has come under increasing scrutiny as greater public attention is paid to the quality of health care.1 In the past few years, national accreditation and governmental agencies have begun using process and quality of care benchmarks (such as community-acquired pneumonia treatment and angiotensin-converting enzyme inhibitor usage) as part of accreditation and reimbursement schemas.2,3 As a result, residency programs, where physicians are taught how to practice medicine, have also come under closer scrutiny.4 Medical educators, with guidance from the Accreditation Council for Graduate Medical Education (ACGME),5 are trying to improve the performance of future practicing physicians. However, basic questions still remain unanswered. How do educators and administrators understand the key factors affecting physician performance? How do we define and measure physician performance? What effect do the factors of individual physician (e.g., learning style, job stress, medical debt, personality traits) have on performance?

Focusing on residents, we attempted to answer these questions by conceptualizing factors affecting an individual physician's performance, and by conducting a systematic review on a subset of those factors. We developed a theoretical model of individual performance that conceptualizes the interactions among the individual practitioner, the system of care in which he or she practices, and the models of education used to teach residents. Performance has been defined by Webster's as “the execution of an action,”6 We defined an individual physician's performance as the actions undertaken during the process of patient care. These actions themselves are influenced by an individual physician's knowledge, skills, attitudes, and habits. If the knowledge, skills, attitudes, and habits comport with professional standards, the physician may be observed to be performing competently.7 From the perspective of patient care, a physician who treats congestive heart failure must understand the pathophysiology of cardiomyopathy and available treatment options (knowledge). The physician must use that knowledge to treat the patient and communicate effectively (skills), and believe that the patient and the condition are worthy of treatment (attitudes). They must also practice what they know on a regular basis (habits). From a physician's perspective, these practice outcomes may be influenced by numerous variables such as a physician's job satisfaction, quality of life, personality traits, learning styles, and personal physical health.

We chose residents as our study population because training programs are beginning to assess many areas of physician performance, due to increased review of physician competencies by accreditation bodies.4 Presumably, the increased scrutiny about performance will have beneficial effects on patient care as residents transition to independent practice. Residents also may be in a more standardized educational and health system environment than are practicing physicians, who may have greater practice variation. Thus, several areas that we hypothesize would affect performance may be more fixed among residents than in the pool of practicing physicians.

Method

Model of resident performance

We used an expert consensus panel to develop a focused theoretical model of factors that contribute to an individual resident's performance. In 2002–03, seven educators (a vice dean for medical education; three program directors in medicine, pediatrics, and psychiatry; a medical education researcher; a health services researcher; and a medicine chief resident) brainstormed in a series of 15 separate meetings over eight months to generate major themes for our model. During those meetings, we also considered information from sources such as the Physician's Worklife Study,8 comments from the Institute of Medicine's Crossing the Quality Chasm,9 and books on educational theory and learning styles.10–13 We then identified major areas that we hypothesized would affect resident performance, and the relationships between those variables. For the purpose of this review, we call these hypothesized variables “performance-related factors.”

We developed our model using the standard health services Medical Outcomes Model approach of “input ⇒ process ⇒ output.”14 For residents' personal factors, we defined input as the resident's inner state influenced by both the medical education and health system infrastructures. We defined process as the immediate performance of the resident regarding patient care, and output as the effect of that performance on the patients, the health care system and the population (see Figure 1). We postulated that physicians' inner states are affected by the learning that results from feedback about performance process/outcomes, which forms a feedback loop to the individual resident. The model underwent eight rounds of review. From the model, we generated key words for a focused literature review.

Figure 1
Figure 1:
The authors' theoretical model of factors that contribute to resident performance in patient care. The authors postulated that residents' inner states are affected by the learning that results from feedback about process/outcomes, which forms a feedback loop to the individual resident. University of California, Davis, School of Medicine, 2002.

Systematic review

Review selection.

The purpose of our systematic review was to illuminate areas of the model and test its construction against literature on resident performance. The educational literature is replete with information on the effects of curricular changes, feedback, and evaluation on a learner's demonstrated performance.15–18 However, most studies did not examine the influence of the variables of individual physicians on resident performance, in the context of other educational variables. Additionally, health system variables, such as payment plans, resources, and hospital staffing, have not been studies with an eye toward their influence on the factors of individual physicians or on resident performance. Thus, we focused on a subset of the performance model: the resident's inner state as it relates to patient care measures.

Review methodology.

Using PubMed, we conducted a search for articles published between 1967–2002 using the key terms “residency” or “resident,” and key terms related to outcomes of physician performance and to variables of individual physicians: “coping,” “cynicism,” “attitudes,” “empathy,” “altruism,” “distress,” “stress,” “personality,” “motivation,” “learning style,” “self-learning,” “health,” “career goals,” “debt,” “expectations,” “burnout,” “emotions,” “knowledge,” “service,” “satisfaction,” and “performance.”

Approximately 1,100 titles were retrieved and reviewed for original research data on resident performance. We excluded commentaries, letters, keynote addresses, consensus documents, policy papers without original data, reviews, studies from non-Western countries, and non-English-language papers. Fifty-two articles contained original data relevant to resident performance and included both cross-sectional and longitudinal studies. Each article was reviewed for the method of obtaining data, the response rate, predictor and outcome variables (where relevant), and significant findings. The final articles were also examined for themes or hypotheses about physician performance to generate variables for a model on resident performance.

Results

We identified five major categories of personal factors that comprise the inner state of the physician: learning style and personality, practice preferences, personal health, social/financial factors, and response to job environment. For each of the five categories, in Table 1 we have summarized the study design, study population, significant results, and have indicated whether the study outcomes were associated with measures of physician performance. No studies established causal relationships between variables.

Table 1
Table 1:
Studies of the Correlation of Five Categories of Residents' Personal Factors to Residents' Intermediate Performance Outcomes, from a Focused Literature Review of Articles Published between 1967–2002
Table 1
Table 1:
(continued)
Table 1
Table 1:
(continued)
Table 1
Table 1:
(continued)
Table 1
Table 1:
(continued)
Table 1
Table 1:
(continued)
Table 1
Table 1:
(continued)

Learning style and personality

Learning style.

Using the search terms “motivation,” “learning style,” “self-learning,” “expectations,” and “career goals,” we found no pertinent articles.

Personality.

We found five studies that looked at residents' personalities. Four of these studies looked at the relationship between personality and performance. None of these four studies used the same methods of evaluation, making direct comparison difficult. Girard's longitudinal study of internal medicine residents found that 48% of the variation in clinical ranks and 38% of the variation on American Board of Internal Medicine (ABIM) examinations could be explained by psychological states and personality characteristics.19 Reich et al.20 examined cognitive, personality, and academic measures related to clinical performance in anesthesia residents. They found that poor clinical performance was associated with difficulty in performing tasks that require divided attention such as complex visual target detection. Personality traits associated with poor performance were introversion and flexibility (flexibility is defined as liking variety and change, and being easily bored). Lacorte and Risucci21 found that pediatrics residents who were younger and more extroverted scored higher on both clinical evaluations and exams. Pasnau and Bayley22 followed 27 first-year psychiatry residents and found that their personality patterns did not change throughout a given year.

Practice preferences

We found no studies that examined a resident's preferences for practice in relationship to his or her individual performance. This was not unexpected, because despite their personal preferences, residents often cannot change their practice environment.

Personal health

Mental health.

The majority of personal health studies examined residents' mental health, specifically exploring mood states, depression, and burnout. Most studies examined only residents and did not compare their results to the general population or to nonphysician professional populations.

Mood states and emotions.

We found 20 studies related to residents' mood states and/or emotions. Eight studies were cross-sectional, while 12 followed residents longitudinally. Study methods varied from using loosely structured interviews to using validated survey instruments, such as the Profile of Mood States (POMS).23 The POMS was used in eight studies and is a 65-item survey instrument in which participants relate their current mood to specific sentences (such as “I feel tense today”) on a five-point scale from “not at all” to “extremely.” From this, six mood-related domains are described: “tension-anxiety,” “depression-dejection,” “anger-hostility,” “vigor-activity,” “fatigue-inertia,” “confusion-bewilderment.” All eight studies similarly found that emotions varied throughout the year. Two small longitudinal studies (one by Ford and Wentz24 and another by Uliana et al.25) found that of the mood states, only anger-hostility rose during the first year of residency.24,25 Another study found that along with anger, fatigue-inertia worsened throughout the year.26 Recently, Bellini et al.27 found that anger, fatigue, and depression all rose by the fifth month of internship. A survey of 207 psychiatry residency program directors found that 6.7% of their residents did not complete their current year of training and of those leaving, 26% left due to emotional illness.28 A similar study of 274 internal medicine residency program directors found that about 1% of residents took a leave of absence during training, representing 420 residents in a five-year period.29 Twelve of those residents on a leave of absence had unsuccessful suicide attempts, and eight had successful attempts. None of the studies found significant relationships between mood and performance.

Depression.

Twenty-six studies examined the prevalence of depression among residents. Thirteen studies were cross-sectional, 12 were longitudinal, and one looked at both cross-sectional and longitudinal data. Of these studies, seven measured depression using self-reported symptoms, while 18 used validated scales, and one used a psychiatric interview. The two validated scales used most frequently were the Beck Depression Index (BDI)30 and the Center for Epidemiological Studies of Depression (CES-D).31 The BDI and CES-D are similar in length and are self-administered questionnaires that measure symptoms of depression. Both questionnaires involve answering questions regarding the frequency of symptoms. A score is allotted for each answer, and the total score places a person into a category of no, mild, moderate, or severe depression. Five studies measured depression using the BDI, finding that 7% to 15% of residents met the criteria for at least mild depression.32–36 The five studies using the CES-D found depression rates between 23% and 28%.37–41 The CES-D studies' findings were similar to findings by Valko and Paula in 1975.42 Theirs was the earliest study we found regarding depression in residents: approximately 30% of residents reported depression during their first year of residency. Thirty years later, Collier et al.43 reported a similar finding with 35% of internal medicine residents reporting significant depressive symptoms. None of these depression studies examined resident performance.

Burnout.

The Oxford dictionary defines burnout as “the state of being extremely tired or ill, either mentally or physically, because you have worked too hard.”44 We found four studies on burnout. All were cross-sectional, using the Maslach Burnout Inventory (MBI). This well-established inventory is a 22-item self-administered questionnaire that measures three components of burnout: emotional exhaustion, depersonalization, and personal accomplishment.45 Three of the studies used the same data set from a group of family medicine residents, but analyzed different aspects of that data.46–48 These family medicine residents showed moderate to high levels of burnout, with notable scores under emotional exhaustion and depersonalization. There was no significant gender difference in burnout rates. In the fourth study, 76% of internal medicine residents met criteria for burnout.49 Notably, burned-out residents self-reported a decrease in the quality of care they felt they provided to patients and lower levels of job satisfaction. This was the only study to link resident burnout with any aspect of resident performance.

Residents' physical health.

One study assessed the physical health of residents, although a second study did ask about residents' health on a portion of a locally developed questionnaire.50 Using several instruments, Godenick et al.35 surveyed 178 family practice residents in South Carolina regarding their psychological and physical health. Physical health was measured using weight, blood pressure, skin-fold thickness, cholesterol, and aerobic exercise tolerance. Residents' physical health was approximately the same as the health of age-adjusted norms for the general population in their 20s and 30s. The relationship between physical health and performance outcomes was not examined.

Social and financial factors

Social factors.

Eight studies examined the relationship between a resident's social support system and job stress.41,50–56 Social support was inversely correlated with stress in every study. These studies did not examine the relationship between social support and performance.

Financial factors.

We found two studies on resident debt. Collier et al.43 found that 43% of over 4,000 responding internal medicine residents had a monthly disposable income of less than US$100, and 42% had educational debt above US$50,000. Average credit card debt was close to US$4,000.43 In the same study, only 10% of respondents indicated that salary had been consideration when choosing internal medicine as their specialty. Archer et al.55 found that lack of financial stability was a major stressor to responding residents. No study examined the relationship of debt to performance.

Response to job environment

Stress/distress.

Nineteen studies focused primarily on stress/distress as residents' response to their job environment. Three studies were longitudinal and 16 were cross-sectional. Nine studies developed their own questionnaires and ten used validated questionnaires, including the Physician Stress Inventory,57 Job Stress Index,58 Brief Symptom Inventory,59 Hassles Scale,60 Ways of Coping,61 Work-Related Strain Inventory (WRSI),62 and the General Health Questionnaire (GHQ).63 As an example, the WRSI was used in two studies and measures responses to 18 statements concerning personal productivity, co-worker relationships, and capacity to detach oneself from work-related stress when off-duty. All studies found that job-related factors such as fatigue, time demands, and role ambiguity were associated with higher stress.38–40,50–56,64–71 Interestingly, one group of investigators in the United Kingdom showed that general practitioners had higher levels of psychological distress than did the residents with whom they worked.69 This study was done after the United Kingdom made significant duty-hour reductions for residents; we found no data for the stress levels in these groups before the work-hour reductions. Schwartz et al.54 found that residents' stress was similar to the stress of a random sample of adults in the community of Rochester, New York. Only one study examined the association between stress and job performance, and found that residents with less stress and more positive attitudes had higher ratings on attending evaluations.64

Job satisfaction.

We found 15 studies that looked at residents' job satisfaction. Nine were cross-sectional and six were longitudinal. None of these studies used questionnaires specifically on satisfaction. Two did use questionnaires for stress that included questions about job satisfaction (WRSI and GHQ). Booth and Smith67 surveyed a random selection of New Zealand residents who constituted a third of the resident pool. Of the 388 respondents, 66% were satisfied with their jobs, 20% were neutral, and 14% were dissatisfied. Overall, 28% reported they would not choose medicine again as a career. The other investigations attempted to identify aspects of residency training that might affect residents' satisfaction. Revicki et al.41 found that residents with greater role ambiguity had less job satisfaction. A random sample of 10% of residents who were members of the American Medical Association reported that higher job satisfaction during their internship correlated with more frequent attending contact, lectures, and patient rounds.62 Weaver et al.72 found that community-based family medicine residents reported higher job satisfaction, compared to university-based residents. Finally, a study of 19 surgical interns found that those on call every third night reported higher levels of satisfaction compared to those on every-other-night call.70 Neither the residents themselves nor the attending physicians supervising them identified significant differences in the frequency of patient care errors between call groups. This study was the only one to examine the relationship between job satisfaction and resident performance.

Empathy.

When using search terms “empathy,” “altruism,” and “community involvement,” we found three studies that analyzed positive responses to the job environment. All were longitudinal studies of internal medicine residents. The three scales used were Jefferson Scale of Physician Empathy,73 Interpersonal Reactivity Index,74 and The Emotion and Empathy Scales.75 All three studies found residents had decreased empathy toward patients as they progressed through their training. The studies did not attempt to link empathy with resident performance.

Discussion

Attempting to understand physician performance without understanding factors that influence performance is analogous to examining patient adherence to medication regimens without understanding anything about the individual patient and his or her environment. We developed a model for conceptualizing the interactions of five domains of the individual physician's performance. Our study also examined the current state of the literature on contributors to resident performance. We found few discrete associations between the individual resident's factors and actual job performance.

Overall, we found more than 1,000 commentaries, opinion pieces, consensus statements, and theoretical articles about residency training and physician performance. However, we found fewer than 100 original research articles on residents' personal factors and fewer that studied work performance. Most of the studies focused on various mood states of residents (depression, anxiety, stress). Directionality of influence of these moods on other performance factors was not examined. In addition, we found scant research that covered the positive aspects of training or of being a physician (empathy, motivation, goals, positive emotions).

Our review paints a distressing picture of physicians in training. Stress, burnout, and fatigue levels are high. Levels of depression vary and can be quite high. There are low levels of job satisfaction. However, these studies did not examine the more positive and motivating aspects of medicine, such as a joyous interaction with a patient or a successful completion of a procedure. The unhappy picture has implications for recruitment of new medical students and residents, especially into fields (such as primary care) that are undergoing significant fiscal stresses with less autonomy of practice. Yet, because of the paucity of positive studies, one must question whether this picture is accurate.

Additionally, there are many gaps in this literature base. We found no studies that systematically reviewed patient care errors in relation to resident performance or mood state. We found very few studies that analyzed resident performance or aspects of patient care. We found no research articles on residents' learning style preferences, self-reflection about their practice, or personal preferences for practice as related to their performance. Educational articles focused almost exclusively on teaching methods and provided only cursory examinations of residents' inner states in relationship to their performances. The literature that relates health system variables and individual physician states to resident performance is indeed scanty.

This review has several limitations. First, given the broad scope of our model, we did not review all aspects of educational and medical infrastructure influences on performance. In addition, studies that developed their own survey instruments rather than using previously validated scales are difficult to interpret without comparison groups or populations. Using common scales, such as the POMS, in conjunction with new instruments allows for examination of scale validity and generalizability of results. Thus, when several groups of educators find rising anxiety and fatigue levels into midwinter, interpretation of the scores becomes simplified. We also did not examine the reliability and validity of the more than 60 scales used in these studies, as this was beyond the scope of this paper. Most studies usually relied on self-report, which is subject to recall bias and positive-negative reporting bias. In addition, the longitudinal studies only followed residents throughout their training. We do not know how these residents fared as practicing physicians.

Our model of individual factors contributing to resident performance outcomes builds on areas identified as important in the literature and on expert consensus to help frame future work in understanding physicians' performances. This hypothesis-generating model can be used to test how variations in motivation, physical health, and personal preferences might influence physician performance in specific domains. Testing this theoretical model in its entirety would be complicated. Given the number of variables, researchers would need to follow thousands of residents over several years to identify the contribution of the variables involved. Work in this research domain looks promising, since new accreditation standards require educators to document and track various aspects of physician performance. The next 20 years of educational research on physician performance will be aided by the creation and maintenance of new performance-related databases.

Our review examined only individual factors that might influence the performance of physicians. Many outcomes of interest to educators and policy stakeholders occur when an individual physician interacts with an individual patient in the context of his or her medical setting, and the application of his or her knowledge base in clinical setting. These decisions may range from a physician's prescription of a beta blocker for a patient after myocardial infarction, a decision to perform an exploratory laparoscopy, or a pleasant/positive interaction that would encourage medical follow-up. The full model including medical education and health systems infrastructure becomes more important as the focus on performance moves away from residents (in somewhat constant training environments) to practicing physicians who have greater variations and fewer checks and balances on their practice patterns.

Our review occurred during a time of unprecedented increases in physician and physician training oversight and calls for accountability in the field of medicine. Understanding current influences on physician practice, and developing a testable model of the influence of physician performance on patient outcomes, are essential to improving those outcomes.

ACKNOWLEDGMENTS

The authors would like to acknowledge the contributions of Stephen Chen, MD, MBA, in the Department of Surgery at University of Michigan, Ann Arbor; Paul Cox, MD, in the Department of Psychiatry at University of California, Davis; and Daniel Pratt, MD, at University of British Columbia, Vancouver, British Columbia, Canada.

References

[Note: The references after number 75 are inTable 1only.]

1 Robinson AR, Hohmann KB, Rifkin JI, et al. Physician and public opinions on quality of health care and the problem of medical errors. Arch Intern Med. 2002;162:2186–90.
2 Performance measurement in healthcare: core measures 〈http://www.jcaho.org/pms/index.htm〉. Accessed 21 December 2004.
3 Ameringer CF. State Medical Boards and the Politics of Public Protection. Baltimore: Johns Hopkins University Press, 1999.
4 ACGME General Competencies 〈http://www.acgme.org/outcome/comp/compFull.asp〉. Accessed 21 December 2004.
5 ACGME Outcomes Project 〈http://www.acgme.org/outcome〉. Accessed 21 December 2004.
6 Merriam-Webster Dictionary 〈http://www.m-w.com/〉. Accessed 4 January 2005.
7 Miller GE. The Assessment of Clinical Skills/Competence/Performance. Acad Med. 1990;65(9 suppl):S63–7.
8 Physician, practice, and patient characteristics related to primary care physician physical and mental health: results from the Physician Worklife Study. Health Serv Res. 2002;37:121–43.
9 Institute of Medicine. Crossing the Quality Chasm. Washington, DC: National Academy Press, 2001.
10 Schon DA. Educating the Reflective Practitioner. San Francisco: Jossey-Bass, 1987.
11 Pratt DD. Five Perspectives on Teaching in Adult and Higher Education. Malabar, FL: Krieger Publishing, 1998.
12 Lloyd JS, Langsley DG. How to Evaluate Residents. Chicago: American Board of Medical Specialties, 1986.
13 Gagne RM, Briggs LJ, Wager WW. Principles of Instructional Design. 4th ed. Belmont, CA: Thomson Learning, 1992.
14 Tarlov AR, Ware JE Jr, Greenfield S, Nelson EC, Perrin E, Zubkoff M. The Medical Outcomes Study: an application of methods for monitoring the results of medical care. JAMA. 1989;262:925–30.
15 Kogan JR, Reynolds EE, Shea JA. Effectiveness of report cards based on chart audits of residents' adherence to practice guidelines on practice performance. Teach Learn Med. 2003;15:25–30.
16 Sox CM, Burstin HR, Orav EJ, et al. The effect of supervision of residents on quality of care in five university-affiliated emergency departments. Acad Med. 1998;73:776–82.
17 Holmboe E, Scranton R, Sumption K, Hawkins R. Effect of medical record audit and feedback on residents' compliance with preventive health care guidelines. Acad Med. 1998;73:901–3.
18 Rust CT, Sisk FA, Kuo AR, Smith J, Miller R, Sullivan KM. Impact of resident feedback on immunization outcomes. Arch Pediatr Adolesc Med. 1999;153:1165–9.
19 Girard DE, Hickman DH. Predictors of clinical performance among internal medicine residents. J Gen Intern Med. 1991;6:150–4.
20 Reich DL, Uysal S, Bodian CA, et al. The relationship of cognitive, personality, and academic measures to anesthesiology resident clinical performance. Anesth Analg. 1999;88:1092–100.
21 Lacorte MA, Risucci DA. Personality, clinical performance and knowledge in paediatric residents. Med Educ. 1993;27:165–9.
22 Pasnau RO, Bayley SJ. Personality changes in the first year of internship. Am J Psychiatry. 1971;128:111–5.
23 McNair DM, Lorr M, Droppleman LF. Profile of Mood States. San Diego: Educational and Industrial Testing Services, 1981.
24 Ford CV, Wentz DK. The internship year: a study of sleep, mood states and psychophysiologic parameters. South Med J. 1984;77:1435–42.
25 Uliana RL, Hubbell FA, Wyle FA, Gordon GH. Mood changes in internship. J Med Educ. 1984;59:118–23.
26 Gordon GH, Hubbell FA, Wyle FA, Charter RA. Stress during internship. J Gen Int Med. 1986;1:228–31.
27 Bellini LM, Baime M, Shea JA. Variation of mood and empathy during internship. JAMA. 2002;287:3143–6.
28 Russell AT, Pasnau RO, Taintor ZC. Emotional problems in psychiatry. Am J Psychiatry. 1975;132:263–7.
29 Smith JW, Denny WF, Witzke DB. Emotional impairment in internal medicine house staff. JAMA. 1986;255:1155–8.
30 Beck AT. Beck Depression Inventory. Philadelphia: Center for Cognitive Therapy, 1978.
31 Radloff LS. The CES-D Scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1:385–401.
32 Clark DC, Salazar-Grueso E, Grabler P, Fawcett J. Predictors of depression during the first 6 months of internship. Am J Psychiatry. 1984;141:1095–8.
33 Kirsling RA, Mahendr SK, Chan CH. An evaluation of mood states among first year residents. Psychol Rep. 1989;65:355–66.
34 Samuel SE, Lawrence JS, Schartz HJ, Weiss JC, Seltzer JL. Investigating stress levels of residents: a pilot study. Med Teach. 1991;13:89–92.
35 Godenick MT, Musham C, Palesch Y, Hainer BL, Michels PJ. Physical and psychological health of family practice residents. Fam Med. 1995;27:646–51.
36 Hainer BL, Palesch Y. Symptoms of depression in residents: a South Carolina Family Practice Research Consortium study. Acad Med. 1998;73:1305–10.
37 Reuben DB. Depressive symptoms in medical house officers. Arch Intern Med. 1985;145:286–8.
38 Hsu K, Marshall V. Prevalence of depression and distress in a large sample of Canadian residents, interns, and fellows. Am J Psychiatry. 1987;144:1561–6.
39 Whitley TW, Gallery ME, Allison EJ, Revicki DA. Factors associated with stress among emergency medicine residents. Ann Emerg Med. 1989;18:1157–61.
40 Whitley TW, Allison EJ, et al. Work-related stress and depression among physicians pursuing postgraduate training in emergency medicine: an international study. Ann Emerg Med. 1991;20:992–6.
41 Revicki DA, Whitley TW, Gallery ME. Organizational characteristics, perceived work stress, and depression in emergency medicine residents. Behav Med. 1993;19:74–81.
42 Valko RJ, Paula C. Depression in the internship. Dis Nerv Syst. 1975;36:26–9.
43 Collier VU, McCue JD, Markus A, Smith L. Stress in medical residency: status quo after a decade of reform? Ann Intern Med. 2002;136:384–90.
44 Simpson JA, Weiner ESC (eds). Oxford English Dictionary. 2nd ed. Oxford: Clarendon Press, 1989; OED Online, Oxford University Press, 2000.
45 Maslach C, Jackson SE, Leiter P. Maslach Burnout Inventory. Palo Alto, CA: Consulting Psychologists Press, 1996.
46 Rafferty JP, Lemkau JP, Purdy RR, Rudisill JR. Validity of the Maslach Burnout Inventory for family practice physicians. J Clin Psychol. 1986;42:488–92.
47 Purdy RR, Lemkau JP, Rafferty JP, Rudisill JR. Resident physician burnout: who's burned out and who knows? Fam Med. 1987;19:203–8.
48 Lemkau JP, Purdy RR, Rafferty JP, Rudisill JR. Correlates of burnout among family practice residents. J Med Educ. 1988;63:682–91.
49 Shanafelt TD, Bradley KA, Wipf JE, Back AL. Burnout and self-reported patient care in an internal medicine residency program. Ann Intern Med. 2002;136:358–67.
50 May HJ, Revicki DA. Professional stress among family physicians. J Fam Pract. 1985;20:165–71.
51 Rudner HL. Stress and coping mechanisms in a group of family practice residents. J Med Educ. 1985;60:564–6.
52 Mazie B. Job stress, psychological health, and social support of family practice residents. J Med Educ. 1985;60:935–41.
53 Alexander D, Monk JS, Jonas AP. Occupational stress, personal strain, and coping among residents and faculty members. J Med Educ. 1985;60:830–9.
54 Schwartz AJ, Black ER, Goldstein MG, Jozefowiccz RF, Emmings FG. Levels and causes of stress among residents. J Med Educ. 1987;62:744–53.
55 Archer LR, Keever RR, Gordon RA, Archer RP. The relationship between residents' characteristics, their stress experiences, and their psychological adjustment at one medical school. Acad Med. 1991;66:301–3.
56 Taylor AD, Sinclair A, Wall EM. Sources of stress in postgraduate medical training. J Med Educ. 1987;62:425–8.
57 May H, Revicki D. Physician Stress Inventory. Greenville, NC: East Carolina University School of Medicine, Department of Family Medicine, 1981.
58 Kahn RL, Wolfe DM, Quinn RP, Sneok JD, Rosenthal RA. Organizational Stress: Studies in Role Conflict and Ambiguity. New York: Wiley, 1964.
59 Derogatis LR. SCL-90: Administration, Scoring, and Procedures Manual-1 for the revised version. Baltimore: Clinical Psychometrics Research Unit, Johns Hopkins School of Medicine, 1977.
60 Lazarus R, Folkman S. Manual for the Hassles and Uplifts Scales: Research Edition. Palo Alto, CA: Consulting Psychologists Press, 1989.
61 Folkman S, Lazarus R. Manual for the Ways of Coping Questionnaire: Research Edition. Palo Alto, CA: Consulting Psychologists Press, 1988.
62 Revicki DA, May HJ, Whitley TW. Reliability and validity of the Work-Related Strain Inventory among health professionals. Behav Med. 1991;17:111–20.
63 Goldberg DP. The Detection of Psychiatric Illness by Questionnaire. London: Oxford University Press, 1977.
64 Adler R, Werner ER, Korsch B. Systematic study of four years of internship. Pediatrics. 1980;66:1000–8.
65 Yogev S, Harris S. Women physicians during residency years: workload, work satisfaction and self-concept. Soc Sci Med. 1983;17:837–41.
66 Blackwell B, Gutmann MC, Jewell KE. Role adoption in residency training. Gen Hosp Psychiatry. 1984;6:280–8.
67 Booth M, Smith DF. Job satisfaction amongst resident medical officers. N Z Med J. 1990;103:425–7.
68 Daugherty SR, Baldwin DC, Rowley BD. Learning, satisfaction, and mistreatment during medical internship. JAMA. 1998;279:1194–9.
69 Kapur N, Appleton K, Neal RD. Sources of job satisfaction and psychological distress in GPs and medical house officers. Fam Pract. 1999;16:600–1.
70 Sawyer RG, Tribble CG, Newberg DS, Pruett TL, Minasi JS. Intern call schedules and their relationship to sleep, operating room participation, stress, and satisfaction. Surgery. 1999;126:337–42.
71 Tyssen R, Vaglum P, Gronvold NT, Ekeberg O. The impact of job stress and working conditions on mental health problems among junior house officers. A nationwide Norwegian prospective cohort study. Med Educ. 2000;34:374–84.
72 Weaver SP, Mills TL, Passmore C. Job satisfaction of family practice residents. Fam Med. 2001;33:678–82.
73 Hojat M, Mangione S, Nasca TJ, et al. The Jefferson Scale Of Physician Empathy: development and preliminary psychometric data. Educ Psychol Meas. 2001;61:349–65.
74 Davis M. Measuring individual differences in empathy: evidence for a multidimensional approach. J Pers Soc Psychol. 1983;44:113–26.
75 Mehrabian A, Epstein N. A measure of emotional empathy. J Pers. 1972;40:525–43.
76 Friedman RC, Bigger JT, Kornfeld DS. The intern and sleep loss. N Engl J Med. 1971;285:201–3.
77 Friedman CF, Kornfeld DS, Bigger TJ. Psychological problems associated with sleep deprivation in interns. J Med Educ. 1973;48:436–41.
78 Bates EM, Hinton JH, Wood TR. Unhappiness and discontent: a study of junior resident medical officers. Med J Aust. 1973;2:606–12.
79 Garfinkel PE, Waring EM. Personality, interests, and emotional disturbances in psychiatric residents. Am J Psychiatry. 1981;138:51–5.
80 Ford CV. Emotional distress in internship and residency: a questionnaire study. Psychiatr Med. 1983;1:143–50.
81 Girard DE, Elliot DL, Hickman DH, et al. The internship: a prospective investigation of emotions and attitudes. West J Med. 1986;144:93–8.
82 Elliot DL, Girard DE. Gender and the emotional impact of internship. JAMWA. 1986;41:54–6.
    83 Firth-Cozens J. Emotional distress in junior house officers. BMJ. 1987;295:533–6.
    84 Gordon GH, Girard DE, Hickman DH. Comparison of mood changes and satisfaction among first year medical residents in three programs. J Med Educ. 1987;62:428–30.
    85 Badger LW, Chesebro MJ, Hartman A. First year residency stress: sources and mediators. Fam Pract Res J. 1987;7:104–13.
    86 Young EH. Relationship of residents' emotional problems, coping behaviors, and gender. J Med Educ. 1987;62:642–50.
    87 Hendrie HC, Clair DK, Brittain HM. a study of anxiety/depressive symptoms of medical students, house staff, and their spouses/partners. J Nerv Ment Dis. 1990;178:204–7.
    88 Jex SM, Baldwin DC, Hughes P, Storr C, Conrad S, Sheehand DV. Behavioral consequences of job-related stress among resident physicians: the mediating role of psychological strain. Psychol Rep. 1991;69:339–49.
    89 Girard DE, Hickman DH, Gordon GH, Robinson RO. A prospective study of internal medicine residents' emotions and attitudes throughout their training. Acad Med. 1991;66:111–4.
    90 Schneider SE, Phillips WM. Depression and anxiety in medical, surgical, and pediatric interns. Psychol Rep. 1993;72.
      91 Mangione S, Kane GC, Caruso JW, Gonnella JS, Nasca TJ, Hojat M. Assessment of empathy in different years of internal medicine training. Med Teach. 2002;24:370–3.
      © 2005 Association of American Medical Colleges