Purpose: To assess internal medicine (IM) and surgery program directors’ views of the likely effects of the 2011 Accreditation Council for Graduate Medical Education duty hours regulations.
Method: In fall 2010, investigators surveyed IM and surgery program directors, assessing their views of the likely impact of the 2011 duty hours standards on learning environment, workload, education opportunities, program administration, and patient outcomes.
Results: Of 381 IM program directors, 287 (75.3%) responded; of 225 surgery program directors, 118 (52.4%) responded. Significantly more surgeons than internists indicated that the new regulations would likely negatively impact learning climate, including faculty morale and residents’ relationships (P < .001). Most leaders in both specialties (80.8% IM, 80.2% surgery) felt that the regulations would likely increase faculty workload (P = .73). Both IM (82.2%) and surgery (96.6%) leaders most often rated, of all education opportunities, first-year resident clinical experience to be adversely affected (P < .001). Respondents from both specialties indicated that they will hire more nonphysician/midlevel providers (59.5% IM, 89.0% surgery, P < .001) and use more nonteaching services (66.8% IM, 70.1% surgery, P = .81). Respondents expect patient safety (45.1% IM, 76.9% surgery, P < .001) and continuity of care (83.6% IM across all training levels, 97.5% surgery regarding first-year residents) to decrease.
Conclusions: IM and surgery program directors agree that the 2011 duty hours regulations will likely negatively affect the quality of the learning environment, workload, education opportunities, program administration, and patient outcomes. Careful evaluation of actual impact is important.
Dr. Shea is professor of medicine–clinician educator and associate dean of medical education research, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania.
Dr. Willett is program director for the internal medicine residency, Department of Medicine, University of Alabama at Birmingham, Birmingham, Alabama.
Dr. Borman is senior associate program director, Abington Memorial Hospital, and clinical professor of surgery, Temple University School of Medicine, Philadelphia, Pennsylvania.
Dr. Itani is chief of surgical service, Veterans Affairs Boston Health Care System, and professor of surgery, Boston University, Boston, Massachusetts.
Dr. McDonald is program director, Mayo Clinic Internal Medicine Residency, Rochester, Minnesota.
Dr. Call is internal medicine program director, Virginia Commonwealth University, Richmond, Virginia.
Dr. Chaudhry is director, Residency Program in Internal Medicine, Hofstra North Shore LIJ School of Medicine, Hempstead, New York.
Dr. Adams is program director, Internal Medicine Residency, MedStar Georgetown University Hospital, Washington, DC.
Dr. Chacko is program director, Primary Care Internal Medicine Residency Training Program, University of Colorado, Denver, Colorado.
Dr. Volpp is staff physician, Center for Health Equity Research and Promotion (CHERP), Philadelphia Veterans Affairs Medical Center, and professor, Perelman School of Medicine and Wharton School of Business, University of Pennsylvania, Philadelphia, Pennsylvania.
Dr. Arora is associate program director, Internal Medicine Residency, Department of Medicine, University of Chicago, Chicago, Illinois.
Correspondence should be addressed to Dr. Shea, Perelman School of Medicine at the University of Pennsylvania, 1223 Blockley Hall, 423 Guardian Dr., Philadelphia, PA 19104-6021; telephone: (215) 573-5111; fax: (215) 573-8778; e-mail: firstname.lastname@example.org.
In July 2011, the Accreditation Council for Graduate Medical Education (ACGME) implemented additional rules regarding duty hours for trainees. The 2011 rules retain many of the 2003 limitations, including the “80-hour” workweek.1 New specifications add further limits of 16-hour work limits for interns (i.e., graduates in postgraduate year 1), 28-hour work limits (including time for transitions and education activities) for upper-level residents (i.e., residents in postgraduate years 2 or higher), and greater supervision requirements. These new regulations also limit the number of night floats per rotation and training time. Moreover, the new standards encourage strategic napping for upper-level residents (but they do not require key recommendations from the 2008 Institute of Medicine [IOM] report regarding resident sleep and patient safety,2 such as the mandatory five-hour nap period during long shifts).
The intended goals of both the 2003 and 2011 regulations are to improve patient safety, resident education, and resident well-being. Residency program directors generally agree that the 2003 regulations have improved resident well-being, but at the expense of educational experiences.3–11 The 2003 regulations have forced many programs to decrease elective rotations, teaching conferences, and clinical bedside teaching.12 Parallel to these educational experience concerns are concerns about the impact of more frequent handoffs on patient outcomes13 and concerns about the increased costs of the regulations in terms of constituting an unfunded mandate that necessitates the hiring more staff and increasing faculty workload.10,11 Further, surgical specialties have voiced surgery-specific concerns related to the involvement of trainees in fewer and/or less complex surgical cases in the years since the implementation of the 2003 duty hours standards.8–10
The majority of internal medicine (IM) program directors responding to a 2009 survey regarding the IOM recommendations for duty hours thought that future increased limitations would further decrease patient ownership, faculty morale, the quality of learning environments, patient safety, and the quality of handoffs.14 And, since the release of the highly anticipated 2011 ACGME duty hours standards, program directors have continued to show ambivalence. For example, a national survey of program directors in IM, surgery, and pediatrics demonstrated that whereas over 70% of respondents supported standards related to supervision and workload, their support for the maximum limit of 16 hours for first-year residents was very low.15 Moreover, most of these program directors felt that residents’ ability to achieve competency in five of the six required ACGME competency areas would be limited.16 Consistent with earlier reports,3 views of surgical program directors reflected even more concern than those of their IM peers that new regulations would negatively impact residents’ ability to achieve competency in all six required ACGME competency areas; further, surgical program directors worried that resident fatigue would not decrease. Additionally, program directors from smaller community training programs espoused less favorable opinions than did directors of large academic medical center programs presumably because community programs have fewer resources and fewer personnel to cover times when interns are off and to provide supervision.16
Given mixed support for the 2003 duty hours limits among residency program directors and the differences observed between surgery and IM, we undertook this study to understand in greater detail program directors’ concerns regarding the potential effects of the 2011 duty hours regulations. Through this increased understanding, the graduate medical education community will be in a better position both to formally evaluate the effects of the 2011 duty hours standards and to implement interventions to preserve the mission of residency education—that is, to graduate residents who have achieved entry-level competency. We partnered with the Association of Program Directors in Internal Medicine (APDIM) and the Association of Program Directors in Surgery (APDS) to determine (1) how IM and surgery program leaders thought the 2011 regulations would affect program learning environment, workload, education opportunities, program organization/administration, and patient outcomes, (2) whether there were differences in perceptions between surgery and IM program directors, and (3) how perceived effects related to individual program features.
In summer 2010, representatives from APDIM and APDS held a series of phone meetings to develop survey content and methods. We chose IM and surgery for our population or census-based surveys for two reasons. First, they represent the two specialties that are the focus of the grant supporting this project. Second, investigators often study duty hours issues and the effects of duty hours in IM and surgery specialties, likely because these specialties typically have larger training programs and because they represent two types of programs, sometimes referred to, respectively, as “nonprocedural” and “procedural”17 and/or “person-oriented” and “technique-oriented.”18
One investigator with expertise in survey development and item writing (J.S.) compiled a master list of items based both on the literature published since the implementation of the 2003 regulations and on earlier APDIM surveys.14 The ad hoc committee—comprising the Duty Hours Workgroup of the APDIM Survey Committee, representatives of the APDS, and members of the study team with expertise in survey development—reviewed, reworked, and shortened the initial items over multiple iterations. APDS members who did not participate in writing the items reviewed them for clarity and relevance. The full APDIM Survey Committee and the APDIM Council vetted candidate items, and the APDS Duty Hours Taskforce Survey and Documentation Group piloted the penultimate draft. A limited number of specialty-specific items were developed, typically to reflect specialty-specific issues (e.g., the number of operations for surgery trainees).19 See Results (and Table 1) for these and other differences. The stem for each item read as follows:
There could be multiple potential consequences of the new requirements. Please indicate your beliefs regarding the potential effects of the 2010 ACGME regulations, if implemented, on each of the following….
Response options were 1 = greatly decrease, 2 = decrease, 3 = neither increase nor decrease, 4 = increase, and 5 = greatly increase. The IM survey included 34 items, and the surgery survey included 44 items.
Members of the study team debated ways to collapse items into themes/categories or domains to facilitate presentation. Working independently, each team member assigned items to a domain: learning environment, workload, education opportunities, program organization/management, and other. They were invited to suggest new domains. Items for which 8 or more of the 11 reviewers chose the same category were assigned therein (40 of 49 unique items). A subset of authors reviewed the 9 items for which there was less agreement, and they reached a consensus on an appropriate domain, including a fifth domain, “patient outcomes,” for each of the items. This subset of authors assigned 4 of the 9 items for which there was less agreement into this new domain.
The survey for IM was embedded within the annual survey sent to all APDIM members. Previous reports have described those procedures.14,20 Briefly, the APDIM survey committee developed the annual survey, and the Mayo Clinic Survey Research Center administered it to the population of IM program directors. In August 2010, the Mayo Clinic Survey Research Center sent e-mail notifications with program-specific hyperlinks to a Web-based questionnaire to all 381 IM residency core program directors recognized by APDIM. Nonresponders received two monthly reminders. The hyperlinks allowed the survey administrators to send personalized reminders to program directors (and they provided links to other databases with program-level details that are not relevant to the current study).
Research staff at the University of Pennsylvania administered the survey to the population of APDS members (n = 249). APDS members with an active e-mail address received an initial electronic greeting letter from the most recent past president of the organization (K.B.), announcing the survey and encouraging participation. The initial invitation including a link to the Web-based survey was sent in September 2010. Nonresponders received one reminder two weeks after the initial invitation. There were no links to other program-level data.
Participation was voluntary. Results were confidential, and the analytic file did not contain identifiable data. We offered no incentives for participation.
Once the respondents completed the questionnaires, we linked their responses to publicly available data that describe program characteristics such as accreditation cycle length, region of the country, and total number of ACGME-approved positions. In addition, we obtained some data describing program and program directors either directly from respondents’ answers on the survey (IM) or from manually abstracting necessary information from the Fellowship and Residency Electronic Interactive Database (surgery).
We have provided data regarding program director and program demographics as well as responses to the survey items for each specialty. We collapsed responses with the same valence—that is, “greatly decrease”/“decrease” and “increase”/“greatly increase.” Analyses using the full five-point scale were substantially similar. Because these are population-based surveys, statistics (other than descriptive statistics) may not be necessary.21 However, our interest was in comparing responses between the two specialties; thus, we used the chi-square statistic to compare response distributions by specialty as well as by
* program type (university, nonuniversity),
* program director tenure (tertiles: 0–3 years, 3.1–8 years, >8 years),
* year program director completed residency (tertiles: prior to 1954, 1954–1984, 1985 or later), and
* number of filled first-year trainee positions (grouped into quartiles within specialty: IM = 0–12, 13–19, 20–31, 32+; surgery = 2–6, 7–10, 11–21, 22+).
Finally, we used ordinal regression analyses to examine the relationship between survey items and specialty. Again, we used program type, program director tenure, program size, and year program director completed residency as covariates. We used SPSS (version 16, Armonk, New York) for all analyses.
The University of Pennsylvania and Mayo Clinic institutional review boards approved this study.
Of the 381 IM program directors who received the e-mail, 287 (75.3%) completed the section on the anticipated consequences of 2011 duty hours regulations. Of the 249 names on the APDS membership list, 18 did not have an e-mail address, 5 had nonvalid e-mail addresses, and 1 was deceased. We received responses from 118 (52.4%) of the 225 living surgery program directors who received the e-mail. Within IM, we detected no differences between responders and nonresponders in terms of geographic area, program type, three-year American Board of Internal Medicine examination pass rate, total filled trainee positions, total filled first-year positions, total trainee positions approved by ACGME, or program director tenure (all P > .05). Within surgery, we detected no differences between responders and nonresponders in program type, total filled trainee positions, or total filled first-year positions (all P > .05).
The samples were similar in terms of program director’s tenure (IM mean = 7.0 years, standard deviation [SD] = 6.1; surgery mean = 7.3 years, SD = 5.3; P = .65) and year residency was completed (IM mean = 1989, SD = 8.6 years; surgery mean = 1990, SD = 8.3; P = .28). Compared with IM, more surgery programs were university based (33.9% [IM] versus 62.7% [surgery], P < .001), and surgery programs had, on average, fewer first-year trainee positions filled (IM mean = 24.1, SD = 15.1; surgery mean = 15.4, SD = 12.6; P ≤ .001).
In general, the results of our national surveys show that program directors in IM and surgery do not believe that the 2011 regulations will have a positive or beneficial impact on residency programs in any domain, including learning environment, workload, education opportunities, program administration/organization, or patient outcomes (Table 1).
The prevailing viewpoint was that the learning environment would suffer (Table 1). Distributions between IM and surgery were significantly different for every item within this category. A greater percentage of surgeons consistently indicated that the 2011 ACGME duty hours regulations would decrease the quality of, or have a negative impact on, the learning climate. To illustrate, 88.1% of surgery program directors indicated that the quality of the relationship between first-year residents and all other residents would decrease compared with 57.5% of IM program directors (P < .001). Surgeons were much more likely than their IM peers to think the 2011 regulations would hurt the morale of residents in their second or higher postgraduate year (46.7% IM, 83.9% surgery, P < .001). In addition, 46.2% of IM program directors indicated the 2011 regulations would increase first-year resident morale, whereas 61.9% of surgery directors thought the regulations would decrease morale (P < .001). Of all the aspects of the learning climate, the one that the greatest percentage (85.0%) of IM program directors thought would decrease was faculty morale.
Most program directors agreed that the regulations would increase the workload for faculty (80.8% IM, 80.2% surgery, P = .73; Table 1). Surgeons were more likely than internists to think that the regulations would increase the workload of subspecialty fellows (41.4% IM, 56.1% surgery, P = .02) and of housestaff (31.7% IM, 55.1% surgery, P < .001). Notably, almost all surgery program directors (91.5%) thought the workload of the program director and program coordinator would increase.
We detected few differences between specialties in perceptions of the impact on education opportunities; responses were decidedly negative across both IM and surgery directors (Table 1). Leaders from both IM (82.2%) and surgery (96.6%) most often rated, of all the areas within education opportunities, first-year resident clinical experience to be adversely affected (P = .001). More surgery (72.9%) than IM (49.5%) program directors predicted a negative impact on first-year resident attendance at educational conferences (P < .001). The majority in both specialties indicated that the regulations would likely decrease the educational experience in terms of elective rotation time (P = 0.29), medical student education (P = .51), attendance at educational conferences by residents in their second or higher postgraduate year (P = .12), research time for housestaff (P = .56), and clinical experience for residents in their second or higher postgraduate year (P = .03). The majority of surgery program directors indicated concerns about the number of operations a resident surgeon (78.0%), a first assistant (63.2%), and a teaching assistant (53.4%) would be able to perform. Surgery program directors were particularly worried about decreased resident availability for elective (89.8%) and urgent (79.7%) surgery cases.
The new regulations require program directors to make changes in how they organize their program (Table 1). The majority of program directors in both specialties agree that they will need to increase the hiring of nonphysician/midlevel providers (59.5% IM, 89.0% surgery, P ≤ .001). The number of hospitalists/additional faculty members hired will also have to increase for both surgery (70.3%) and IM (63.8%) programs (P = .22). The new regulations will increase the burden of monitoring duty hours, more so in surgery (75.0%) than in IM (66.6%, P = .02), and they are associated with large predicted decrements in program director morale (72.1% IM, 95.7% surgery, P < .001). The majority of respondents in each group agreed that their ability to negotiate for space would likely not change (67.1% IM, 65.0% surgery, P = .50), whereas the quality of the relationship of the residency program with the hospital administration would decrease (54.9% IM, 65.5% surgery, P = .14). Surgery program directors were more likely than IM program directors to indicate they would probably, if approved by ACGME, increase the number of interns admitted to their programs (49.3% IM, 63.2% surgery, P = .002) as well as the number of residents in their second or higher postgraduate year (40.8% IM, 53.8% surgery, P = .05).
Almost half of responding IM directors and more than three-quarters of responding surgery program directors thought the regulations would decrease the safety of patients (45.1% IM, 76.9% surgery, P < .001; Table 1). Most program directors (both IM and surgery) also expected decrements in the continuity of care (83.6% IM across all training levels, 97.5% surgery regarding first-year residents). Use of nonteaching services (e.g., services in which attendings provide clinical care and there are no residents) was expected to increase (66.8% IM, 70.1% surgery, P = .81). Whereas most responding program directors did not think the perceived quality of trainees leaving their programs would change (83.6% IM, 70.7% surgery, P = .01), 83.1% of surgery program directors believed graduates would be less prepared to practice.
Program and program director characteristics
Appendix 1 summarizes the analyses examining the relationship between views of changes to the learning environment, workload, education opportunities, program administration/organization, and characteristics of programs and program directors. We detected very few statistically significant relationships. For five items, program directors from university programs felt that the consequences would be worse compared with program directors from nonuniversity programs. For the other program and program director characteristics, we detected very few significant relationships. When we applied these variables (i.e., program type, program director tenure, year program director finished training, and number of first-year trainee positions filled) as covariates in the regression models, only three significant findings reported in Table 1 became nonsignificant: the educational experience of second year or higher postgraduate residents, the burden of monitoring duty hours by the program, and the workload of subspecialty fellows.
Discussion and Conclusions
The results of this national survey of the populations of U.S. IM and surgery program directors provide four key findings. First, the majority of program directors in both specialties agreed that the 2011 duty hours regulations will lead to a deterioration in multiple aspects of the learning climate and educational experience, increase the workload for faculty and program directors, and require multiple changes in how clinical services are run. Second, surgery program directors generally had more concerns about the potential impact than did IM program directors. Third, whereas IM and surgery directors share many concerns, certain concerns are specialty-specific; for example, large percentages of surgery program directors expect declines in program director morale, in the quality of the relationship of first-year residents to trainees of other levels, in housestaff autonomy, and in the availability of residents for elective and urgent surgeries. IM program directors were concerned with faculty morale. Finally, these results were largely unrelated to program and program director characteristics.
The results of these population-based surveys show many of the same trends as surveys that followed the 2003 duty hours regulations; specifically, directors have concerns regarding resident educational and clinical experiences, continuity of care for patients, faculty workload, and the need to make changes, many of which are quite expensive, in how clinical services are delivered.3–12, 14 Another similarity to the previous studies is that the concerns of surgery program directors were more prevalent than those of IM program directors.3,15 One difference between our findings and those of earlier studies15 is that we did not observe that responses were related to program or program director characteristics; this lack of correlation is likely related to the lack of variation in the responses.
This study makes several unique contributions to the literature. First, we have identified areas of concern across five domains of the learning climate. Our findings show that across all domains, both IM and surgery program directors felt the 2011 duty hours would have multiple negative effects. Our study further allows us to expand the scope for each domain to identify the specific areas of concern; for example, within the learning environment domain, respondents were concerned about decreased morale among trainees, faculty, and program directors as well as a detriment in the quality of the relationships of first-year residents to trainees of other levels. Perhaps the concerns regarding relationships among interns and other postgraduate trainees were temporary reactions to the implementation of the new regulations, resulting from the perception that first-year residents in 2011 have it easier than those who went before them. Another cause for the concern over graduate trainees’ relationships could lie in the answer to the question, Who will be doing the extra work brought on by tighter duty hours restrictions and increased supervision? The answer was clearly faculty, although about half of the surgery program directors thought fellows and upper-level trainees would also have an increased workload.
The overriding conclusion from the results of our national surveys is that program directors in IM and surgery do not believe that the 2011 regulations will have a positive or beneficial impact on any domain in the residency program, including patient safety, resident well-being, and education.
Clearly, including only two specialties limits the generalizability of our results, although IM and surgery are often the subjects of research because they are the largest representatives of person-oriented and technique-oriented specialties.18 Further, our response rate from the IM program directors exceeded and our response rate from the surgery directors matched the oft-cited 50% goal,22 and we detected no apparent differences between responders and nonresponders.
Important follow-up studies might go in several directions. First, assessing what actually happens in terms of patient and educational outcomes, as several researchers did after the implementation of the 2003 duty hours limits, is critical.23–32 Scientifically rigorous studies of outcomes which factor in the many complexities of residency training (e.g., fatigue, experience, procedural competency, continuity of care, supervision) must occur before further regulations are implemented. Another line of future inquiry would be to use different methodologies, including those associated with qualitative research, to ask “why” and “how” questions. For example, why don’t program directors think the health of housestaff will improve, and how has the relationship between director and hospital administration changed?
Third, concerns of increased faculty and fellow workload suggest the need to reconcile the dual demands of patient care (which is income generating) with increased supervision (which is likely not equally compensated). Fourth, given the worries of program directors regarding diminished educational opportunities, it is important to follow objective metrics through the implementation process and to develop interventions that improve educational opportunities and ensure adequate clinical experiences, especially—given concerns of diminished operative experience—for surgical residents. Fifth, future work can better tailor policies and programs to optimize residents’ duty hours by specialty. The multiple differences among specialties suggest that a one-size-fits-all approach may not be the best strategy to optimize training across disciplines. Tailoring the postgraduate experience may both address some of the concerns noted by our respondents and enable the innovations to lead to improvements—rather than detriments—in key metrics related to patient quality, resident education and wellness, and program director satisfaction.
Acknowledgments: The authors gratefully acknowledge the efforts of the Mayo Clinic Survey Research Center for their assistance with survey design and data collection for the APDIM Survey. The authors also acknowledge the assistance of Andrew J. Halvorsen, MS, and Elizabeth O’Grady in data collection and preparation of the analytic files and associated documentation, and Jennifer Lapin, PhD, for her statistical advice.
Funding: The work was supported by National Heart, Lung, and Blood Institute grant no. 1R01HL094593: Work Hour Regulation for Physician Trainees: Educational and Clinical Outcomes (Volpp).
Other disclosures: None.
Ethical approval: This study was approved by the University of Pennsylvania and Mayo Clinic institutional review boards.
Previous presentations: None.
1. Nasca TJ, Day SH, Amis ES Jrfor the Accreditation Council for Graduate Medical Education (ACGME) Duty Hour Task Force. . The new recommendations on duty hours from the ACGME task force. N Engl J Med. 2010;363:e3
2. Ulmer C, Wolman DM, Johns MME. Committee on Optimizing Graduate Medical Trainee (Resident) Hours and Work Schedules to Improve Patient Safety. Resident Duty Hours: Enhancing Sleep, Supervision, and Safety. 2009 Washington, DC National Academies Press
3. Lieberman JD, Olenwine JA, Finley W, Nicholas GG. Residency reform: Anticipated effects of ACGME guidelines on general surgery and internal medicine residency programs. Curr Surg. 2005;62:231–236
4. Cull WL, Mulvey HJ, Jewett EA, Zalneraitis EL, Allen CE, Pan RJ. Pediatric residency duty hours before and after limitations. Pediatrics. 2006;118:e1805–e1811
5. Immerman I, Kubiak EN, Zuckerman JD. Resident work-hour rules: A survey of residents’ and program directors’ opinions and attitudes. Am J Orthop. 2007;36:e172–e179
6. Joyner BD, Siedel K, Stoll D, Mitchell M. Report of the national survey of urology program directors: Attitudes and actions regarding the Accreditation Council for Graduate Medical Education regulations. J Urol. 2005;174:1961–1968
7. Nuthalapaty FS, Carver AR, Nuthalapaty ES, Ramsey PS. The perceived impact of duty hour restrictions on the residency environment: A survey of residency program directors. Am J Obstet Gynecol. 2006;194:1556–1562
8. DeLaRosa J, Thourani VH, Wheatley GH 3rd, et al. Impact of resident duty hour standards on cardiothoracic residents and program directors. Ann Thorac Surg. 2005;80:1569–1571
9. Jagannathan J, Vates GE, Pouratian JP, et al. Impact of the Accreditation Council for Graduate Medical Education work-hour regulations on neurosurgical resident education and productivity. J Neurosurg. 2009;110:820–827
10. Cohen-Gadol AA, Piepgras DG, Krishnamurthy S, Fessler RD. Resident duty hours reform: Results of a national survey of the program directors and residents in neurosurgery training programs. Neurosurgery. 2005;56:398–403
11. Kupferman TA, Lian TS. Implementation of duty hour standards in otolaryngology–head and neck surgery residency training. Otolaryngol Head Neck Surg. 2005;132:819–822
12. Willis RE, Coverdill JE, Mellinger JD, Collins JC, Potts JR 3rd, Dent DL. Views of surgery program directors on the current ACGME and proposed IOM duty-hours standards. J Surg Educ. 2009;66:216–221
13. Hutter MM, Kellogg KC, Ferguson CM, Abbott WM, Warshaw AL. The impact of the 80-hour resident workweek on surgical residents and attending surgeons. Ann Surg. 2006;243:864–871
14. Willett LL, Arora V, Halvorsen AJ, Chacko KM, Chaudhry S, McDonald FS. Challenges with duty hours reforms: A survey of residency program directors. Am J Med. 2011;124:370–378
15. Antiel RM, Thompson SM, Reed DA, et al. ACGME duty-hour recommendations—A national survey of residency program directors. N Engl J Med. 2010;363:e12
16. Antiel RM, Thompson SM, Hafferty FW, et al. Duty hour recommendations and implications for meeting the ACGME core competencies: Views of residency directors. Mayo Clin Proc. 2011;86:185–191
17. Myers JS, Bellini LM, Morris JB, et al. Internal medicine and general surgery residents’ attitudes about the ACGME duty hour regulations: A multicenter study. Acad Med. 2006;81:1052–1058
18. Manuel RS, Borges NJ, Jones BJ. Person-oriented versus technique-oriented specialties: Early preferences and eventual choice. Med Educ Online. February 19, 2009;14:4
19. Fletcher KE, Reed DA, Arora VM. Patient safety, resident education, and resident well-being following implementation of the 2003 ACGME duty hour rules. J Gen Intern Med. 2011;26:907–919
20. Loertscher LL, Halvorsen AJ, Beasley BW, Holmboe ES, Kolars JC, McDonald FS. Pharmaceutical industry support and residency education. A survey of internal medicine program directors. Arch Intern Med. 2010;170:356–362
21. Desbiens NA. The reporting of statistics in medical education studies: An observational study. BMC Med Res Methodol. 2007;7:35
22. Asch DA, Jedrziewski MK, Christakis NA. Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997;50:1129–1136
23. West CP, Shanafelt TD, Cook DA. Lack of association between resident doctors’ well-being and medical knowledge. Med Educ. 2010;44:1224–1231
24. Campbell J, Prochazka AV, Yamashita T, Gopal R. Predictors of persistent burnout in internal medicine residents: A prospective cohort study. Acad Med. 2010;85:1630–1634
25. Goitein L, Shanafelt TD, Wipf JE, Slatore CG, Back AL. The effects of work-hour limitations on resident well-being, patient care, and education in an internal medicine residency program. Arch Intern Med. 2005;165:2601–2606
26. Gelfand DV, Podnos YD, Carmichael JC, Saltzman DJ, Wilson SE, Williams RA. Effect of the 80-hour workweek on resident burnout. Arch Surg. 2004;139:933–940
27. Shetty KD, Bhattacharya J. Changes in hospital mortality associated with residency work-hour regulations. Ann Intern Med. 2007;147:73–80
28. Volpp KG, Rosen AK, Rosenbaum PR, et al. Mortality among patients in VA hospitals in the first 2 years following ACGME resident duty hour reform. JAMA. 2007;298:984–992
29. Volpp KG, Rosen AK, Rosenbaum PR, et al. Mortality among hospitalized Medicare beneficiaries in the first 2 years following ACGME resident duty hour reform. JAMA. 2007;298:975–983
30. Rosen AK, Loveland SA, Romano PS, et al. Effects of resident duty hour reform on surgical and procedural patient safety indicators among hospitalized Veterans Health Administration and Medicare patients. Med Care. 2009;47:723–731
31. Kaafarani HM, Itani KMF, Petersen LA, Thornby J, Berger DH. Does resident hours reduction have an impact on surgical outcomes? J Surg Res. 2005;126:167–171
32. Whang EE, Perez A, Ito H, Mello MM, Ashley SW, Zinner MJ. Work-hour reform: Perceptions and desires of contemporary surgical residents. J Am Coll Surg. 2003;197:624–630