Institutional members access full text with Ovid®

Share this article on:

Relationships Between the ACGME Resident and Faculty Surveys and Program Pass Rates on the ABIM Internal Medicine Certification Examination

Holt, Kathleen D., PhD; Miller, Rebecca S., MS; Vasilias, Jerry, PhD; Byrne, Lauren M., MPH; Cable, Christian, MD, MHPE; Grosso, Louis, MEd; Bellini, Lisa M., MD; McDonald, Furman S., MD, MPH

doi: 10.1097/ACM.0000000000002228
Research Reports

Purpose The Accreditation Council for Graduate Medical Education (ACGME) has surveyed residents since 2003, and faculty since 2012. Surveys are designed to assess program functioning and specify areas for improvement. The purpose of this study was to assess the association of the ACGME’s resident and faculty surveys with residency-program-specific performance on the American Board of Internal Medicine (ABIM) certification exam.

Method Data were available from residents and faculty in 375 U.S. ACGME-accredited internal medicine programs from the 2012–2013, 2013–2014, and 2014–2015 academic years. Analysis of variance and correlations were used to examine the relationship between noncompliance with ACGME program requirements as assessed by the resident and faculty surveys, and ABIM program pass rates.

Results Noncompliance reported on the resident and faculty surveys was highest for programs not meeting the ACGME program requirement of an 80% pass rate on the ABIM certification examination. This relationship was significant for overall noncompliance, both within the resident (P < .001) and faculty (P < .05) surveys, for many areas within the two surveys (correlations ranged between −.07 and −.25, and P values ranged between .20 and < .001), and for the highest levels of noncompliance across areas of the resident (P < .001) and faculty (P < .04) surveys.

Conclusions ACGME resident and faculty surveys were significantly associated with ABIM program pass rates, supporting the importance of these surveys within the ACGME’s Next Accreditation System.

K.D. Holt is special projects analyst, Accreditation Council for Graduate Medical Education (ACGME), Chicago, Illinois, and staff scientist, University of Rochester Medical Center, Rochester, New York.

R.S. Miller is senior vice president of applications and data analysis, ACGME, Chicago, Illinois.

J. Vasilias is executive director, Review Committee for Internal Medicine, ACGME, Chicago, Illinois.

L.M. Byrne is director of data analytics, quality, and reporting, ACGME, Chicago, Illinois.

C. Cable is chair, Review Committee for Internal Medicine, ACGME, Chicago, Illinois, and faculty member, Hematology–Oncology Program, Scott and White Memorial Hospital, Temple, Texas.

L. Grosso is vice president of psychometrics, American Board of Internal Medicine (ABIM), Philadelphia, Pennsylvania.

L.M. Bellini is vice dean for academic affairs, University of Pennsylvania, Philadelphia, Pennsylvania.

F.S. McDonald is senior vice president of academic and medical affairs, ABIM, Philadelphia, Pennsylvania.

Funding/Support: Reported as not applicable.

Other disclosures: It is the Accreditation Council for Graduate Medical Education’s legal policy that neither the resident nor faculty survey instruments, nor any of the individual survey questions from these instruments, are made public.

Ethical approval: The University of Pennsylvania Institutional Review Board reviewed and approved this study.

Supplemental digital content for this article is available at http://links.lww.com/ACADMED/A541.

Correspondence should be addressed to Kathleen D. Holt, 401 N. Michigan Ave., Suite 2000, Chicago, IL 60611; telephone: (312) 755-7119; e-mail: kholt@acgme.org.

© 2018 by the Association of American Medical Colleges