To evaluate how emergency medicine residency programs perceived and used Association of American Medical Colleges (AAMC) Standardized Video Interview (SVI) total scores and videos during the Electronic Residency Application Service 2018 cycle.
Study 1 (November 2017) used a program director survey to evaluate user reactions to the SVI following the first year of operational use. Study 2 (January 2018) analyzed program usage of SVI video responses using data collected through the AAMC Program Director’s Workstation.
Results from the survey (125/175 programs; 71% response rate) and video usage analysis suggested programs viewed videos out of curiosity and to understand the range of SVI total scores. Programs were more likely to view videos for attendees of U.S. MD-granting medical schools and applicants with higher United States Medical Licensing Examination Step 1 scores, but there were no differences by gender or race/ethnicity. More than half of programs that did not use SVI total scores in their selection processes were unsure of how to incorporate them (36/58; 62%) and wanted additional research on utility (33/58; 57%). More than half of programs indicated being at least somewhat likely to use SVI total scores (55/97; 57%) and videos (52/99; 53%) in the future.
Program reactions on the utility and ease of use of SVI total scores were mixed. Survey results indicate programs used the SVI cautiously in their selection processes, consistent with AAMC recommendations. Future user surveys will help the AAMC gauge improvements in user acceptance and familiarity with the SVI.
F.E. Gallahue is associate professor and director, Department of Emergency Medicine, University of Washington, Seattle, Washington.
K.M. Hiller is professor and director of undergraduate education, Department of Emergency Medicine, University of Arizona College of Medicine–Tucson, Tucson, Arizona.
S.B. Bird is program director, Department of Emergency Medicine, and vice chair for education, University of Massachusetts Medical School, Worcester, Massachusetts.
M.R.C. Haas is a medical education fellow, Department of Emergency Medicine, University of Michigan, Ann Arbor, Michigan.
N.M. Deiorio is associate dean for student affairs and professor, Department of Emergency Medicine, Virginia Commonwealth University School of Medicine, Richmond, Virginia.
H.G. Hern is associate clinical professor, University of California, San Francisco, and vice chair of education, Department of Emergency Medicine, Highland Hospital, Oakland, California.
Z.J. Jarou is clinical associate, Section of Emergency Medicine, Department of Medicine, University of Chicago, Chicago, Illinois.
A. Pierce is associate professor, Department of Emergency Medicine, University of Texas Southwestern Medical Center, Dallas, Texas.
T. Geiger is senior selection research analyst, Association of American Medical Colleges, Washington, D.C.
L. Fletcher is an intern, Association of American Medical Colleges, Washington, D.C.
The authors have informed the journal that they agree that both Fiona E. Gallahue and Katherine M. Hiller completed the intellectual and other work typical of the first author.
Funding/Support: This research was funded by the Association of American Medical Colleges.
Other disclosures: T. Geiger and L. Fletcher are employees of the Association of American Medical Colleges.
Ethical approval: The institutional review board of the American Institutes for Research (FWA00001666) approved the SVI research study on September 30, 2017, and determined that the survey was exempt on October 30, 2017. Individuals provided explicit consent for their data to be used for research purposes when they took the SVI.
Previous presentations: A subset of these data was reported at the following meetings: 2018 AAMC Continuum Connections meeting, April 2018, Orlando, Florida; 2018 Council of Residency Directors in Emergency Medicine (CORD) Academic Assembly, April 2018, San Antonio, Texas; and 2018 Society of Academic Emergency Medicine (SAEM) Annual Meeting, May 2018, Orlando, Florida.
Data: The authors have complied with all rules or restrictions related to AAMC Standardized Video Interview and Electronic Residency Application Service data used in the analyses.
Supplemental digital content for this article is available at http://links.lww.com/ACADMED/A657.
Correspondence should be addressed to Thomas Geiger, Association of American Medical Colleges, 655 K St., Suite 100, Washington, DC 20001; telephone: (202) 862-6064; email: firstname.lastname@example.org.