An interim report on the MCAT Essay Pilot Project

Abstract

Results from four pilot administrations of the Medical College Admission Test essay question are reported. Analyses focused on (a) the performance characteristics of sample groups differentiated by gender, size of hometown, race/ethnicity, and dominant language; (b) the relationships between essay scores and academic/demographic characteristics; and (c) the reliability of one 45-minute versus two 30-minute essays. No differences were found for examinees grouped by gender and size of home community. Mean differences among the racial/ethnic groups were explained largely by reading level differences. Differences in essay performance by language group were large and unexplained by reading level differences. No relationship was found between the essay score and the academic/demographic characteristics. Reliability estimates for two 30-minute essays were higher than for one 45-minute essay; however, the 30-minute period yielded writing of poorer quality. Test-retest reliabilities for the 45-minute topics will remain the focus of future studies as will performance by examinees for whom English is a second language. The impact of the essay on the selection process will also be assessed.