Although traditional virtual patient simulations are designed to teach and assess clinical reasoning skills, few employ conversational dialogue with the patients. The virtual standardized patients (VSPs) described herein represent standardized patients that students interview using natural language. Students take histories and develop differential diagnoses of the VSPs as much as they would with standardized or actual patients. The student-VSP interactions are recorded, creating a comprehensive record of questions and the order in which they were asked, which can be analyzed to assess information-gathering skills. Students document the encounter in an electronic medical record created for the VSPs.
The VSP was developed by integrating a dialogue management system (ChatScript) with emotionally responsive 3D characters created in a high-fidelity game engine (Unity). The system was tested with medical students at the Ohio State University College of Medicine. Students are able to take a history of a VSP, develop a differential diagnosis, and document the encounter in the electronic medical record.
Accuracy of the VSP responses ranged from 79% to 86%, depending on the complexity of the case, type of history obtained, and skill of the student. Students were able to accurately develop an appropriate differential diagnosis on the basis of the information provided by the patient during the encounter.
The VSP enables students to practice their history-taking skills before encounters with standardized or actual patients. Future developments will focus on creating an assessment module that will automatically analyze VSP sessions and provide immediate student feedback.
From the Department of Obstetrics and Gynecology in the College of Medicine (D.D., L.Z.), Advanced Computing Center for the Arts and Design in the College of Arts and Sciences (A.P.), The Ohio State University; Hospital Medicine (B.L.), Family Medicine (H.C., L.B., D.P., A.M., M.R.), General Internal Medicine (C.L.), Emergency Medicine (D.W.), The Ohio State University Wexner Medical Center, Columbus (K.M.); and Brillig Understanding, Inc (B.W.), San Luis Obispo, CA.
Reprints: Douglas R. Danforth, PhD, Department of Obstetrics and Gynecology, The Ohio State University, 5th Floor, 395 W 12th Ave, Columbus, OH 43210 (e-mail: Doug.Danforth@osumc.edu).
This project was funded (in part) by a National Board of Medical Examiners (NBME) Edward J. Stemmler, MD Medical Education Research Fund grant (NBME 1112-064). The project does not necessarily reflect NBME policy, and NBME support provides no official endorsement. This project was also supported by funding from the Department of Health and Human Services Health Resources and Services Administration (HRSA D56HP020687).
Our VSP system is currently used for educational research purposes only. We are currently collaborating with several institutions and are interested in expanding such collaborations.