Purpose: Interprofessional simulation-based team training is strongly endorsed as a potential solution for improving teamwork in health care delivery. Unfortunately, there are few teamwork evaluation instruments. The present study developed and tested the psychometric characteristics of the newly developed KidSIM Team Performance Scale checklist.
Method: A quasi-experimental research design engaging a convenience sample of 196 undergraduate medical, nursing, and respiratory therapy students was completed in the 2010–2011 academic year. Multidisciplinary student teams participated in a simulation-based curriculum that included the completion of two acute illness management scenarios, resulting in 282 independent reviews by evaluators from medicine, nursing, and respiratory therapy. The authors investigated the underlying factors of the performance checklist and examined the performance scores of an experimental and a control team-training-curriculum group.
Results: Participation in the supplemental team training curriculum was related to higher team performance scores (P < .001). All teams at Time 2 achieved higher scores than at Time 1 (P < .05). The reliability coefficient for the total performance scale was α = 0.90. Factor analysis supported a three-factor solution (accounting for 67.9% of the variance) with an emphasis on roles and responsibilities (five items) and communication (six items) subscale factors.
Conclusions: When simulation is used in acute illness management training, the KidSIM Team Performance Scale provides reliable, valid score interpretation of undergraduates’ team process based on communication effectiveness and identification of roles and responsibilities. Implementation of a supplementary team training curriculum significantly enhances students’ performance in multidisciplinary simulation-based scenarios at the undergraduate level.
Dr. Sigalet is KidSIM research and education specialist, Department of Pediatrics, Faculty Medicine, University of Calgary, Calgary, Alberta, Canada.
Dr. Donnon is associate professor, Medical Education and Research Unit, Department of Community Health Sciences, Faculty of Medicine, University of Calgary, Calgary, Alberta, Canada.
Dr. Cheng is associate professor and director of research and development, KidSIM-Aspire Simulation Research Program, Department of Pediatrics, Faculty of Medicine, University of Calgary, Calgary, Alberta, Canada.
Dr. Cooke is hospital pediatrician and section director for human patient simulation, Department of Pediatrics, Faculty of Medicine, University of Calgary, Calgary, Alberta, Canada.
Ms. Robinson is simulation educator/operations coordinator, KidSIM-Aspire Simulation Research Program, Department of Pediatrics, Alberta Health Services, Calgary, Alberta, Canada.
Ms. Bissett is clinical nurse educator, Pediatric Intensive Care Unit, Department of Pediatrics, Alberta Health Services, Calgary, Alberta, Canada.
Dr. Grant is associate professor and medical director, KidSIM-Aspire Pediatric Patient Simulation Program, Departments of Emergency Medicine and Pediatrics, University of Calgary, Calgary, Alberta, Canada.
Correspondence should be addressed to Dr. Donnon, Medical Education and Research Unit, G13 Health Medical Research Building, Faculty of Medicine, University of Calgary, 3330 Hospital Dr., NW, Calgary, AB Canada, T2N 4N1; telephone: (403) 210-9682; fax: (403) 210-7507; e-mail: firstname.lastname@example.org.