Skip Navigation LinksHome > March 2010 - Volume 89 - Issue 3 > Reliability of the Physical Medicine and Rehabilitation Resi...
American Journal of Physical Medicine & Rehabilitation:
doi: 10.1097/PHM.0b013e3181cf1b30
Education & Administration: Competency

Reliability of the Physical Medicine and Rehabilitation Resident Observation and Competency Assessment Tool: A Multi-Institution Study

Musick, David W. PhD; Bockenek, William L. MD; Massagli, Teresa L. MD; Miknevich, Mary A. MD; Poduri, K. Rao MD; Sliwa, James A. DO; Steiner, Monica MD

Collapse Box


Musick DW, Bockenek WL, Massagli TL, Miknevich MA, Poduri KR, Sliwa JA, Steiner M: Reliability of the physical medicine and rehabilitation resident observation and competency assessment tool: A multi-institution study.

Objectives: To assess the psychometric qualities of a method of resident physician evaluation by faculty.

Design: Multicenter study by seven Physical Medicine and Rehabilitation training programs. Faculty physicians observed residents in brief patient encounters or teaching sessions, rated specific competencies, and provided residents with immediate feedback. The resident observation and competency assessment form included competencies in patient care, professionalism, interpersonal and communication skills, systems-based practice, and practice-based learning and improvement. Residents and faculty rated satisfaction with the process.

Results: Three hundred sixty-two ratings were completed on 88 different residents. Each resident received an average of 3.8 ratings across two academic years. Overall internal consistency reliability was high (0.98); reliability of the individual competencies ranged from 0.74 to 0.76. Item means were correlated with year of training for two skill sets, with higher means for more experienced residents. The majority of participants gave high ratings of satisfaction; correlation between satisfaction ratings of attending and resident physicians was 0.63 (P < 0.01).

Conclusions: The resident observation and competency assessment is a reliable method to assess resident skills in five of six general competencies. Construct validity of the tool is supported by the fact that faculty rated two skill sets higher for senior residents.

© 2010 Lippincott Williams & Wilkins, Inc.


Article Tools


Article Level Metrics

Search for Similar Articles
You may search for similar articles that contain these same keywords or you may modify the keyword list to augment your search.