Institutional members access full text with Ovid®

Virtual Interactive Presence and Augmented Reality (VIPAR) for Remote Surgical Assistance

Shenai, Mahesh B MD, MSE*; Dillavou, Marcus BS†; Shum, Corey BS†; Ross, Douglas PhD†; Tubbs, Richard S PhD‡; Shih, Alan PhD†; Guthrie, Barton L MD*

doi: 10.1227/NEU.0b013e3182077efd
Instrumentation Assessment: Editor's Choice

BACKGROUND: Surgery is a highly technical field that combines continuous decision-making with the coordination of spatiovisual tasks.

OBJECTIVE: We designed a virtual interactive presence and augmented reality (VIPAR) platform that allows a remote surgeon to deliver real-time virtual assistance to a local surgeon, over a standard Internet connection.

METHODS: The VIPAR system consisted of a “local” and a “remote” station, each situated over a surgical field and a blue screen, respectively. Each station was equipped with a digital viewpiece, composed of 2 cameras for stereoscopic capture, and a high-definition viewer displaying a virtual field. The virtual field was created by digitally compositing selected elements within the remote field into the local field. The viewpieces were controlled by workstations mutually connected by the Internet, allowing virtual remote interaction in real time. Digital renderings derived from volumetric MRI were added to the virtual field to augment the surgeon's reality. For demonstration, a fixed-formalin cadaver head and neck were obtained, and a carotid endarterectomy (CEA) and pterional craniotomy were performed under the VIPAR system.

RESULTS: The VIPAR system allowed for real-time, virtual interaction between a local (resident) and remote (attending) surgeon. In both carotid and pterional dissections, major anatomic structures were visualized and identified. Virtual interaction permitted remote instruction for the local surgeon, and MRI augmentation provided spatial guidance to both surgeons. Camera resolution, color contrast, time lag, and depth perception were identified as technical issues requiring further optimization.

CONCLUSION: Virtual interactive presence and augmented reality provide a novel platform for remote surgical assistance, with multiple applications in surgical training and remote expert assistance.

*Division of Neurosurgery, Department of Surgery, University of Alabama–Birmingham, Alabama; †Department of Mechanical Engineering, University of Alabama–Birmingham, Alabama; ‡Division of Pediatric Neurosurgery, Children's Hospital of Alabama, Birmingham, Alabama

Received, December 19, 2009.

Accepted, September 27, 2010.

Correspondence: Barton L. Guthrie, MD, c/o Division of Neurosurgery, University of Alabama–Birmingham, FOT 1050, 1530 3rd Ave S, Birmingham, AL 35294-3410. E-mail:

Copyright © by the Congress of Neurological Surgeons