Share this article on:

Intraoperative Evaluation of Body Surface Improvement by an Augmented Reality System That a Clinician Can Modify

Mitsuno, Daisuke MD*; Ueda, Koichi MD*; Itamiya, Tomoki PhD; Nuri, Takashi MD*; Otsuki, Yuki MD*

Plastic and Reconstructive Surgery – Global Open: August 2017 - Volume 5 - Issue 8 - p e1432
doi: 10.1097/GOX.0000000000001432
Special Topic
Press Release

Background: Augmented reality (AR) technology that can combine computer-generated images with a real scene has been reported in the medical field recently. We devised the AR system for evaluation of improvements of the body surface, which is important for plastic surgery.

Methods: We constructed an AR system that is easy to modify by combining existing devices and free software. We superimposed the 3-dimensional images of the body surface and the bone (obtained from VECTRA H1 and CT) onto the actual surgical field by Moverio BT-200 smart glasses and evaluated improvements of the body surface in 8 cases.

Results: In all cases, the 3D image was successfully projected on the surgical field. Improvement of the display method of the 3D image made it easier to distinguish the different shapes in the 3D image and surgical field, making comparison easier. In a patient with fibrous dysplasia, the symmetrized body surface image was useful for confirming improvement of the real body surface. In a patient with complex facial fracture, the simulated bone image was useful as a reference for reduction. In a patient with an osteoma of the forehead, simultaneously displayed images of the body surface and the bone made it easier to understand these positional relationships.

Conclusions: This study confirmed that AR technology is helpful for evaluation of the body surface in several clinical applications. Our findings are not only useful for body surface evaluation but also for effective utilization of AR technology in the field of plastic surgery.

From the *Department of Plastic and Reconstructive Surgery, Osaka Medical College, Osaka, Japan; and Department of Media Informatics, Aichi University of Technology, Aichi, Japan.

Received for publication May 24, 2017; accepted June 9, 2017.

Disclosure: The authors have no financial interest to declare in relation to the content of this article. The Article Processing Charge was paid for by the authors.

Koichi Ueda, MD, Department of Plastic and Reconstructive Surgery, Osaka Medical College, 2–7 Daigaku-cho, Takatsuki city, Osaka, 569–8686, Japan, E-mail

This is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially without permission from the journal.

Copyright © 2017 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of the American Society of Plastic Surgeons. All rights reserved.