Secondary Logo

Institutional members access full text with Ovid®

Effective Application of Mixed Reality Device HoloLens

Simple Manual Alignment of Surgical Field and Holograms

Mitsuno, Daisuke, M.D.; Ueda, Koichi, M.D.; Hirota, Yuka, M.D.; Ogino, Mariko, M.D.

Plastic and Reconstructive Surgery: February 2019 - Volume 143 - Issue 2 - p 647–651
doi: 10.1097/PRS.0000000000005215
Plastic Surgery Focus: Ideas and Innovations
Watch Video

Summary: The technology used to add information to a real visual field is defined as augmented reality technology. Augmented reality technology that can interactively manipulate displayed information is called mixed reality technology. HoloLens from Microsoft, which is a head-mounted mixed reality device released in 2016, can display a precise three-dimensional model stably on the real visual field as hologram. If it is possible to accurately superimpose the position/direction of the hologram in the surgical field, surgical navigation-like use can be expected. However, in HoloLens, there was no such function. The authors devised a method that can align the surgical field and holograms precisely within a short time using a simple manual operation. The mechanism is to match the three points on the hologram to the corresponding marking points of the body surface. By making it possible to arbitrarily select any of the three points as a pivot/axis of the rotational movement of the hologram, alignment by manual operation becomes very easy. The alignment between the surgical field and the hologram was good and thus contributed to intraoperative objective judgment. By using the method of this study, the clinical usefulness of the mixed reality device HoloLens will be expanded.

Osaka, Japan

From the Department of Plastic and Reconstructive Surgery, Osaka Medical College.

Received for publication March 8, 2018; accepted August 2, 2018.

Disclosure: The authors have no financial interest in any of the products or devices mentioned in this article. There was no internal or external financial support for this study.

Supplemental digital content is available for this article. Direct URL citations appear in the text; simply type the URL address into any Web browser to access this content. Clickable links to the material are provided in the HTML text of this article on the Journal’s website (

A “Hot Topic Video” by Editor-in-Chief Rod J. Rohrich, M.D., accompanies this article. Go to and click on “Plastic Surgery Hot Topics” in the “Digital Media” tab to watch.

Daisuke Mitsuno, M.D., Department of Plastic and Reconstructive Surgery, Osaka Medical College, 2-7 Daigaku-cho, Takatsuki City, Osaka 569-8686, Japan,

©2019American Society of Plastic Surgeons