Multi device augmented-reality Interface

We have created and tested the augmented reality user interface for a transparent large-format cylindrical display. The interface includes hand gestures and voice control. We present various approaches for designing the user interface. We discuss the hardware setup of a cylindrical display prototype and the distributed software for the multiple synchronized video projectors. Furthermore, we demonstrate a standalone client application for video mapping onto the cylindrical display, together with master software that ensures that multiple clients act as a single surface for seamless interaction via gestures and voice. Finally, we discuss the user testing of the interface with a focus on attention tracking between the GUI on the transparent display and the natural scene behind it, along with overall usability and user-friendliness testing of the multimodal interaction.