Real-time Color Ball Tracking for Augmented Reality

In this paper, we introduce a light-weight and robust tracking technique based on color balls. The algorithm builds on a variant of randomized Hough transform and is optimized for a use in real-time applications like on low-cost Augmented Reality (AR) systems. With just one conventional color camera our approach provides the ability to determine the 3D position of several color balls at interactive frame rates on a common PC workstation. It is fast enough to be easily combined with another real-time tracking engine. In contrast to popular tracking techniques based on recognition of planar fiducial markers it offers robustness to partial occlusion, which eases handling and manipulation. Furthermore, while using balls as markers a proper haptic feedback and visual metaphor is provided. The exemplary use of our technique in the context of two AR applications indicates the effectiveness of the proposed approach.