Abstract | In augmented reality, virtual objects are added to the real world by superimposing them onto a video stream or a head-mounted display in real-time. Typical augmented reality applications track 2D patterns on rigid planar objects in order to acquire the pose of the camera in the scene. Rigid augmentations are then performed on the planar objects. We present a method to track non-rigid objects such as cloth, and to perform flexible augmentations on the cloth while stretching and rippling it in real-time, using a single camera. In addition, we present a simple technique to apply real-world illumination to the augmentation, which greatly improves perception and realism. Results show believable real-time augmentations of a non-rigid object, even under extreme lighting conditions. |
---|