Performance capture solution

The Kostilam is software for performance capture that does not require any specialized hardware or studio environment. The software allows capturing human movement using off-the-shelf cameras. The resulting animation can be used for pre-visualization, filmmaking, or video game development. The software is freely available for non-commercial use. For further information and inquiries about licensing for commercial use, please contact us.

Step By Step Guide

1. Rectification & Synchronizaiton

First, the input videos have to be rectified to remove lens distortion. Furthermore all the videos needs to be synchronized to establish frame correspondences.

2. Camera Calibration

The software estimates the position and orientation of all cameras in the scene from a calibration sequence with a moving point light.

3. Mesh Skinning

Besides the videos the input to our sofware is a rigged mesh of a person being captured. There is a tool for semi-automatic skinning of this mesh.

4. Model Tracking

Finally, character movement is tracked throughout the video sequence and the resulting animation is exported into FBX format.

Use Cases

This software has been supported by the Technology Agency of the Czech Republic under research program TE01020415 (V3C — Visual Computing Competence Center).