A principal limitation of the conventional video technology is that the viewpoint is fixed by the camera that captures a scene. Since the last decade, researchers have tried to overcome this limitation by allowing a remote viewer to interactively navigate across the scene. The potential applications of such free viewpoint rendering are tremendous, ranging from 3D TV to scene analysis, and from interactive media, augmented reality to video content/game production, etc.