AUTOMATIC MODELLING OF NATURAL SCENES FOR GENERATING SYNTHETIC MOVIES

Abstract

A model based analysis by synthesis algorithm is presented. It combines image analysis and synthesis techniques to obtain a three dimensional scene description and to generate synthetic movies out of that scene description. A 3D model world is generated automatically out of TV image sequences containing 3D objects with naturally textured surfaces. The objects are projected into the 2D image domain and compared with subsequent images of the sequence to be analyzed. Differences between input and synthesized images serve to extract shape, motion and surface texture parameters and to adapt the 3D model scene. The model data base can be manipulated to generate synthetic movies with highly realistic, natural looking images.