Acquisition, Representation and Rendering of Real-World Models using Polynomial Texture Maps in 3D

Abstract

The ability to represent real-world objects digitally in a realistic manner is an indispensable tool for many applications. This paper proposes a method for acquiring, processing, representing, and rendering these digital representations. Acquisition can be divided into two processes: acquiring the 3D geometry of the object, and obtaining the texture and reflectance behaviour of the object. Our work explores the possibility of using Microsoft's Kinect sensor to acquire the 3D geometry, by registration of data captured from different viewpoints. The Kinect sensor itself is used to acquire texture and reflectance information which is represented using multiple Polynomial Texture Maps. We present processing pipelines for both geometry and texture, and finally our work examines how the acquired and processed geometry, texture, and reflectance behaviour information can be mapped together in 3D, allowing the user to view the object from different viewpoints while being able to interactively change light direction. Varying light direction uncovers details of the object which would not have been possible to observe using a single, fixed, light direction. This is useful in many scenarios, amongst which is the examination of cultural heritage artifacts with surface variations.