Materiality Manipulation by Light-Field Projection from Reflectance Analysis

Abstract

In this paper, we report a method for changing the appearance of an object to different colors as a function of viewing perspective with multiple projectors and cameras. If such appearance manipulation becomes possible, morpho butterfly colors, metallic reflection, and other structural colors can be expressed. For such appearance editing, we proposed a reflection model which describes the optical response of projectors and cameras. We also propose methods for calculating the reflectance matrix and the optimized projection images using non-negative minimization. Through experimental results, we confirmed our method allowed perspective-dependent appearance to be designed by choosing the appropriate reflectance from the non-Lambert reflection area.