Light Field Rendering for Games

Abstract

This paper studies the problem of integrating high-quality light field rendering into state-of-the-art real-time computer games. We present a complete production pipeline for generation of light fields from arbitrary complex 3D content using commercial 3D modeling software commonly used in the gaming industry. We show how recent advances in light field rendering techniques can be used to composite light fields with dynamic scene content. The results demonstrate the potential of light fields as a valuable extension to polygonal rendering techniques by employing accurate silhouette reconstruction and correct per-pixel depth values for scene composition. Level of detail techniques are applied to light fields to optimize rendering performance. Dynamic light field rendering is implemented to account for animation, deformation and varying lighting conditions.