Automatic Image Selection in Photogrammetric Multi-view Stereo Methods

Abstract

This paper brings together a team of specialists in optical metrology, museum curation, collection digitization and 3D development to describe and illustrate by example a method for the selection of the most suitable camera views, vantage viewpoints, from a large image dataset intended for metric 3D artefact reconstruction. The presented approach is capable of automatically identifying and processing the most appropriate images from a multi-image photogrammetric network captured by an imaging specialist. The aim is to produce a 3D model suited to a wide range of museum uses, including visitor interactives. The approach combines off-the-shelf imaging equipment with rigorous photogrammetric bundle adjustment and multi-view stereo (MVS), supported by an image selection process that is able to take into account range-related and visibility-related constraints. The paper focusses on the two key steps of image clustering and iterative image selection. The developed method is illustrated by the 3D recording of four ancient Egyptian artefacts from the Petrie Museum of Egyptian Archaeology at UCL, with an analysis taking into account completeness, coordination uncertainty and required number of images. Comparison is made against the baseline of the established CMVS (Clustering Views for Multi-view Stereo), which is a free package for selecting vantage images within a huge image collection. For the museum, key outputs from the 3D recording process are visitor interactives which are built around high quality textured mesh models. The paper therefore considers the quality of the output from each process as input to texture model generation. Results demonstrate that whilst both methods can provide high quality records, our new method, Image Network Designer (IND), can provide a better image selection for MVS than CMVS in terms of coordination uncertainty and completeness of the final model for the museum recording of artefacts. Furthermore, the improvements gained, particularly in model completeness, minimise the significant overhead in mesh editing needed to provide a more direct and economical route to 3D model output.