Authors:
Shiori Ueda
1
;
Hideo Saito
1
and
Shohei Mori
1
;
2
Affiliations:
1
Faculty of Science and Technology, Keio University, Yokohama, Kanagawa, Japan
;
2
Institute of Computer Graphics and Vision, Graz University of Technology, Graz, Styria, Austria
Keyword(s):
Focal Stack Imaging, Casual Photography, Multi-Plane Image, View Synthesis.
Abstract:
3D imaging combining a focal stack and multi-plane images (MPI) facilitates various real-time applications, including view synthesis, 3D scene editing, and augmented and virtual reality. Building upon the foundation of MPI, originally derived from multi-view images, we introduce a novel pipeline for reconstructing MPI by casually capturing a focal stack optically using a handheld camera with a manually modulated focus ring. We hypothesized two distinct strategies for focus ring modulation that users could employ, to sample defocus images along the front-facing axis uniformly. Our quantitative analysis using a synthetic dataset suggests tendencies in possible simulated errors in focus modulations, while qualitative results illustrate visual differences. We further showcase applications utilizing the resultant MPI, including depth rendering, occlusion-aware defocus filtering, and de-fencing.