Joint estimation of high resolution images and depth maps from light field cameras

Kazuki Ohashi; Keita Takahashi; Toshiaki Fujii

doi:10.1117/12.2042627

6 March 2014 Joint estimation of high resolution images and depth maps from light field cameras

Kazuki Ohashi, Keita Takahashi, Toshiaki Fujii

Proceedings Volume 9011, Stereoscopic Displays and Applications XXV; 90111B (2014) https://doi.org/10.1117/12.2042627
Event: IS&T/SPIE Electronic Imaging, 2014, San Francisco, California, United States

Abstract

Light field cameras are attracting much attention as tools for acquiring 3D information of a scene through a single camera. The main drawback of typical lenselet-based light field cameras is the limited resolution. This limitation comes from the structure where a microlens array is inserted between the sensor and the main lens. The microlens array projects 4D light field on a single 2D image sensor at the sacrifice of the resolution; the angular resolution and the position resolution trade-off under the fixed resolution of the image sensor. This fundamental trade-off remains after the raw light field image is converted to a set of sub-aperture images. The purpose of our study is to estimate a higher resolution image from low resolution sub-aperture images using a framework of super-resolution reconstruction. In this reconstruction, these sub-aperture images should be registered as accurately as possible. This registration is equivalent to depth estimation. Therefore, we propose a method where super-resolution and depth refinement are performed alternatively. Most of the process of our method is implemented by image processing operations. We present several experimental results using a Lytro camera, where we increased the resolution of a sub-aperture image by three times horizontally and vertically. Our method can produce clearer images compared to the original sub-aperture images and the case without depth refinement.

Citation Download Citation

Kazuki Ohashi, Keita Takahashi, and Toshiaki Fujii "Joint estimation of high resolution images and depth maps from light field cameras", Proc. SPIE 9011, Stereoscopic Displays and Applications XXV, 90111B (6 March 2014); https://doi.org/10.1117/12.2042627

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available