Dual-level light field reconstruction network based on directional EPI volume

Deyang Liu; Wenfa Zhan; Guangjun Wang; Xin Zheng; Liefu Ai

doi:10.1117/12.2573411

10 October 2020 Dual-level light field reconstruction network based on directional EPI volume

Deyang Liu, Wenfa Zhan, Guangjun Wang, Xin Zheng, Liefu Ai

Proceedings Volume 11550, Optoelectronic Imaging and Multimedia Technology VII; 115500X (2020) https://doi.org/10.1117/12.2573411
Event: SPIE/COS Photonics Asia, 2020, Online Only

Conference Poster

Abstract

Light field (LF) imaging, which can capture spatial and angular information of light-rays in one shot, has received increasing attention. However, the well-known LF spatio-angular trade-off problem has restricted many applications of LF imaging. In order to alleviate this problem, this paper put forward a dual-level LF reconstruction network to improve LF angular resolution with sparselysampled LF inputs. Instead of using 2D or 3D LF representation in reconstruction process, this paper propose an LF directional EPI volume representation to synthesize the full LF. The proposed LF representation can encourage an interaction of spatial-angular dimensions in convolutional operation, which is benefit for recovering the lost texture details in synthesized sub-aperture images (SAIs). In order to extract the high-dimensional geometric features of the angular mapping from low angular resolution inputs to high angular full LF, a dual-level deep network is introduced. The proposed deep network consists of an SAI synthesis sub-network and a detail refinement sub-network, which allows LF reconstruction in a dual-level constraint (i.e., from coarse to fine). Our network model is evaluated on several real-world LF scenes datasets, and extensive experiments validate that the proposed model outperforms the state-of-the-arts and achieves a better reconstruct SAIs perceptual quality as well.

Conference Presentation

Citation Download Citation

Deyang Liu, Wenfa Zhan, Guangjun Wang, Xin Zheng, and Liefu Ai "Dual-level light field reconstruction network based on directional EPI volume", Proc. SPIE 11550, Optoelectronic Imaging and Multimedia Technology VII, 115500X (10 October 2020); https://doi.org/10.1117/12.2573411

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available