Light Field Synthesis Using Inexpensive Surveillance Camera Systems

Dumbgen, Frederike; Schroers, Christopher; Mitchell, Kenny

Abstract

We present a light field synthesis technique that achieves accurate reconstruction given a low-cost, wide-baseline camera rig. Our system integrates optical flow with methods for rectification, disparity estimation, and feature extraction, which we then feed to a neural network view synthesis solver with wide-baseline capability. We propose two novel warping methods that improve the accuracy of disparity estimation and view synthesis. The methods enable the use of off-the-shelf surveillance camera hardware in a simplified and expedited capture workflow. A thorough analysis of the process and resulting view synthesis accuracy over state of the art is provided.

• Presentation Conference Type: Conference Paper (Published)
• Conference Name: 2019 IEEE International Conference on Image Processing (ICIP)
• Start Date: Sep 22, 2019
• End Date: Sep 25, 2019
• Acceptance Date: Apr 30, 2019
• Online Publication Date: Aug 26, 2019
• Publication Date: 2019-09
• Deposit Date: Nov 4, 2019
• Publicly Available Date: Nov 4, 2019
• Publisher: Institute of Electrical and Electronics Engineers
• Series ISSN: 2381-8549
• ISBN: 9781538662496
• DOI: https://doi.org/10.1109/icip.2019.8804269
• Keywords: Light field reconstruction, view synthesis, camera arrays, surveillance cameras, disparity estimation
• Public URL: http://researchrepository.napier.ac.uk/Output/2284342