Skip to main content

Research Repository

Advanced Search

Real-time rendering with compressed animated light fields.

Koniaris, Babis; Kosek, Maggie; Sinclair, David; Mitchell, Kenny

Authors

Maggie Kosek

David Sinclair



Abstract

We propose an end-to-end solution for presenting movie quality animated graphics to the user while still allowing the sense of presence afforded by free viewpoint head motion. By transforming offline rendered movie content into a novel immersive representation, we display the content in real-time according to the tracked head pose. For each frame, we generate a set of cubemap images per frame (colors and depths) using a sparse set of of cameras placed in the vicinity of the potential viewer locations. The cameras are placed with an optimization process so that the rendered data maximise coverage with minimum redundancy, depending on the lighting environment complexity. We compress the colors and depths separately, introducing an integrated spatial and temporal scheme tailored to high performance on GPUs for Virtual Reality applications. We detail a real-time rendering algorithm using multi-view ray casting and view dependent decompression. Compression rates of 150:1 and greater are demonstrated with quantitative analysis of image reconstruction quality and performance.

Presentation Conference Type Conference Paper (Published)
Conference Name 43rd Graphics Interface Conference
Start Date May 16, 2017
End Date May 19, 2017
Acceptance Date Mar 6, 2017
Online Publication Date Jun 1, 2017
Publication Date Jun 1, 2017
Deposit Date Jun 23, 2017
Print ISSN 0097-8493
Publisher Association for Computing Machinery (ACM)
Peer Reviewed Peer Reviewed
Pages 33-40
Series ISSN 0713-5424
Book Title GI '17 Proceedings of the 43rd Graphics Interface Conference
ISBN 978-0-9947868-2-1
DOI https://doi.org/10.20380/GI2017.05
Keywords Image-based rendering, compression, light field rendering, multi-view,
Public URL http://researchrepository.napier.ac.uk/Output/951667