Depth Light Field Training (DeLFT)

Mihnea Toader1,
Supervisors: Elmar Eisemann1, Petr Kellnhofer1, Michael Weinmann1
1EEMCS, Delft University of Technology, The Netherlands

Abstract

Neural radiance fields (NeRF) based solutions for novel view synthesis can achieve state of the art results. Recent work proposes models that take less time to render, need less training data or take up less space. However, few papers explore the use of NeRFs in classic rendering scenarios such as rasterization, which could contribute to wider adoption. Our paper proposes a deep MLP network with fast evaluation times, that generates view-dependent shadow maps. The network distills the knowledge of an existing NeRF model and achieves the speedup through the use of neural light fields, by only doing one network forward per ray.

Visual Comparison on the NeRF dataset

Blender scenes

Scene: Lego (Blender).

Scene: Chair (Blender).

Scene: Microphone (Blender).

LLFF scenes

Scene: Fern (LLFF).

Scene: Horns (LLFF).