A curated list of neural rendering resources.

Overview

Awesome-of-Neural-Rendering Awesome

A curated list of neural rendering and related resources.

Please feel free to pull requests or open an issue to add papers.

🔆 Updated 2021-09-08

Table of Contents

Type of Neural-Rendering

Type View `` `` `` `` `` Other
Explanation View Synthesis other types

GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering

2021

Title Venue Type Code Star
ICCV Other PyTorch(Author) ``
Self-Calibrating Neural Radiance Fields ICCV Other PyTorch(Author) 72
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering ICLR-Oral Other PyTorch(Author) ``
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields ICCV-Oral Other PyTorch(Author) ``
GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering ICCV Other PyTorch(Author) 128
PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting CVPR Other PyTorch(Author) 33
IBRNet: Learning Multi-View Image-Based Rendering CVPR View PyTorch(Author) 126
NeX: Real-time View Synthesis with Neural Basis Expansion CVPR-Oral View PyTorch(Author) 320
Neural Lumigraph Rendering CVPR Other PyTorch(Author) ``
AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR Other PyTorch(Author) 80
pixelNeRF: Neural Radiance Fields from One or Few Images CVPR View PyTorch(Author) 456
StereoRadiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenes CVPR View PyTorch(Author) 32
D-NeRF: Neural Radiance Fields for Dynamic Scenes CVPR Other PyTorch(Author) 61
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis CVPR Other PyTorch(Author) ``
AutoInt: Automatic Integration for Fast Neural Volume Rendering CVPR Other PyTorch(Author) ``
GIRAFFE: Representing Scenes asCompositional Generative Neural Feature Fields CVPR-BestPaper Other PyTorch(Author) 609
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination SIGGRAPH Asia Other PyTorch(Author) 104

2020

Title Venue Type Code Star
Multiview Neural Surface Reconstruction with Implicit Lighting and Material NeurIPS Other PyTorch(Author) 223
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis NeurIPS Other PyTorch(Author) 183
Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervision CVPR Other PyTorch(Author) 471
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
CVPR `` PyTorch(Author) ``
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis ECCV-Oral View TensorFlow(Author) PyTorch(3rd) PyTorch(3rd) Jax(3rd) 3.6k/1.1k/429/19.2k

2019

Title Venue Type Code Star
Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines SIGGRAPH View PyTorch(Author) 691
Deferred Neural Rendering: Image Synthesis using Neural Textures SIGGRAPH Other PyTorch(Author) 123
Geometry-Aware Neural Rendering NeurIPS Other PyTorch(Author) ``
Scene Representation Networks: Continuous3D-Structure-Aware Neural Scene Representations NeurIPS-Oral Other PyTorch(Author) 287
Monocular Neural Image Based Rendering with Continuous View Control ICCV Other PyTorch(Author) 43
CVPR Other PyTorch(Author) ``

2018

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

2017

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

2016

Title Venue Type Code Star
CVPR Other PyTorch(Author) ``

Previous Venues

Title Venue Type Code Star
Ray-casting Point-in-polyhedron Test 2012-CESCG Other -

Arxiv

Title Date Type Code Star
NeuLF: Efficient Novel View Synthesis with Neural 4D Light Field 2021.08.04 View -
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs 2021.08.02 Other PyTorch(Author) 169
Neural Rays for Occlusion-aware Image-based Rendering 2021.07.28 Other PyTorch(Author) 13
Fast and Explicit Neural View Synthesis 2021.07.12 View -
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields 2021.06.24 Other PyTorch(Author) ``
Volume Rendering of Neural Implicit Surfaces 2021.06.22 Other -
Learning to Stylize Novel Views 2021.05.27 `` -
Neural Ray-Tracing: Learning Surfaces and Reflectance for Relighting and View Synthesis 2021.04.28 Other PyTorch(Author) 7
FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object CategoryModelling 2021.04.17 `` PyTorch(Author) ``
Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation 2021.04.02 Other PyTorch(Author) ``
Inverting Neural Radiance Fields for Pose Estimation 2021.04.01 Other -
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination 2021.01.04 Other PyTorch(Author) 115
2021.08.10 `` PyTorch(Author) ``
2021.08.10 `` PyTorch(Author) ``

Awesome Surveys

Awesome Blogs

Videos

Datasets

Tools

Owner
Zhiwei ZHANG
Zhiwei ZHANG
Aalto-cs-msc-theses - Listing of M.Sc. Theses of the Department of Computer Science at Aalto University

Aalto-CS-MSc-Theses Listing of M.Sc. Theses of the Department of Computer Scienc

Jorma Laaksonen 3 Jan 27, 2022
Generate saved_model, tfjs, tf-trt, EdgeTPU, CoreML, quantized tflite and .pb from .tflite.

tflite2tensorflow Generate saved_model, tfjs, tf-trt, EdgeTPU, CoreML, quantized tflite and .pb from .tflite. 1. Supported Layers No. TFLite Layer TF

Katsuya Hyodo 214 Dec 29, 2022
A repository that finds a person who looks like you by using face recognition technology.

Find Your Twin Hello everyone, I've always wondered how casting agencies do the casting for a scene where a certain actor is young or old for a movie

Cengizhan Yurdakul 3 Jan 29, 2022
Charsiu: A transformer-based phonetic aligner

Charsiu: A transformer-based phonetic aligner [arXiv] Note. This is a preview version. The aligner is under active development. New functions, new lan

jzhu 166 Dec 09, 2022
🌈 PyTorch Implementation for EMNLP'21 Findings "Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer"

SGLKT-VisDial Pytorch Implementation for the paper: Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer Gi-Cheon Kang, Junseok P

Gi-Cheon Kang 9 Jul 05, 2022
Minimal PyTorch implementation of Generative Latent Optimization from the paper "Optimizing the Latent Space of Generative Networks"

Minimal PyTorch implementation of Generative Latent Optimization This is a reimplementation of the paper Piotr Bojanowski, Armand Joulin, David Lopez-

Thomas Neumann 117 Nov 27, 2022
[CVPR2021 Oral] FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimation.

FFB6D This is the official source code for the CVPR2021 Oral work, FFB6D: A Full Flow Biderectional Fusion Network for 6D Pose Estimation. (Arxiv) Tab

Yisheng (Ethan) He 201 Dec 28, 2022
Official repository for "Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems"

Action-Based Conversations Dataset (ABCD) This respository contains the code and data for ABCD (Chen et al., 2021) Introduction Whereas existing goal-

ASAPP Research 49 Oct 09, 2022
CLNTM - Contrastive Learning for Neural Topic Model

Contrastive Learning for Neural Topic Model This repository contains the impleme

Thong Thanh Nguyen 25 Nov 24, 2022
Official Implementation of HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentation

HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentation by Lukas Hoyer, Dengxin Dai, and Luc Van Gool [Arxiv] [Paper] Overview Unsup

Lukas Hoyer 149 Dec 28, 2022
LBK 26 Dec 28, 2022
This is the code for CVPR 2021 oral paper: Jigsaw Clustering for Unsupervised Visual Representation Learning

JigsawClustering Jigsaw Clustering for Unsupervised Visual Representation Learning Pengguang Chen, Shu Liu, Jiaya Jia Introduction This project provid

DV Lab 73 Sep 18, 2022
Toolchain to build Yoshi's Island from source code

Project-Y Toolchain to build Yoshi's Island (J) V1.0 from source code, by MrL314 Last updated: September 17, 2021 Setup To begin, download this toolch

MrL314 19 Apr 18, 2022
🔪 Elimination based Lightweight Neural Net with Pretrained Weights

ELimNet ELimNet: Eliminating Layers in a Neural Network Pretrained with Large Dataset for Downstream Task Removed top layers from pretrained Efficient

snoop2head 4 Jul 12, 2022
Details about the wide minima density hypothesis and metrics to compute width of a minima

wide-minima-density-hypothesis Details about the wide minima density hypothesis and metrics to compute width of a minima This repo presents the wide m

Nikhil Iyer 9 Dec 27, 2022
Project looking into use of autoencoder for semi-supervised learning and comparing data requirements compared to supervised learning.

Project looking into use of autoencoder for semi-supervised learning and comparing data requirements compared to supervised learning.

Tom-R.T.Kvalvaag 2 Dec 17, 2021
Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch

Memory Efficient Attention This is unofficial implementation of Self-attention Does Not Need O(n^2) Memory for Jax and PyTorch. Implementation is almo

Amin Rezaei 126 Dec 27, 2022
Dieser Scanner findet Websites, die nicht direkt in Suchmaschinen auftauchen, aber trotzdem erreichbar sind.

Deep Web Scanner Dieses Script findet Websites, die per IPv4-Adresse erreichbar sind und speichert deren Metadaten. Die Ausgabe im Terminal wird nach

Alex K. 30 Nov 18, 2022
Code for our paper "Sematic Representation for Dialogue Modeling" in ACL2021

AMR-Dialogue An implementation for paper "Semantic Representation for Dialogue Modeling". You may find our paper here. Requirements python 3.6 pytorch

xfbai 45 Dec 26, 2022
WHENet: Real-time Fine-Grained Estimation for Wide Range Head Pose

WHENet: Real-time Fine-Grained Estimation for Wide Range Head Pose Yijun Zhou and James Gregson - BMVC2020 Abstract: We present an end-to-end head-pos

368 Dec 26, 2022