Differentiable Annealed Importance Sampling (DAIS)

This repository contains the code to reproduce the DAIS results from the paper Differentiable Annealed Importance Sampling and the Perils of Gradient Noise.

Bayesian Linear Regression

Please first install JAX (https://github.com/google/jax), then reproduce our results by running the following:

python blr/dais.py --gamma 0.0
python blr/dais.py --gamma 0.9
python blr.dais.py --bsize 100

Variational Autoencoder

Please first install PyTorch (https://pytorch.org/).

For training, one example command for DAIS with $K = 10$ and $S = 5$ (to adapt annealing scheme, add --adapt_beta):

python vae/mnist_train.py --lf_step 10 --n_particles 5 --lf_lrate 0.08

After training, you can find the saved checkpoint and evaluate it (e.g., using AIS):

python vae/mnist_eval.py --ais --n_particles 10 --lf_step 10000 --lf_lrate 0.05 --resume xxx

Also, you can reproduce the evaulation results of AIS/HAIS/DAIS by runing vae/mnist_eval_scaling.py:

python vae/mnist_eval_scaling.py --linear_beta --lf_lrate 0.08 --n_particles 10 --resume xxx

Citation

To cite this work, please use

@inproceedings{
	zhang2021differentiable,
	title={Differentiable Annealed Importance Sampling and the Perils of Gradient Noise},
	author={Guodong Zhang and Kyle Hsu and Jianing Li and Chelsea Finn and Roger Baker Grosse},
	booktitle={Thirty-Fifth Conference on Neural Information Processing Systems},
	year={2021},
	url={https://openreview.net/forum?id=6rqjgrL7Lq}
}

Differentiable Annealed Importance Sampling (DAIS)

Related tags

Overview

Differentiable Annealed Importance Sampling (DAIS)

Bayesian Linear Regression

Variational Autoencoder

Citation

Owner

Guodong Zhang

The official repository for "Revealing unforeseen diagnostic image features with deep learning by detecting cardiovascular diseases from apical four-chamber ultrasounds"

FairyTailor: Multimodal Generative Framework for Storytelling

KGDet: Keypoint-Guided Fashion Detection (AAAI 2021)

Implementation for the paper: Invertible Denoising Network: A Light Solution for Real Noise Removal (CVPR2021).

[CVPR 2021] Monocular depth estimation using wavelets for efficiency

Code for KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.

Pseudo-rng-app - whos needs science to make a random number when you have pseudoscience?

An efficient 3D semantic segmentation framework for Urban-scale point clouds like SensatUrban, Campus3D, etc.

Wav2Vec for speech recognition, classification, and audio classification

Pretrained Cost Model for Distributed Constraint Optimization Problems

Corgis are the cutest creatures; have 30K of them!

Jetson Nano-based smart camera system that measures crowd face mask usage in real-time.

An University Project of Quera Web Crawling.

[CVPR 2022] Structured Sparse R-CNN for Direct Scene Graph Generation

A spatial genome aligner for analyzing multiplexed DNA-FISH imaging data.

Code for paper "Vocabulary Learning via Optimal Transport for Neural Machine Translation"

This repository contains the code for the paper "Hierarchical Motion Understanding via Motion Programs"

Official implementation of "Membership Inference Attacks Against Self-supervised Speech Models"

Freecodecamp Scientific Computing with Python Certification; Solution for Challenge 2: Time Calculator