SMIS - Semantically Multi-modal Image Synthesis(CVPR 2020)

Last update: Dec 01, 2022

Related tags

Deep Learning SMIS

Overview

Semantically Multi-modal Image Synthesis

Project page / Paper / Demo

Semantically Multi-modal Image Synthesis(CVPR2020).
Zhen Zhu, Zhiliang Xu, Ansheng You, Xiang Bai

Requirements

torch>=1.0.0
torchvision
dominate
dill
scikit-image
tqdm
opencv-python

Getting Started

Data Preperation

DeepFashion
Note: We provide an example of the DeepFashion dataset. That is slightly different from the DeepFashion used in our paper due to the impact of the COVID-19.

Cityscapes
The Cityscapes dataset can be downloaded at here

ADE20K
The ADE20K dataset can be downloaded at here

Test/Train the models

Download the tar of the pretrained models from the Google Drive Folder. Save it in checkpoints/ and unzip it. There are deepfashion.sh, cityscapes.sh and ade20k.sh in the scripts folder. Change the parameters like --dataroot and so on, then comment or uncomment some code to test/train model. And you can specify the --test_mask for SMIS test.

Acknowledgments

Our code is based on the popular SPADE

SMIS - Semantically Multi-modal Image Synthesis(CVPR 2020)

Related tags

Overview

Semantically Multi-modal Image Synthesis

Project page / Paper / Demo

Requirements

Getting Started

Data Preperation

Test/Train the models

Acknowledgments

Owner

Deep metric learning methods implemented in Chainer

Pca-on-genotypes - Mini bioinformatics project - PCA on genotypes

Public Code for NIPS submission SimiGrad: Fine-Grained Adaptive Batching for Large ScaleTraining using Gradient Similarity Measurement

AdamW optimizer for bfloat16 models in pytorch.

Discovering Dynamic Salient Regions with Spatio-Temporal Graph Neural Networks

A simple version for graphfpn

Serving PyTorch 1.0 Models as a Web Server in C++

An Open Source Machine Learning Framework for Everyone

Instance-wise Feature Importance in Time (FIT)

Qcover is an open source effort to help exploring combinatorial optimization problems in Noisy Intermediate-scale Quantum(NISQ) processor.

a Lightweight library for sequential learning agents, including reinforcement learning

The implementation for paper Joint t-SNE for Comparable Projections of Multiple High-Dimensional Datasets.

AISTATS 2019: Confidence-based Graph Convolutional Networks for Semi-Supervised Learning

Code in PyTorch for the convex combination linear IAF and the Householder Flow, J.M. Tomczak & M. Welling

Fully Connected DenseNet for Image Segmentation

An off-line judger supporting distributed problem repositories

Generating Digital Painting Lighting Effects via RGB-space Geometry (SIGGRAPH2020/TOG2020)

A hybrid framework (neural mass model + ML) for SC-to-FC prediction

"Exploring Vision Transformers for Fine-grained Classification" at CVPRW FGVC8

Implementation of several Bayesian multi-target tracking algorithms, including Poisson multi-Bernoulli mixture filters for sets of targets and sets of trajectories. The repository also includes the GOSPA metric and a metric for sets of trajectories to evaluate performance.