Council-GAN - Implementation for our paper Breaking the Cycle - Colleagues are all you need (CVPR 2020)

Last update: Nov 16, 2022

Related tags

Deep Learning Council-GAN

Overview

Council-GAN

Implementation of our paper Breaking the Cycle - Colleagues are all you need (CVPR 2020)

Paper

Ori Nizan , Ayellet Tal, Breaking the Cycle - Colleagues are all you need [Project]

Temporary Telegram Bot

Send image to this telegram bot and it will send you back its female translation using our implementation

Usage

Install requirements

conda env create -f conda_requirements.yml

Downloading the dataset

Download the selfie to anime dataset:

bash ./scripts/download.sh U_GAT_IT_selfie2anime

Download the celeba glasses removal dataset:

bash ./scripts/download.sh celeba_glasses_removal

Download the celeba male to female dataset:

bash ./scripts/download.sh celeba_male2female

use your on dataset:

├──datasets
    └──DATASET_NAME
        ├──testA
            ├──im1.png
            ├──im2.png
            └── ...
        ├──testB
            ├──im3.png
            ├──im4.png
            └── ...
        ├──trainA
            ├──im5.png
            ├──im6.png
            └── ...
        └──trainB
            ├──im7.png
            ├──im8.png
            └── ...

and change the data_root attribute to ./datasets/DATASET_NAME in the yaml file

Training:

Selfie to anime:

python train.py --config configs/anime2face_council_folder.yaml --output_path ./outputs/council_anime2face_256_256 --resume

Glasses removel:

python train.py --config configs/galsses_council_folder.yaml --output_path ./outputs/council_glasses_128_128 --resume

Male to female:

python train.py --config configs/male2female_council_folder.yaml --output_path ./outputs/male2famle_256_256 --resume

Testing:

for converting all the images in input_folder using all the members in the council:

python test_on_folder.py --config configs/anime2face_council_folder.yaml --output_folder ./outputs/council_anime2face_256_256 --checkpoint ./outputs/council_anime2face_256_256/anime2face_council_folder/checkpoints/01000000 --input_folder ./datasets/selfie2anime/testB --a2b 0

or using spsified memeber:

python test_on_folder.py --config configs/anime2face_council_folder.yaml --output_folder ./outputs/council_anime2face_256_256 --checkpoint ./outputs/council_anime2face_256_256/anime2face_council_folder/checkpoints/b2a_gen_3_01000000.pt --input_folder ./datasets/selfie2anime/testB --a2b 0

Download Pretrain Models

Download pretrain male to female model:

bash ./scripts/download.sh pretrain_male_to_female

Then to convert images in --input_folder run:

python test_on_folder.py --config pretrain/m2f/256/male2female_council_folder.yaml --output_folder ./outputs/male2famle_256_256 --checkpoint pretrain/m2f/256/01000000 --input_folder ./datasets/celeba_male2female/testA --a2b 1

Download pretrain glasses removal model:

bash ./scripts/download.sh pretrain_glasses_removal

Then to convert images in --input_folder run:

python test_on_folder.py --config pretrain/glasses_removal/128/galsses_council_folder.yaml --output_folder ./outputs/council_glasses_128_128 --checkpoint pretrain/glasses_removal/128/01000000 --input_folder ./datasets/glasses/testA --a2b 1

Download pretrain selfie to anime model:

bash ./scripts/download.sh pretrain_selfie_to_anime

Then to convert images in --input_folder run:

python test_on_folder.py --config pretrain/anime/256/anime2face_council_folder.yaml --output_folder ./outputs/council_anime2face_256_256 --checkpoint pretrain/anime/256/01000000 --input_folder ./datasets/selfie2anime/testB --a2b 0

Test GUI:

test GUI on pretrain model:

male2female

python test_gui.py --config pretrain/m2f/128/male2female_council_folder.yaml --checkpoint pretrain/m2f/128/a2b_gen_0_01000000.pt --a2b 1

glasses Removal

python test_gui.py --config pretrain/glasses_removal/128/galsses_council_folder.yaml --checkpoint pretrain/glasses_removal/128/a2b_gen_3_01000000.pt --a2b 1

selfie2anime

python test_gui.py --config pretrain/anime/256/anime2face_council_folder.yaml --checkpoint pretrain/anime/256/b2a_gen_3_01000000.pt --a2b 0

Citation

@inproceedings{nizan2020council,
  title={Breaking the Cycle - Colleagues are all you need},
  author={Ori Nizan and Ayellet Tal},
  booktitle={IEEE conference on computer vision and pattern recognition (CVPR)},
  year={2020}
}

Acknowledgement

In this work we based our code on MUNIT implementation. Please cite the original MUNIT if you use their part of the code.

Council-GAN - Implementation for our paper Breaking the Cycle - Colleagues are all you need (CVPR 2020)

Related tags

Overview

Council-GAN

Paper

Temporary Telegram Bot

Usage

Install requirements

Downloading the dataset

Download the selfie to anime dataset:

Download the celeba glasses removal dataset:

Download the celeba male to female dataset:

use your on dataset:

Training:

Selfie to anime:

Glasses removel:

Male to female:

Testing:

Download Pretrain Models

Download pretrain male to female model:

Then to convert images in --input_folder run:

Download pretrain glasses removal model:

Then to convert images in --input_folder run:

Download pretrain selfie to anime model:

Then to convert images in --input_folder run:

Test GUI:

test GUI on pretrain model:

male2female

glasses Removal

selfie2anime

Citation

Acknowledgement

Owner

ori nizan

PyTorch Implementation of Vector Quantized Variational AutoEncoders.

This is the code of paper ``Contrastive Coding for Active Learning under Class Distribution Mismatch'' with python.

Code and Data for the paper: Molecular Contrastive Learning with Chemical Element Knowledge Graph [AAAI 2022]

50-days-of-Statistics-for-Data-Science - This repository consist of a 50-day program

A set of tools for creating and testing machine learning features, with a scikit-learn compatible API

Synthetic structured data generators

Pyramid Grafting Network for One-Stage High Resolution Saliency Detection. CVPR 2022

Reproduce ResNet-v2(Identity Mappings in Deep Residual Networks) with MXNet

New approach to benchmark VQA models

Official implementation for Scale-Aware Neural Architecture Search for Multivariate Time Series Forecasting

Use .csv files to record, play and evaluate motion capture data.

TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformers.

Lightweight library to build and train neural networks in Theano

Veri Setinizi Yolov5 Formatına Dönüştürün

The Ludii general game system, developed as part of the ERC-funded Digital Ludeme Project.

Implementation of U-Net and SegNet for building segmentation

Multimodal Temporal Context Network (MTCN)

Training code and evaluation benchmarks for the "Self-Supervised Policy Adaptation during Deployment" paper.

QueryFuzz implements a metamorphic testing approach to test Datalog engines.

Official PyTorch implementation for paper Context Matters: Graph-based Self-supervised Representation Learning for Medical Images