RVT: Robust Vision Transformers

This repository contains PyTorch code for Robust Vision Transformers.

For details see Rethinking the Design Principles of Robust Vision Transformer by Xiaofeng Mao, Gege Qi, Yuefeng Chen, Yuan He and Hui Xue.

Usage

First, clone the repository locally:

git clone https://github.com/vtddggg/Robust-Vision-Transformer.git

Then, install PyTorch 1.7.0+ and torchvision 0.8.1+ and pytorch-image-models 0.3.2:

conda install -c pytorch pytorch torchvision
pip install timm==0.3.2

We use 4 nodes with 8 gpus to train RVT-Ti, RVT-S and RVT-B:

Training RVT-Ti

python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_tiny --data-path /path/to/imagenet --output_dir output --dist-eval

Training RVT-S

python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_small --data-path /path/to/imagenet --output_dir output --dist-eval

Training RVT-B

python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_base --data-path /path/to/imagenet --output_dir output --batch-size 32 --dist-eval

If you want to train RVT-Ti*, RVT-S* or RVT-B*, simply add --use_mask and --use_patch_aug to enable positon-aware attention scaling and patch-wise augmentation.

This repository contains PyTorch code for Robust Vision Transformers.

Related tags

Overview

RVT: Robust Vision Transformers

Usage

Training RVT-Ti

Training RVT-S

Training RVT-B

Owner

Simple Tensorflow implementation of Toward Spatially Unbiased Generative Models (ICCV 2021)

Pytorch Implementation of the paper "Cross-domain Correspondence Learning for Exemplar-based Image Translation"

Large-scale language modeling tutorials with PyTorch

Seach Losses of our paper 'Loss Function Discovery for Object Detection via Convergence-Simulation Driven Search', accepted by ICLR 2021.

PyTorch Implementation of the paper Learning to Reweight Examples for Robust Deep Learning

Pytorch implemenation of Stochastic Multi-Label Image-to-image Translation (SMIT)

Semantically Contrastive Learning for Low-light Image Enhancement

Ağ tarayıcı.Gönderdiği paketler ile ağa bağlı olan cihazların IP adreslerini gösterir.

DiffQ performs differentiable quantization using pseudo quantization noise. It can automatically tune the number of bits used per weight or group of weights, in order to achieve a given trade-off between model size and accuracy.

DCGAN LSGAN WGAN-GP DRAGAN PyTorch

This project provides a stock market environment using OpenGym with Deep Q-learning and Policy Gradient.

Code for paper "Context-self contrastive pretraining for crop type semantic segmentation"

Simple reference implementation of GraphSAGE.

Implementation of Bottleneck Transformer in Pytorch

Pytorch implementation of Deep Recursive Residual Network for Super Resolution (DRRN)

Model-free Vehicle Tracking and State Estimation in Point Cloud Sequences

unet for image segmentation

Style-based Point Generator with Adversarial Rendering for Point Cloud Completion (CVPR 2021)

ZeroGen: Efficient Zero-shot Learning via Dataset Generation

Pytorch implementation of AREL