RVT: Robust Vision Transformers
This repository contains PyTorch code for Robust Vision Transformers.
For details see Rethinking the Design Principles of Robust Vision Transformer by Xiaofeng Mao, Gege Qi, Yuefeng Chen, Yuan He and Hui Xue.
Usage
First, clone the repository locally:
git clone https://github.com/vtddggg/Robust-Vision-Transformer.git
Then, install PyTorch 1.7.0+ and torchvision 0.8.1+ and pytorch-image-models 0.3.2:
conda install -c pytorch pytorch torchvision
pip install timm==0.3.2
We use 4 nodes with 8 gpus to train RVT-Ti, RVT-S and RVT-B:
Training RVT-Ti
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_tiny --data-path /path/to/imagenet --output_dir output --dist-eval
Training RVT-S
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_small --data-path /path/to/imagenet --output_dir output --dist-eval
Training RVT-B
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_base --data-path /path/to/imagenet --output_dir output --batch-size 32 --dist-eval
If you want to train RVT-Ti*, RVT-S* or RVT-B*, simply add --use_mask and --use_patch_aug to enable positon-aware attention scaling and patch-wise augmentation.
546 Dec 17, 2022
10 Oct 10, 2022
60 Oct 12, 2022
203 Nov 30, 2022
47 Dec 06, 2022
7 Jun 22, 2022
147 Dec 28, 2022
159 Dec 16, 2022
21 Oct 27, 2022
4 Dec 05, 2022
130 Dec 25, 2022
11 Oct 07, 2022
7 Oct 20, 2022
3 Jul 26, 2022
5 Jan 25, 2022
154 Sep 12, 2022
19 Apr 06, 2022
160 Dec 09, 2022
55 Dec 29, 2022
2 Dec 27, 2021