RVT: Robust Vision Transformers
This repository contains PyTorch code for Robust Vision Transformers.
For details see Rethinking the Design Principles of Robust Vision Transformer by Xiaofeng Mao, Gege Qi, Yuefeng Chen, Yuan He and Hui Xue.
Usage
First, clone the repository locally:
git clone https://github.com/vtddggg/Robust-Vision-Transformer.git
Then, install PyTorch 1.7.0+ and torchvision 0.8.1+ and pytorch-image-models 0.3.2:
conda install -c pytorch pytorch torchvision
pip install timm==0.3.2
We use 4 nodes with 8 gpus to train RVT-Ti, RVT-S and RVT-B:
Training RVT-Ti
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_tiny --data-path /path/to/imagenet --output_dir output --dist-eval
Training RVT-S
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_small --data-path /path/to/imagenet --output_dir output --dist-eval
Training RVT-B
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_base --data-path /path/to/imagenet --output_dir output --batch-size 32 --dist-eval
If you want to train RVT-Ti*, RVT-S* or RVT-B*, simply add --use_mask and --use_patch_aug to enable positon-aware attention scaling and patch-wise augmentation.
535 Nov 15, 2022
0 Aug 17, 2021
45 Dec 15, 2022
172 Dec 22, 2022
2 Aug 21, 2022
62 Nov 12, 2022
50 Jun 07, 2022
260 Dec 14, 2022
91 Nov 10, 2022
464 Dec 27, 2022
323 Jan 01, 2023
297 Dec 26, 2022
89 Jan 02, 2023
1.8k Dec 25, 2022
401 Dec 28, 2022
5 Nov 18, 2021
1.7k Dec 29, 2022
164 Dec 30, 2022
2.6k Jan 01, 2023
3 Aug 17, 2022