Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Last update: Dec 10, 2022

Related tags

Overview

AdvRush

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Environmental Set-up

Python == 3.6.12, PyTorch == 1.2.0, torchvision == 0.4.0

AdvRush Search Process

cd advrush && python train_search.py --batch_size 32 --gpu 0 --epochs 60 --a_gamma 0.01 --a_warmup_epochs 0 --w_warmup_epochs 60 --loss_hessian loss_cure

Adversarial Training

cd advrush && python adv_train.py --batch_size 64 --gpu 0 --epochs 200 --adv_loss pgd --arch ADVRUSH

Evaluation under PGD Attack

Prior to the evaluation process, add all necessary checkpoint files (preferably in the form of .pth.tar) to the /eval/checkpoints folder. To conduct white-box attacks,

cd eval &&
python pgd_attack.py --white-box-attack True --test-batch-size 10 --arch [arch_name] --checkpoint [./checkpoints/file_name.pth.tar] --data_type [cifar10/svhn]

To conduct black-box attacks,

cd eval &&
python pgd_attack.py --test-batch-size 10 --target_arch [target_arch] --target_checkpoint [./checkpoints/target_file.pth.tar] --source_arch [source_arch] --source_checkpoint [./checkpoints/source_file.pth.tar] --data_type cifar10

References

DARTS: Differentiable Architecture Search [ICLR '19] code paper

Robustness via Curvature Regularization, and Vice Versa [CVPR '19] code paper

Tradeoff-inspired Adversarial Defense via Surrogate-loss Minimization [ICML '19] code paper

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Related tags

Overview

AdvRush

Environmental Set-up

AdvRush Search Process

Adversarial Training

Evaluation under PGD Attack

References

Owner

Minimal PyTorch implementation of Generative Latent Optimization from the paper "Optimizing the Latent Space of Generative Networks"

Weakly-Supervised Semantic Segmentation Network with Deep Seeded Region Growing (CVPR 2018).

A Joint Video and Image Encoder for End-to-End Retrieval

Repo for the Tutorials of Day1-Day3 of the Nordic Probabilistic AI School 2021 (https://probabilistic.ai/)

Companion code for the paper "An Infinite-Feature Extension for Bayesian ReLU Nets That Fixes Their Asymptotic Overconfidence" (NeurIPS 2021)

This folder contains the implementation of the multi-relational attribute propagation algorithm.

Library extending Jupyter notebooks to integrate with Apache TinkerPop and RDF SPARQL.

NAS-Bench-x11 and the Power of Learning Curves

YKKDetector For Python

This initial strategy was developed specifically for larger pools and is based on taking a moving average and deriving Bollinger Bands to create a projected active liquidity range.

Numenta published papers code and data

Jremesh-tools - Blender addon for quad remeshing

Deep Learning pipeline for motor-imagery classification.

CasualHealthcare's Pneumonia detection with Artificial Intelligence (Convolutional Neural Network)

Code for CVPR 2021 paper TransNAS-Bench-101: Improving Transferrability and Generalizability of Cross-Task Neural Architecture Search.

Official Tensorflow implementation of "M-LSD: Towards Light-weight and Real-time Line Segment Detection"

Official Repo of my work for SREC Nandyal Machine Learning Bootcamp

Official implementation of UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation

The MLOps platform for innovators 🚀