i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

This is a public code repository for the publication:

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery
Cameron R Wolfe, Anastasios Kyrillidis

Environment/Dependencies

Requires anaconda to be installed (python3) Anaconda can be installed at https://www.anaconda.com/products/individual

conda create -n ispasp python=3.6 anaconda
conda activate ispasp
conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch
pip install -r requirements.txt

File Arrangement

Here we summarize all files present in this repo and their purpose.

+-- prune_resnet34_ispasp.py : i-SpaSP implementation for ResNet34
+-- prune_mobilenetv2_ispasp.py : i-SpaSP implementation for MobileNetV2
+-- lib/ : utility/helper functions
|   +-- data.py: helper functions for handling data
|   +-- utils.py: helper functions for computing performance metrics
+-- scripts/ : contains python scripts for running pruning experiments
|   +-- prune_rn34_ispasp.py: run an i-SpaSP pruning experiment for ResNet34  
|   +-- prune_mbnv2_ispasp.py: run an i-SpaSP pruning experiment for MobileNetV2
+-- requirements.txt : dependencies for pruning experiments

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Related tags

Overview

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Environment/Dependencies

File Arrangement

Owner

Cameron Ronald Wolfe

Flexible Networks for Learning Physical Dynamics of Deformable Objects (2021)

李云龙二次元风格化!打滚卖萌，使用了animeGANv2进行了视频的风格迁移

Fast, flexible and fun neural networks.

TensorFlow Ranking is a library for Learning-to-Rank (LTR) techniques on the TensorFlow platform

Library for machine learning stacking generalization.

This computer program provides a reference implementation of Lagrangian Monte Carlo in metric induced by the Monge patch

YOLOv5 detection interface - PyQt5 implementation

PyTorch implementation of "Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning"

Prml - Repository of notes, code and notebooks in Python for the book Pattern Recognition and Machine Learning by Christopher Bishop

A PyTorch implementation of SlowFast based on ICCV 2019 paper "SlowFast Networks for Video Recognition"

Animation of solving the traveling salesman problem to optimality using mixed-integer programming and iteratively eliminating sub tours

Uncertain natural language inference

Official repository for "PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation"

Detection of PCBA defect

RL Algorithms with examples in Python / Pytorch / Unity ML agents

Ground truth data for the Optical Character Recognition of Historical Classical Commentaries.

VarCLR: Variable Semantic Representation Pre-training via Contrastive Learning

Dataset used in "PlantDoc: A Dataset for Visual Plant Disease Detection" accepted in CODS-COMAD 2020

Tree LSTM implementation in PyTorch

Understanding Convolution for Semantic Segmentation