PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Last update: Dec 18, 2022

Overview

octconv.pytorch

PyTorch implementation of Octave Convolution in Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution

ResNet-50/101 on ImageNet

Architecture	LR decay strategy	Parameters	GFLOPs	Top-1 / Top-5 Accuracy (%)
ResNet-50	step (90 epochs)	25.557M	4.089	76.010 / 92.834
ResNet-50	cosine (120 epochs)	25.557M	4.089	77.150 / 93.468
Oct-ResNet-50 (alpha=0.5)	cosine (120 epochs)	25.557M	2.367	77.640 / 93.662
ResNet-101	cosine (120 epochs)	44.549M	7.801	78.898 / 94.304
Oct-ResNet-101 (alpha=0.5)	cosine (120 epochs)	44.549M	3.991	78.794 / 94.330
ResNet-152	cosine (120 epochs)	60.193M	11.514	79.234 / 94.556
Oct-ResNet-152 (alpha=0.5)	cosine (120 epochs)	60.193M	5.615	79.258 / 94.480

MobileNet V1 on ImageNet

Architecture	LR decay strategy	Parameters	FLOPs	Top-1 / Top-5 Accuracy (%)
MobileNetV1	cosine (150 epochs)	4.232M	568.7M	72.238 / 90.536
Oct-MobileNetV1	cosine (150 epochs)	4.232M	318.2M	71.254 / 89.728

Acknowledgement

Official MXNet implmentation by @cypw

Citation

@InProceedings{Chen_2019_ICCV,
author = {Chen, Yunpeng and Fan, Haoqi and Xu, Bing and Yan, Zhicheng and Kalantidis, Yannis and Rohrbach, Marcus and Yan, Shuicheng and Feng, Jiashi},
title = {Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks With Octave Convolution},
booktitle = {The IEEE International Conference on Computer Vision (ICCV)},
month = {October},
year = {2019}
}

PyTorch implementation of Octave Convolution with pre-trained Oct-ResNet and Oct-MobileNet models

Related tags

Overview

octconv.pytorch

ResNet-50/101 on ImageNet

MobileNet V1 on ImageNet

Acknowledgement

Citation

Owner

Duo Li

Meta-Learning Sparse Implicit Neural Representations (NeurIPS 2021)

Jupyter notebooks showing best practices for using cx_Oracle, the Python DB API for Oracle Database

Node-level Graph Regression with Deep Gaussian Process Models

Audio-Visual Generalized Few-Shot Learning with Prototype-Based Co-Adaptation

Addon and nodes for working with structural biology and molecular data in Blender.

Implementations for the ICLR-2021 paper: SEED: Self-supervised Distillation For Visual Representation.

Code for our NeurIPS 2021 paper: Sparsely Changing Latent States for Prediction and Planning in Partially Observable Domains

Patch Rotation: A Self-Supervised Auxiliary Task for Robustness and Accuracy of Supervised Models

Aquarius - Enabling Fast, Scalable, Data-Driven Virtual Network Functions

The implementation for paper Joint t-SNE for Comparable Projections of Multiple High-Dimensional Datasets.

The Power of Scale for Parameter-Efficient Prompt Tuning

Machine Learning Privacy Meter: A tool to quantify the privacy risks of machine learning models with respect to inference attacks, notably membership inference attacks

Official implementation of Influence-balanced Loss for Imbalanced Visual Classification in PyTorch.

Here is the implementation of our paper S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations.

Graph InfoClust: Leveraging cluster-level node information for unsupervised graph representation learning

This is the pytorch code for the paper Curious Representation Learning for Embodied Intelligence.

YOLTv5 rapidly detects objects in arbitrarily large aerial or satellite images that far exceed the ~600×600 pixel size typically ingested by deep learning object detection frameworks

Weakly- and Semi-Supervised Panoptic Segmentation (ECCV18)

TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-Captured Scenarios

A containerized REST API around OpenAI's CLIP model.