Pytorch implementation of Learning Rate Dropout.

Last update: Nov 25, 2022

Related tags

Deep Learning Learning-Rate-Dropout

Overview

Learning-Rate-Dropout

Pytorch implementation of Learning Rate Dropout.

Paper Link: https://arxiv.org/pdf/1912.00144.pdf

Train ResNet-34 for Cifar10:

run:

python main.py --model=resnet --optim=adam_lrd --lr=0.001 --LRD_p=0.5

python main.py --model=resnet --optim=adam --lr=0.001

python main.py --model=resnet --optim=sgd_lrd --lr=0.1 --LRD_p=0.5

python main.py --model=resnet --optim=sgd --lr=0.1 

python main.py --model=resnet --optim=rmsprop_lrd --lr=0.001 --LRD_p=0.5

python main.py --model=resnet --optim=rmsprop --lr=0.001

After training, run "plot.py" to show the learning curves.

Owner

GitHub Repository

Pytorch implementation of MixNMatch

MixNMatch: Multifactor Disentanglement and Encoding for Conditional Image Generation [Paper] Yuheng Li, Krishna Kumar Singh, Utkarsh Ojha, Yong Jae Le

910 Dec 30, 2022

Supplementary materials to "Spin-optomechanical quantum interface enabled by an ultrasmall mechanical and optical mode volume cavity" by H. Raniwala, S. Krastanov, M. Eichenfield, and D. R. Englund, 2022

Supplementary materials to "Spin-optomechanical quantum interface enabled by an ultrasmall mechanical and optical mode volume cavity" by H. Raniwala,

1 Jan 17, 2022

DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing

DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing Figure: Joint multi-attribute edits using DyStyle model. Great diversity

74 Dec 03, 2022

Implementation of ICCV 2021 oral paper -- A Novel Self-Supervised Learning for Gaussian Mixture Model

SS-GMM Implementation of ICCV 2021 oral paper -- Self-Supervised Image Prior Learning with GMM from a Single Noisy Image with supplementary material R

4 Dec 05, 2022

How to Train a GAN? Tips and tricks to make GANs work

(this list is no longer maintained, and I am not sure how relevant it is in 2020) How to Train a GAN? Tips and tricks to make GANs work While research

10.8k Dec 31, 2022

An Open-Source Tool for Automatic Disease Diagnosis..

OpenMedicalChatbox An Open-Source Package for Automatic Disease Diagnosis. Overview Due to the lack of open source for existing RL-base automated diag

8 Nov 08, 2022

unet for image segmentation

Implementation of deep learning framework -- Unet, using Keras The architecture was inspired by U-Net: Convolutional Networks for Biomedical Image Seg

4.1k Dec 31, 2022

This is an official implementation of our CVPR 2021 paper "Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression" (https://arxiv.org/abs/2104.02300)

Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression Introduction In this paper, we are interested in the bottom-up paradigm of estima

367 Dec 27, 2022

Official implementation for ICDAR 2021 paper "Handwritten Mathematical Expression Recognition with Bidirectionally Trained Transformer"

Handwritten Mathematical Expression Recognition with Bidirectionally Trained Transformer Description Convert offline handwritten mathematical expressi

87 Dec 27, 2022

This is the offical website for paper ''Category-consistent deep network learning for accurate vehicle logo recognition''

The Pytorch Implementation of Category-consistent deep network learning for accurate vehicle logo recognition This is the offical website for paper ''

28 Oct 29, 2022

Learning Domain Invariant Representations in Goal-conditioned Block MDPs

Learning Domain Invariant Representations in Goal-conditioned Block MDPs Beining Han, Chongyi Zheng, Harris Chan, Keiran Paster, Michael R. Zhang, Jim

3 Apr 12, 2022

李云龙二次元风格化!打滚卖萌，使用了animeGANv2进行了视频的风格迁移

李云龙二次元风格化！一键star、fork，你也可以生成这样的团长！打滚卖萌求star求fork! 0.效果展示视频效果前往B站观看效果最佳：李云龙二次元风格化： github开源repo：李云龙二次元风格化百度AIstudio开源地址,一键fork即可运行: 李云龙二次元风格化！一键fork

44 Dec 04, 2022

MM1 and MMC Queue Simulation using python - Results and parameters in excel and csv files

implementation of MM1 and MMC Queue on randomly generated data and evaluate simulation results then compare with analytical results and draw a plot curve for them, simulate some integrals and compare

1 Jan 19, 2022

A Simple Framwork for CV Pre-training Model (SOCO, VirTex, BEiT)

14 Jul 07, 2022

The project is associated with the recently-launched ICASSP 2022 Multi-channel Multi-party Meeting Transcription Challenge (M2MeT) to provide participants with baseline systems for speech recognition and speaker diarization in conference scenario.

M2MeT challenge baseline -- AliMeeting This project provides the baseline system recipes for the ICASSP 2020 Multi-channel Multi-party Meeting Transcr

81 Dec 08, 2022

Pytorch implementation of Learning Rate Dropout.

Related tags

Overview

Learning-Rate-Dropout

Owner

Pytorch implementation of MixNMatch

Supplementary materials to "Spin-optomechanical quantum interface enabled by an ultrasmall mechanical and optical mode volume cavity" by H. Raniwala, S. Krastanov, M. Eichenfield, and D. R. Englund, 2022

DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing

Implementation of ICCV 2021 oral paper -- A Novel Self-Supervised Learning for Gaussian Mixture Model

How to Train a GAN? Tips and tricks to make GANs work

An Open-Source Tool for Automatic Disease Diagnosis..

unet for image segmentation

This is an official implementation of our CVPR 2021 paper "Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression" (https://arxiv.org/abs/2104.02300)

Official implementation for ICDAR 2021 paper "Handwritten Mathematical Expression Recognition with Bidirectionally Trained Transformer"

This is the offical website for paper ''Category-consistent deep network learning for accurate vehicle logo recognition''

Learning Domain Invariant Representations in Goal-conditioned Block MDPs

李云龙二次元风格化!打滚卖萌，使用了animeGANv2进行了视频的风格迁移

MM1 and MMC Queue Simulation using python - Results and parameters in excel and csv files

A Simple Framwork for CV Pre-training Model (SOCO, VirTex, BEiT)

The project is associated with the recently-launched ICASSP 2022 Multi-channel Multi-party Meeting Transcription Challenge (M2MeT) to provide participants with baseline systems for speech recognition and speaker diarization in conference scenario.

🐾 Semantic segmentation of paws from cute pet images (PyTorch)

最新版本yolov5+deepsort目标检测和追踪，支持5.0版本可训练自己数据集

A PyTorch version of You Only Look at One-level Feature object detector

Latex code for making neural networks diagrams

This is the repository for the paper "Have I done enough planning or should I plan more?"