Pytorch implementation of Learning Rate Dropout.

Last update: Nov 25, 2022

Related tags

Deep Learning Learning-Rate-Dropout

Overview

Learning-Rate-Dropout

Pytorch implementation of Learning Rate Dropout.

Paper Link: https://arxiv.org/pdf/1912.00144.pdf

Train ResNet-34 for Cifar10:

run:

python main.py --model=resnet --optim=adam_lrd --lr=0.001 --LRD_p=0.5

python main.py --model=resnet --optim=adam --lr=0.001

python main.py --model=resnet --optim=sgd_lrd --lr=0.1 --LRD_p=0.5

python main.py --model=resnet --optim=sgd --lr=0.1 

python main.py --model=resnet --optim=rmsprop_lrd --lr=0.001 --LRD_p=0.5

python main.py --model=resnet --optim=rmsprop --lr=0.001

After training, run "plot.py" to show the learning curves.

Owner

GitHub Repository

Square Root Bundle Adjustment for Large-Scale Reconstruction

RootBA: Square Root Bundle Adjustment Project Page | Paper | Poster | Video | Code Table of Contents Citation Dependencies Installing dependencies on

205 Dec 20, 2022

Fake videos detection by tracing the source using video hashing retrieval.

Vision Transformer Based Video Hashing Retrieval for Tracing the Source of Fake Videos 🎉️ 📜 Directory Introduction VTL Trace Samples and Acc of Hash

56 Dec 22, 2022

Power Core Simulator!

Power Core Simulator Power Core Simulator is a simulator based off the Roblox game "Pinewood Builders Computer Core". In this simulator, you can choos

1 Nov 13, 2021

Open source implementation of "A Self-Supervised Descriptor for Image Copy Detection" (SSCD).

A Self-Supervised Descriptor for Image Copy Detection (SSCD) This is the open-source codebase for "A Self-Supervised Descriptor for Image Copy Detecti

68 Jan 04, 2023

PyTorch code for ICPR 2020 paper Future Urban Scene Generation Through Vehicle Synthesis

Future urban scene generation through vehicle synthesis This repository contains Pytorch code for the ICPR2020 paper "Future Urban Scene Generation Th

4 Oct 11, 2021

Multimodal Temporal Context Network (MTCN)

Multimodal Temporal Context Network (MTCN) This repository implements the model proposed in the paper: Evangelos Kazakos, Jaesung Huh, Arsha Nagrani,

13 Nov 24, 2022

yolov5目标检测模型的知识蒸馏（基于响应的蒸馏）

代码地址： https://github.com/Sharpiless/yolov5-knowledge-distillation 教师模型： python train.py --weights weights/yolov5m.pt \ --cfg models/yolov5m.ya

52 Dec 04, 2022

Probabilistic Entity Representation Model for Reasoning over Knowledge Graphs

Implementation for the paper: Probabilistic Entity Representation Model for Reasoning over Knowledge Graphs, Nurendra Choudhary, Nikhil Rao, Sumeet Ka

8 Nov 15, 2022

Trained on Simulated Data, Tested in the Real World

43 Nov 18, 2022

Open-source python package for the extraction of Radiomics features from 2D and 3D images and binary masks.

pyradiomics v3.0.1 Build Status Linux macOS Windows Radiomics feature extraction in Python This is an open-source python package for the extraction of

842 Dec 28, 2022

Code for pre-training CharacterBERT models (as well as BERT models).

Pre-training CharacterBERT (and BERT) This is a repository for pre-training BERT and CharacterBERT. DISCLAIMER: The code was largely adapted from an o

31 Dec 05, 2022

PyTorch framework, for reproducing experiments from the paper Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks

Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks. Code, based on the PyTorch framework, for reprodu

3 Dec 27, 2022

Pytorch implementation of Learning Rate Dropout.

Related tags

Overview

Learning-Rate-Dropout

Owner

Square Root Bundle Adjustment for Large-Scale Reconstruction

Fake videos detection by tracing the source using video hashing retrieval.

Power Core Simulator!

Open source implementation of "A Self-Supervised Descriptor for Image Copy Detection" (SSCD).

PyTorch code for ICPR 2020 paper Future Urban Scene Generation Through Vehicle Synthesis

Multimodal Temporal Context Network (MTCN)

yolov5目标检测模型的知识蒸馏（基于响应的蒸馏）

Probabilistic Entity Representation Model for Reasoning over Knowledge Graphs

Trained on Simulated Data, Tested in the Real World

Open-source python package for the extraction of Radiomics features from 2D and 3D images and binary masks.

Code for pre-training CharacterBERT models (as well as BERT models).

PyTorch framework, for reproducing experiments from the paper Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks

Efficient semidefinite bounds for multi-label discrete graphical models.

High performance distributed framework for training deep learning recommendation models based on PyTorch.

SynNet - synthetic tree generation using neural networks

prior-based-losses-for-medical-image-segmentation

This is the source code of the solver used to compete in the International Timetabling Competition 2019.

This is the repo for Uncertainty Quantification 360 Toolkit.

Improved Fitness Optimization Landscapes for Sequence Design

A custom DeepStack model for detecting 16 human actions.