PyTorch code accompanying the paper "Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning" (NeurIPS 2021).

Last update: Dec 14, 2022

Related tags

Deep Learning HIGL

Overview

HIGL

This is a PyTorch implementation for our paper: Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning (NeurIPS 2021).

Our code is based on official implementation of HRAC (NeurIPS 2020) and Map-planner (NeurIPS 2019)

Installation

conda create -n higl python=3.6
conda activate higl
./install_all.sh

Also, to run the MuJoCo experiments, a license is required (see here).

Usage

Training & Evaluation

Point Maze

./scripts/point_maze_sparse.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/point_maze_sparse.sh dense 5e5 0 2
./scripts/point_maze_sparse.sh sparse 5e5 0 2

Ant Maze (U-shape)

./scripts/higl_ant_maze_u.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u.sh dense 10e5 0 2
./scripts/higl_ant_maze_u.sh sparse 10e5 0 2

Ant Maze (W-shape)

./scripts/higl_ant_maze_w.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_w.sh dense 10e5 0 2
./scripts/higl_ant_maze_w.sh sparse 10e5 0 2

Reacher & Pusher

./scripts/higl_fetch.sh ${env} ${timesteps} ${gpu} ${seed}
./scripts/higl_fetch.sh Reacher3D-v0 5e5 0 2
./scripts/higl_fetch.sh Pusher-v0 10e5 0 2

Stochastic Ant Maze (U-shape)

./scripts/higl_ant_maze_u_stoch.sh ${reward_shaping} ${timesteps} ${gpu} ${seed}
./scripts/higl_ant_maze_u_stoch.sh dense 10e5 0 2
./scripts/higl_ant_maze_u_stoch.sh sparse 10e5 0 2

PyTorch code accompanying the paper "Landmark-Guided Subgoal Generation in Hierarchical Reinforcement Learning" (NeurIPS 2021).

Related tags

Overview

HIGL

Installation

Usage

Training & Evaluation

Owner

Junsu Kim

DFM: A Performance Baseline for Deep Feature Matching

This is the official code for the paper "Learning with Nested Scene Modeling and Cooperative Architecture Search for Low-Light Vision"

Import Python modules from dicts and JSON formatted documents.

A tensorflow implementation of GCN-LPA

Download files from DSpace systems (because for some reason DSpace won't let you)

“Data Augmentation for Cross-Domain Named Entity Recognition” (EMNLP 2021)

Adaptive Pyramid Context Network for Semantic Segmentation (APCNet CVPR'2019)

MASS (Mueen's Algorithm for Similarity Search) - a python 2 and 3 compatible library used for searching time series sub-sequences under z-normalized Euclidean distance for similarity.

CowHerd is a partially-observed reinforcement learning environment

A package, and script, to perform imaging transcriptomics on a neuroimaging scan.

Code for the paper Task Agnostic Morphology Evolution.

Improving Query Representations for DenseRetrieval with Pseudo Relevance Feedback:A Reproducibility Study.

EFENet: Reference-based Video Super-Resolution with Enhanced Flow Estimation

🏅 The Most Comprehensive List of Kaggle Solutions and Ideas 🏅

Supervised Sliding Window Smoothing Loss Function Based on MS-TCN for Video Segmentation

Yolov5 deepsort inference，使用YOLOv5+Deepsort实现车辆行人追踪和计数，代码封装成一个Detector类，更容易嵌入到自己的项目中

VSR-Transformer - This paper proposes a new Transformer for video super-resolution (called VSR-Transformer).

Learning What and Where to Draw

Tzer: TVM Implementation of "Coverage-Guided Tensor Compiler Fuzzing with Joint IR-Pass Mutation (OOPSLA'22)“.

Codes for "Template-free Prompt Tuning for Few-shot NER".