Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

[CVPR 2021 Oral] Variational Relational Point Completion Network

Instance Segmentation by Jointly Optimizing Spatial Embeddings and Clustering Bandwidth

A multi-scale unsupervised learning for deformable image registration

OntoProtein: Protein Pretraining With Ontology Embedding

PAMI stands for PAttern MIning. It constitutes several pattern mining algorithms to discover interesting patterns in transactional/temporal/spatiotemporal databases

Boosted CVaR Classification (NeurIPS 2021)

Code for the ICCV 2021 Workshop paper: A Unified Efficient Pyramid Transformer for Semantic Segmentation.

Companion code for the paper "An Infinite-Feature Extension for Bayesian ReLU Nets That Fixes Their Asymptotic Overconfidence" (NeurIPS 2021)

This is a Python Module For Encryption, Hashing And Other stuff

The open source code of SA-UNet: Spatial Attention U-Net for Retinal Vessel Segmentation.

A `Neural = Symbolic` framework for sound and complete weighted real-value logic

iris - Open Source Photos Platform Powered by PyTorch

Evaluating saliency methods on artificial data with different background types

Code for Multimodal Neural SLAM for Interactive Instruction Following

hySLAM is a hybrid SLAM/SfM system designed for mapping

Parameterized Explainer for Graph Neural Network

CT Based COVID 19 Diagnose by Image Processing and Deep Learning

Pytorch Implementation for CVPR2018 Paper: Learning to Compare: Relation Network for Few-Shot Learning

Streamlit app demonstrating an image browser for the Udacity self-driving-car dataset with realtime object detection using YOLO.

Mercer Gaussian Process (MGP) and Fourier Gaussian Process (FGP) Regression