Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Video Background Music Generation with Controllable Music Transformer (ACM MM 2021 Oral)

Sionna: An Open-Source Library for Next-Generation Physical Layer Research

SphereFace: Deep Hypersphere Embedding for Face Recognition

3D2Unet: 3D Deformable Unet for Low-Light Video Enhancement (PRCV2021)

Full-featured Decision Trees and Random Forests learner.

Official Code for VideoLT: Large-scale Long-tailed Video Recognition (ICCV 2021)

Source code for paper "ATP: AMRize Than Parse! Enhancing AMR Parsing with PseudoAMRs" @NAACL-2022

Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"

Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imaging, ICCV2021 [PyTorch Code]

Visual Question Answering in Pytorch

Official code for "EagerMOT: 3D Multi-Object Tracking via Sensor Fusion" [ICRA 2021]

Latex code for making neural networks diagrams

A Framework for Encrypted Machine Learning in TensorFlow

Pytorch implementation of Each Part Matters: Local Patterns Facilitate Cross-view Geo-localization https://arxiv.org/abs/2008.11646

Benchmark spaces - Benchmarks of how well different two dimensional spaces work for clustering algorithms

Source code of "Hold me tight! Influence of discriminative features on deep network boundaries"

On the model-based stochastic value gradient for continuous reinforcement learning

TensorFlow GNN is a library to build Graph Neural Networks on the TensorFlow platform.

Tensorflow/Keras Plug-N-Play Deep Learning Models Compilation

FuseDream: Training-Free Text-to-Image Generationwith Improved CLIP+GAN Space OptimizationFuseDream: Training-Free Text-to-Image Generationwith Improved CLIP+GAN Space Optimization