Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

Source code of our BMVC 2021 paper: AniFormer: Data-driven 3D Animation with Transformer

GPT-Code-Clippy (GPT-CC) is an open source version of GitHub Copilot

PyTorch and Tensorflow functional model definitions

This repository contains numerical implementation for the paper Intertemporal Pricing under Reference Effects: Integrating Reference Effects and Consumer Heterogeneity.

PyTorch implementation of paper "IBRNet: Learning Multi-View Image-Based Rendering", CVPR 2021.

Single Red Blood Cell Hydrodynamic Traps Via the Generative Design

Codebase for BMVC 2021 paper "Text Based Person Search with Limited Data"

CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolution

Implementation of paper "Graph Condensation for Graph Neural Networks"

Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness

Detecting and Tracking Small and Dense Moving Objects in Satellite Videos: A Benchmark

PASTRIE: A Corpus of Prepositions Annotated with Supersense Tags in Reddit International English

Official pytorch implementation of DeformSyncNet: Deformation Transfer via Synchronized Shape Deformation Spaces

Game Agent Framework. Helping you create AIs / Bots that learn to play any game you own!

CodeContests is a competitive programming dataset for machine-learning

Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes

using STGCN to achieve egg classification task

Navigating StyleGAN2 w latent space using CLIP

Official PyTorch implementation of "Preemptive Image Robustification for Protecting Users against Man-in-the-Middle Adversarial Attacks" (AAAI 2022)

Deploying PyTorch Model to Production with FastAPI in CUDA-supported Docker