Offline Reinforcement Learning with Implicit Q-Learning

This repository contains the official implementation of Offline Reinforcement Learning with Implicit Q-Learning by Ilya Kostrikov, Ashvin Nair, and Sergey Levine.

If you use this code for your research, please consider citing the paper:

@article{kostrikov2021iql,
    title={Offline Reinforcement Learning with Implicit Q-Learning},
    author={Ilya Kostrikov and Ashvin Nair and Sergey Levine},
    year={2021},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

How to run the code

Install dependencies

pip install -r requirements.txt

See instructions for CUDA.

Run training

Locomotion

python train_offline.py --env_name=halfcheetah-medium-expert-v2 --config=configs/mujoco_config.py

AntMaze

python train_offline.py --env_name=antmaze-large-play-v0 --config=configs/antmaze_config.py --eval_episodes=100 --eval_interval=100000

Kitchen and Adroit

python train_offline.py --env_name=pen-human-v0 --config=configs/kitchen_config.py

Misc

The implementation is based on JAXRL.

Offline Reinforcement Learning with Implicit Q-Learning

Related tags

Overview

Offline Reinforcement Learning with Implicit Q-Learning

How to run the code

Install dependencies

Run training

Misc

Owner

Ilya Kostrikov

PyTorch implementation of Masked Autoencoders Are Scalable Vision Learners for self-supervised ViT.

🙄 Difficult algorithm, Simple code.

Official Implementation of "LUNAR: Unifying Local Outlier Detection Methods via Graph Neural Networks"

Py-FEAT: Python Facial Expression Analysis Toolbox

The code is for the paper "A Self-Distillation Embedded Supervised Affinity Attention Model for Few-Shot Segmentation"

Snscrape-jsonl-urls-extractor - Extracts urls from jsonl produced by snscrape

multimodal transformer

A GPT, made only of MLPs, in Jax

ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.

A Fast Sequence Transducer Implementation with PyTorch Bindings

Illuminated3D This project participates in the Nasa Space Apps Challenge 2021.

2D Time independent Schrodinger equation solver for arbitrary shape of well

Spectral Tensor Train Parameterization of Deep Learning Layers

I have created this Virtual Paint Program, in this you can paint(draw) on your screen using hand gestures, created in Python-3 using OpenCV and Mediapipe library. Gestures :- Index Finger for drawing and Index+Middle Finger for changing position and objects.

PyTorch implementation of Interpretable Explanations of Black Boxes by Meaningful Perturbation

Unifying Global-Local Representations in Salient Object Detection with Transformer

Latex code for making neural networks diagrams

offical implement of our Lifelong Person Re-Identification via Adaptive Knowledge Accumulation in CVPR2021

Official code base for the poster "On the use of Cortical Magnification and Saccades as Biological Proxies for Data Augmentation" published in NeurIPS 2021 Workshop (SVRHM)

Fortuitous Forgetting in Connectionist Networks