Stochastic Offline RL Tasks

This codebase contains only the essential code for running the stochastic offline RL environments from the paper "You Can't Count on Luck: Why Decision Transformers Fail in Stochastic Environments" (arXiv).

Tasks:

• Connect 4 vs. a stochastic opponent
• 2048 (but ends at 128 to make it feasible as an offline RL task)
• Simplistic Gambling environment as a sanity check

Installation Instructions

• Install the gym-2048 package that is included.
• Install dependencies with pip install -r requirements.txt
• Run pip install -e . to install the stochastic_offline_envs package.
• Run the script download_datasets.py to download the datasets used in the paper.

Usage Instructions

Please see notebooks/env_example.ipynb for details about how to load the environments and offline datasets.