himo_example.ipynb contains code for the illustrative task of Section 3.2 in the paper.

This is a Colaboratory notebook:

If your runtime doesn't include Haiku and Tree please run the cell labeled "Install extra dependencies" which contains the following pip installation commands:

!pip install dm-haiku

!pip install dm-tree

Value-driven Hindsight Modelling Arthur Guez, Fabio Viola, Théophane Weber, Lars Buesing, Steven Kapturowski, Doina Precup, David Silver, and Nicolas Heess Neural Information Processing Systems 2020, URL: https://arxiv.org/abs/2002.08329