First, we should install the Atari environments with:
pip install .[atari]
For more information: https://gymnasium.farama.org/environments/atari/
It is important to remind that not all the algorithms can work with images, so it is necessary to check the first table in the README and select a proper algorithm. The list of selectable algorithms is given below:
dreamer_v1
dreamer_v2
dreamer_v3
p2e_dv1
p2e_dv2
p2e_dv3
ppo
ppo_decoupled
sac_ae
Once you have chosen the algorithm you want to train, you can start the train, for instance, of the ppo agent by running:
python sheeprl.py exp=ppo env=atari env.id=PongNoFrameskip-v4 algo.cnn_keys.encoder=[rgb] fabric.accelerator=cpu fabric.strategy=ddp fabric.devices=2 algo.mlp_keys.encoder=[]