We are making the evaluation worker that we run during evaluations optional. We use this worker to generate videos during training.
What will happen if I disable the evaluation worker?
- Videos will not be generated during training.
- You can use one additional rollout worker in its place (by increasing
num_workersby 1). This is useful for those who are experiencing low throughput.
rllib's ARS, APEX implementations should work. They need more than one worker to work. A single evaluation worker results in training failures.
- The custom random agent code in the starter kit works with no additional modifications.
How can I disable the evaluation worker?
You should set
True in your experiment YAML file.
procgen-ppo: run: PPO env: procgen_env_wrapper disable_evaluation_worker: True stop: timesteps_total: 100000