I am trying to run train_experiment.py in the baselines/RLLib_training folder, but the import PPOPolicy Graph doesn’t exist. I’ve looked through the source code of ray/rllib/agents/ppo and there is indeed no such module. Help.
File "render_training_result.py", line 8, in <module>
from ray.rllib.agents.ppo.ppo_policy_graph import PPOPolicyGraph as PolicyGraph
ModuleNotFoundError: No module named 'ray.rllib.agents.ppo.ppo_policy_graph'