RLLib config for Round 2

#1

Hi everybody,

I’m trying to configure RLLib https://github.com/ray-project/ray/tree/master/rllib with Flatland 2.1.8 for Round 2, starting from the code that was available in the baselines for Round 1, but I’m getting the following errors:

TypeError: can’t pickle _thread.lock objects

And using Tune:
TypeError: Object of type ‘TreeObsForRailEnv’ is not JSON serializable

This happens both using ray version 0.7.0 (as suggested in the old README) and the latest ray 0.7.6.
Someone that managed to configure RLLib with Flatland could give me some advice about that?

Thanks in advance!