Thanks, @MasterScrat. I found out that I had the previous version of flatland-rl due to which the error was coming.
flatland-rl