Evaluation

NeurIPS 2022: CityLearn Challenge
#1

Hi,

I can see that there are two parallel eval servers. Is it one for train env and one for val env?

Also, is it possible to see separate scores for the train env and val env?

Many thanks.

1 Like
#2

Thanks for your question @andy8. The two parallel eval servers were both for train env in Phase I and both for train+val env in Phase II. Please see this post regarding the current server configuration.

Also, please see these posts regarding scores and this post regarding scores:

  1. Update to Evaluation Leaderboard
  2. Average Score Weighting