Computation resource limit in evaluation for IGLU NLP task

NeurIPS 2022 IGLU Challenge
#1

Hi,

I did not find any information about the computation resource limit for evaluation in the AIcrowd evaluator. Could you provide some information about that? For example, how many GPUs at max can be used in the AIcrowd evaluator?

Thanks.

1 Like
#2

Hi, the resources and limits can be found in the starting kit for the NLP track.

The time allotted for the ranker is 60 minutes and for the classifier it is 30 minutes.

The current resources available are:

  • 1 NVIDIA T4 GPU with 16 GB Mem
  • 8 vCPUs
  • 56GB RAM