Temporary Service Outage because of Service Quotas on AWS

Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937 Meta KDD Cup 24 - CRAG - Retrieval Summarization
#1

Because of a large number of parallel submissions, we are experiencing issues with our Service Quotas on AWS, and hence not able to instantitate the required nodes for evaluations.

We are in touch with AWS to resolve this issue, and in the meantime, a set of the parallel submissions were manually stopped. These will automatically be re-evaluated over time. Please do not re-submit them again.

In the meantime, we request you to not make multiple parallel submissions, until this issue is resolved.
We very much appreciate your patience.

Best,
AIcrowd Team

1 Like
Oh, ops, it seems to be my submission failed abnormally "workflow shutdown with strategy: Stop"
#2

How long will it take for it to be re-evaluated? Where should we see the re-evaluated page? Round 1b ends in a few hours. Is it possible that the re-evaluation will be postponed and affect our results?@ aicrowd_team

1 Like