"Evaluation Failed"

Meta Comprehensive RAG Benchmark: KDD Cup 2
#1

Hello, I wonder what’s wrong with my latest submission. It completed the evaluation process and calculated the overall score with performance metrics. However, it shows the “evaluation failed”.

PixPin_2024-04-18_15-29-03
PixPin_2024-04-18_15-29-03730×415 17.8 KB

#2

@TaurusHorse : This is fixed now. Thanks for the heads up.
Please refer to https://gitlab.aicrowd.com/TaurusHorse/meta-comphrehensive-rag-benchmark-starter-kit/-/issues/10 for more details.

#3

Thanks for your reply. And I have another question about the exact deadline of submission date. In this page AIcrowd | Meta Comprehensive RAG Benchmark: KDD Cup 2024 | Challenges, there is one sentence " Phase 1 Submission End Date:May 20, 2024, 23:55 UTC".
However, at the header of the page，there is a countdown timer of "2024-05-14 03:13:00 UTC“.
I’d like to know what’s the difference between these two times.
image

#4

Hi TaurusHorse,

The Phase 1 end date is indeed 5/20/2024. The countdown timer on the main page has been fixed.

Thanks,
The CRAG Team