‼️ Imp: Challenge Updates [24 April 2024]

Meta Comprehensive RAG Benchmark: KDD Cup 2
#1

Hello everyone,

Here are some updates for the challenge:

  • We added the “query_time” to the generate_answer function as an input.
  • We’ve corrected an error in the “number of days left” displayed on the main page; it will now accurately show that the challenge ends on 5/20/2024.
  • We are working on a batch inference solution and will share it soon. During the interim, we will increase the time-out limit for each example to 30s. Please note we might reduce this limit to a smaller number when the batch inference solution settles.

Thank you for your participation!
Team CRAG

#2
#3