Will the Mock API data evolve?

Meta Comprehensive RAG Benchmark: KDD Cup 2
#1

Hello,

Will the data provided to run the Mock API evolve to include up to date data or is it frozen ?

Thank you

#2

Hello simon_jegou,

We don’t plan to evolve the Mock API data. Recall that " Every query is associated with a query_time (when the query was made), the query_time may affect the answers, in particular for dynamic questions.". However, the Mock API data used during Phase 1 and Phase 2 might not be exactly the same.

Best Regards,
The CRAG Team